2024-08-17T02:13:29.749 INFO:root:teuthology version: 1.2.0 2024-08-17T02:13:29.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:13:29.864 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858282 branch: wip-mchangir-mgr-volumes-print-thread-name-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} email: mchangir@redhat.com first_in_suite: false job_id: '7858282' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - filesystem is online with fewer MDS than max_mds - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: enable_coprs: - ceph/el9 flavor: default sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e owner: scheduled_mchangir@teuthology priority: 25 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5995 sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e sleep_before_teardown: 0 suite: fs suite_branch: wip-mchangir-mgr-volumes-print-thread-name-quincy suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e targets: smithi106.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO1Ta5zL3w7mLnP283c23abNRd/7DV9crWcVL8qxYpe+l9Ry8CT4sFm0uBwVup3bNfa6BtiYk11Lkxb+nPleO+8= smithi171.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNhJ++dhQ+d+AIxfFaqSLzfV5bE9AW1EXBCBdn4fShNwx8M33Eg8n91yuPiIU5weAfvyBPAQRsSs9HOyrAIGBlY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-17_01:10:27 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-17T02:13:29.864 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa; will attempt to use it 2024-08-17T02:13:29.865 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks 2024-08-17T02:13:29.865 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-17T02:13:29.867 INFO:teuthology.task.internal:Checking packages... 2024-08-17T02:13:29.887 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2577e8139c6b8786f9d6d6ea21b8da9244b9260e' 2024-08-17T02:13:29.887 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-17T02:13:29.887 INFO:teuthology.packaging:ref: None 2024-08-17T02:13:29.887 INFO:teuthology.packaging:tag: None 2024-08-17T02:13:29.887 INFO:teuthology.packaging:branch: wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:13:29.887 INFO:teuthology.packaging:sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:13:29.888 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:13:30.026 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-1375.g2577e813 2024-08-17T02:13:30.027 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-17T02:13:30.033 INFO:teuthology.task.internal:no buildpackages task found 2024-08-17T02:13:30.033 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-17T02:13:30.098 INFO:teuthology.task.internal:Saving configuration 2024-08-17T02:13:30.114 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-17T02:13:30.120 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-17T02:13:30.146 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi106.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858282', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:04:00.799371', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO1Ta5zL3w7mLnP283c23abNRd/7DV9crWcVL8qxYpe+l9Ry8CT4sFm0uBwVup3bNfa6BtiYk11Lkxb+nPleO+8='} 2024-08-17T02:13:30.169 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858282', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:04:00.797815', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNhJ++dhQ+d+AIxfFaqSLzfV5bE9AW1EXBCBdn4fShNwx8M33Eg8n91yuPiIU5weAfvyBPAQRsSs9HOyrAIGBlY='} 2024-08-17T02:13:30.169 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-17T02:13:30.176 INFO:teuthology.task.internal:roles: ubuntu@smithi106.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-08-17T02:13:30.176 INFO:teuthology.task.internal:roles: ubuntu@smithi171.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-08-17T02:13:30.176 INFO:teuthology.run_tasks:Running task console_log... 2024-08-17T02:13:30.229 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f913ad1fac0>, signals=[15]) 2024-08-17T02:13:30.230 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-17T02:13:30.235 INFO:teuthology.task.internal:Opening connections... 2024-08-17T02:13:30.236 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi106.front.sepia.ceph.com 2024-08-17T02:13:30.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:13:30.310 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi171.front.sepia.ceph.com 2024-08-17T02:13:30.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:13:30.386 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-17T02:13:30.391 DEBUG:teuthology.orchestra.run.smithi106:> uname -m 2024-08-17T02:13:30.409 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2024-08-17T02:13:30.410 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2024-08-17T02:13:30.466 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="CentOS Stream" 2024-08-17T02:13:30.466 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="9" 2024-08-17T02:13:30.466 INFO:teuthology.orchestra.run.smithi106.stdout:ID="centos" 2024-08-17T02:13:30.467 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:13:30.467 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="9" 2024-08-17T02:13:30.467 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:13:30.467 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:13:30.467 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31" 2024-08-17T02:13:30.467 INFO:teuthology.orchestra.run.smithi106.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:13:30.467 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:13:30.467 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:13:30.467 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:13:30.467 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:13:30.467 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:13:30.468 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2024-08-17T02:13:30.492 DEBUG:teuthology.orchestra.run.smithi171:> uname -m 2024-08-17T02:13:30.510 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2024-08-17T02:13:30.510 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2024-08-17T02:13:30.567 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream" 2024-08-17T02:13:30.567 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="9" 2024-08-17T02:13:30.567 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos" 2024-08-17T02:13:30.567 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:13:30.567 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="9" 2024-08-17T02:13:30.567 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:13:30.567 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:13:30.567 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31" 2024-08-17T02:13:30.567 INFO:teuthology.orchestra.run.smithi171.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:13:30.567 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:13:30.567 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:13:30.568 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:13:30.568 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:13:30.568 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:13:30.568 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2024-08-17T02:13:30.592 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-17T02:13:30.602 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-17T02:13:30.608 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-17T02:13:30.609 DEBUG:teuthology.orchestra.run.smithi106:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:13:30.611 DEBUG:teuthology.orchestra.run.smithi171:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:13:30.627 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-17T02:13:30.633 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-17T02:13:30.634 DEBUG:teuthology.orchestra.run.smithi106:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:13:30.668 DEBUG:teuthology.orchestra.run.smithi171:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:13:30.761 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-17T02:13:30.814 INFO:teuthology.run_tasks:Running task kernel... 2024-08-17T02:13:30.829 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-17T02:13:30.829 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-08-17T02:13:30.829 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-08-17T02:13:30.830 DEBUG:teuthology.orchestra.run.smithi106:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:13:30.830 DEBUG:teuthology.orchestra.run.smithi171:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:13:30.847 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:13:30.847 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:13:30.848 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:13:30.849 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:13:31.005 DEBUG:teuthology.task.kernel:sha1 for client.0 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:13:31.006 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:13:31.006 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2024-08-17T02:13:31.011 DEBUG:teuthology.task.kernel:sha1 for client.1 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:13:31.011 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:13:31.012 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2024-08-17T02:13:31.023 INFO:teuthology.orchestra.run.smithi106.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:13:31.024 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:13:31.024 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:13:31.024 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum upgrade -y linux-firmware 2024-08-17T02:13:31.029 INFO:teuthology.orchestra.run.smithi171.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:13:31.030 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:13:31.030 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:13:31.030 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum upgrade -y linux-firmware 2024-08-17T02:13:33.049 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.2 MB 00:00 2024-08-17T02:13:33.511 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.2 MB 00:00 2024-08-17T02:13:36.745 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 20 MB 00:02 2024-08-17T02:13:41.858 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 20 MB 00:07 2024-08-17T02:13:42.545 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.6 MB 00:02 2024-08-17T02:13:44.396 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 18 kB 00:00 2024-08-17T02:13:45.733 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux 19 MB/s | 22 MB 00:01 2024-08-17T02:13:46.359 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - CRB 9.2 MB/s | 6.6 MB 00:00 2024-08-17T02:13:48.022 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - Extras packages 56 kB/s | 18 kB 00:00 2024-08-17T02:13:49.222 INFO:teuthology.orchestra.run.smithi106.stdout:Extra Packages for Enterprise Linux 21 MB/s | 22 MB 00:01 2024-08-17T02:13:51.056 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras 21 kB/s | 1.7 kB 00:00 2024-08-17T02:13:53.132 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-08-17T02:13:53.143 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-08-17T02:13:53.143 INFO:teuthology.orchestra.run.smithi171.stdout: Package Architecture Version Repository Size 2024-08-17T02:13:53.143 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-08-17T02:13:53.143 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrading: 2024-08-17T02:13:53.144 INFO:teuthology.orchestra.run.smithi171.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:13:53.144 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:13:53.144 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-08-17T02:13:53.144 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-08-17T02:13:53.144 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrade 1 Package 2024-08-17T02:13:53.144 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:13:53.144 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 383 M 2024-08-17T02:13:53.144 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-08-17T02:13:54.594 INFO:teuthology.orchestra.run.smithi106.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-08-17T02:13:56.696 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-08-17T02:13:56.709 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-08-17T02:13:56.709 INFO:teuthology.orchestra.run.smithi106.stdout: Package Architecture Version Repository Size 2024-08-17T02:13:56.709 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-08-17T02:13:56.709 INFO:teuthology.orchestra.run.smithi106.stdout:Upgrading: 2024-08-17T02:13:56.709 INFO:teuthology.orchestra.run.smithi106.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:13:56.709 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:13:56.709 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-08-17T02:13:56.709 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-08-17T02:13:56.709 INFO:teuthology.orchestra.run.smithi106.stdout:Upgrade 1 Package 2024-08-17T02:13:56.710 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:13:56.710 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 383 M 2024-08-17T02:13:56.710 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2024-08-17T02:13:58.657 INFO:teuthology.orchestra.run.smithi171.stdout:linux-firmware-20240716-145.el9.noarch.rpm 70 MB/s | 383 MB 00:05 2024-08-17T02:13:58.657 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:13:58.657 INFO:teuthology.orchestra.run.smithi171.stdout:Total 70 MB/s | 383 MB 00:05 2024-08-17T02:14:01.739 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-08-17T02:14:01.905 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-08-17T02:14:01.906 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-08-17T02:14:03.296 INFO:teuthology.orchestra.run.smithi106.stdout:linux-firmware-20240716-145.el9.noarch.rpm 59 MB/s | 383 MB 00:06 2024-08-17T02:14:03.296 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:14:03.296 INFO:teuthology.orchestra.run.smithi106.stdout:Total 58 MB/s | 383 MB 00:06 2024-08-17T02:14:05.471 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-08-17T02:14:05.471 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-08-17T02:14:06.391 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2024-08-17T02:14:06.598 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2024-08-17T02:14:06.598 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2024-08-17T02:14:10.066 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2024-08-17T02:14:10.067 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2024-08-17T02:14:14.744 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-08-17T02:14:15.460 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:14:15.550 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:14:16.420 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:14:16.420 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:14:17.133 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:14:17.133 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:14:17.133 INFO:teuthology.orchestra.run.smithi171.stdout:Upgraded: 2024-08-17T02:14:17.133 INFO:teuthology.orchestra.run.smithi171.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:14:17.134 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:14:17.134 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-08-17T02:14:17.453 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:14:17.454 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:14:17.597 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:14:17.598 DEBUG:teuthology.orchestra.run.smithi171:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:14:17.600 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi171.front.sepia.ceph.com to complete... 2024-08-17T02:14:19.403 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2024-08-17T02:14:20.039 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:14:20.114 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:14:21.079 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:14:21.080 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:14:21.819 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:14:21.819 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:14:21.819 INFO:teuthology.orchestra.run.smithi106.stdout:Upgraded: 2024-08-17T02:14:21.819 INFO:teuthology.orchestra.run.smithi106.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:14:21.820 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:14:21.820 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-08-17T02:14:22.128 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:14:22.128 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:14:22.273 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:14:22.274 DEBUG:teuthology.orchestra.run.smithi106:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:14:22.277 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi106.front.sepia.ceph.com to complete... 2024-08-17T02:14:56.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17 02:14:56 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:14:56.129 INFO:teuthology.orchestra.run.smithi106.stderr:FINISHED --2024-08-17 02:14:56-- 2024-08-17T02:14:56.129 INFO:teuthology.orchestra.run.smithi106.stderr:Total wall clock time: 34s 2024-08-17T02:14:56.129 INFO:teuthology.orchestra.run.smithi106.stderr:Downloaded: 1 files, 344M in 33s (10.3 MB/s) 2024-08-17T02:14:56.132 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:14:56.133 DEBUG:teuthology.orchestra.run.smithi106:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:14:58.223 INFO:teuthology.orchestra.run.smithi106.stdout:Verifying... ######################################## 2024-08-17T02:14:58.646 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing... ######################################## 2024-08-17T02:14:58.698 INFO:teuthology.orchestra.run.smithi106.stdout:Updating / installing... 2024-08-17T02:15:06.663 INFO:teuthology.orchestra.run.smithi106.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:15:32.750 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17 02:15:32 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:15:32.750 INFO:teuthology.orchestra.run.smithi171.stderr:FINISHED --2024-08-17 02:15:32-- 2024-08-17T02:15:32.750 INFO:teuthology.orchestra.run.smithi171.stderr:Total wall clock time: 1m 15s 2024-08-17T02:15:32.751 INFO:teuthology.orchestra.run.smithi171.stderr:Downloaded: 1 files, 344M in 1m 15s (4.61 MB/s) 2024-08-17T02:15:32.754 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:15:32.754 DEBUG:teuthology.orchestra.run.smithi171:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:15:34.833 INFO:teuthology.orchestra.run.smithi171.stdout:Verifying... ######################################## 2024-08-17T02:15:34.874 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing... ######################################## 2024-08-17T02:15:34.924 INFO:teuthology.orchestra.run.smithi171.stdout:Updating / installing... 2024-08-17T02:15:43.009 INFO:teuthology.orchestra.run.smithi171.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:15:44.708 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi106.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:15:44.708 DEBUG:teuthology.orchestra.run.smithi106:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:15:44.795 INFO:teuthology.orchestra.run.smithi106.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:44.795 INFO:teuthology.orchestra.run.smithi106.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:44.795 INFO:teuthology.orchestra.run.smithi106.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:44.795 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:44.795 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:15:44.795 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:15:44.795 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:15:44.795 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:15:44.796 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:15:44.796 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:15:44.796 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:15:44.796 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:15:44.796 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:15:44.796 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:15:44.796 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:15:44.796 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:15:44.796 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:15:44.796 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:15:44.796 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:15:44.796 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:15:44.796 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:15:44.797 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:15:44.797 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:15:44.797 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:15:44.797 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:15:44.797 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:15:44.797 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:15:44.797 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:15:44.797 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:15:44.797 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:15:44.797 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:15:44.797 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:15:44.797 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:15:44.797 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:15:44.798 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:15:44.798 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:15:44.798 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:15:44.798 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:15:44.798 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:15:44.798 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:15:44.798 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:15:44.798 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:15:44.798 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:15:44.798 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:15:44.798 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:15:44.798 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:15:44.798 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:15:44.799 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:15:44.799 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:15:44.799 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:15:44.799 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:15:44.799 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:15:44.799 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:15:44.799 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:15:44.799 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:15:44.799 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:15:44.799 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:15:44.799 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:15:44.799 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:15:44.799 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:15:44.799 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:15:44.800 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:15:44.800 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:15:44.800 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:15:44.800 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:15:44.800 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:15:44.800 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:15:44.800 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:15:44.800 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:15:44.800 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:15:44.800 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:15:44.800 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:15:44.800 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:15:44.800 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:15:44.800 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:15:44.801 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:15:44.801 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:15:44.801 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:15:44.801 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:15:44.801 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:15:44.801 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:15:44.801 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:15:44.801 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:15:44.801 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:15:44.801 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:15:44.802 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:15:44.802 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:15:44.802 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:15:44.802 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:15:44.802 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:15:44.802 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:15:44.802 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:15:44.802 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:15:44.802 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:15:44.802 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:15:44.802 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:15:44.802 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:15:44.802 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:15:44.803 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:15:44.803 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:15:44.803 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:15:44.803 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:15:44.803 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:15:44.803 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:15:44.803 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:15:44.803 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:15:44.803 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:15:44.803 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:15:44.803 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:15:44.803 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:15:44.803 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:15:44.804 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:15:44.804 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:15:44.804 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:15:44.804 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:15:44.804 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:15:44.804 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:15:44.804 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:15:44.804 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:15:44.804 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:15:44.804 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:15:44.804 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:15:44.804 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:15:44.805 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:15:44.805 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:15:44.805 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:15:44.805 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:15:44.805 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:15:44.805 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:15:44.805 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:15:44.805 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:15:44.805 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:15:44.805 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:15:44.805 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:15:44.805 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:15:44.806 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:15:44.806 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:15:44.806 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:15:44.806 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:15:44.806 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:15:44.806 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:15:44.806 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:15:44.806 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:15:44.806 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:15:44.806 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:15:44.806 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:15:44.806 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:15:44.806 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:15:44.807 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:15:44.807 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:15:44.807 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:15:44.807 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:15:44.807 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:15:44.807 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:15:44.807 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:15:44.807 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:15:44.807 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:15:44.807 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:15:44.807 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:15:44.807 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:15:44.807 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:15:44.807 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:15:44.808 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:15:44.808 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:15:44.808 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:15:44.808 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:15:44.808 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:15:44.808 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:15:44.808 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:15:44.808 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:15:44.808 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:15:44.808 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:15:44.808 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:15:44.808 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:15:44.808 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:15:44.808 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:15:44.809 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:15:44.809 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:15:44.809 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:15:44.809 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:15:44.809 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:15:44.809 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:15:44.809 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:15:44.809 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:15:44.809 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:15:44.809 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:15:44.809 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:15:44.809 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:15:44.810 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:15:44.810 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:15:44.810 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:15:44.810 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:15:44.810 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:15:44.810 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:15:44.810 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:15:44.810 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:15:44.810 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:15:44.810 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:15:44.810 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:15:44.810 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:15:44.810 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:15:44.810 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:15:44.811 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:15:44.811 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:15:44.811 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:15:44.811 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:15:44.811 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:15:44.811 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:15:44.811 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:15:44.811 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:15:44.811 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:15:44.811 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:15:44.811 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:15:44.811 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:15:44.811 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:15:44.811 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:15:44.812 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:15:44.812 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:15:44.812 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:15:44.812 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:15:44.812 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:15:44.812 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:15:44.812 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:15:44.812 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:15:44.812 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:15:44.812 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:15:44.812 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:15:44.812 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:15:44.812 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:15:44.812 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:15:44.813 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:15:44.813 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:15:44.813 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:15:44.813 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:15:44.813 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:15:44.813 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:15:44.813 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:15:44.813 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:15:44.813 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:15:44.813 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:15:44.813 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:15:44.813 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:15:44.813 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:15:44.814 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:15:44.814 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:15:44.814 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:15:44.814 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:15:44.814 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:15:44.814 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:15:44.814 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:15:44.814 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:15:44.814 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:15:44.814 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:15:44.814 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:15:44.814 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:15:44.815 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:15:44.815 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:15:44.815 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:15:44.815 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:15:44.815 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:15:44.815 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:15:44.815 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:15:44.815 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:15:44.815 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:15:44.815 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:15:44.815 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:15:44.815 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:15:44.815 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:15:44.815 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:15:44.816 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:15:44.816 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:15:44.816 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:15:44.816 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:15:44.816 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:15:44.816 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:15:44.816 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:15:44.816 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:15:44.816 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:15:44.816 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:15:44.816 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:15:44.816 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:15:44.816 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:15:44.816 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:15:44.817 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:15:44.817 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:15:44.817 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:15:44.817 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:15:44.817 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:15:44.817 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:15:44.817 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:15:44.817 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:15:44.817 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:15:44.817 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:15:44.817 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:15:44.817 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:15:44.817 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:15:44.817 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:15:44.818 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:15:44.818 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:15:44.818 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:15:44.818 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:15:44.818 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:15:44.818 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:15:44.818 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:15:44.818 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:15:44.818 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:15:44.818 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:15:44.818 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:15:44.818 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:15:44.818 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:15:44.819 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:15:44.819 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:15:44.819 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:15:44.819 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:15:44.819 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:15:44.819 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:15:44.819 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:15:44.819 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:15:44.819 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:15:44.819 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:15:44.819 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:15:44.819 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:15:44.819 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:15:44.820 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:15:44.820 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:15:44.820 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:15:44.820 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:15:44.820 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:15:44.820 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:15:44.820 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:15:44.820 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:15:44.820 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:15:44.820 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:15:44.820 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:15:44.820 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:15:44.820 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:15:44.820 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:15:44.821 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:15:44.821 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:15:44.821 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:15:44.821 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:15:44.821 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:15:44.821 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:15:44.821 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:15:44.821 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:15:44.821 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:15:44.821 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:15:44.821 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:15:44.821 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:15:44.821 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:15:44.822 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:15:44.822 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:15:44.822 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:15:44.822 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:15:44.822 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:15:44.822 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:15:44.822 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:15:44.822 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:15:44.822 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:15:44.822 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:15:44.822 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:15:44.822 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:15:44.822 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:15:44.823 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:15:44.823 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:15:44.823 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:15:44.823 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:15:44.823 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:15:44.823 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:15:44.823 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:15:44.823 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:15:44.823 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:15:44.823 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:15:44.823 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:15:44.823 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:15:44.823 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:15:44.824 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:15:44.824 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:15:44.824 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:15:44.824 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:15:44.824 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:15:44.824 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:15:44.824 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:15:44.824 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:15:44.824 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:15:44.824 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:15:44.824 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:15:44.824 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:15:44.825 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:15:44.825 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:15:44.825 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:15:44.825 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:15:44.825 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:15:44.825 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:15:44.825 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:15:44.825 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:15:44.825 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:15:44.825 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:15:44.825 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:15:44.826 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:15:44.826 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:15:44.826 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:15:44.826 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:15:44.826 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:15:44.826 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:15:44.826 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:15:44.826 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:15:44.826 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:15:44.826 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:15:44.826 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:15:44.826 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:15:44.826 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:15:44.826 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:15:44.827 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:15:44.827 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:15:44.827 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:15:44.827 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:15:44.827 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:15:44.827 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:15:44.827 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:15:44.827 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:15:44.827 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:15:44.827 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:15:44.827 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:15:44.827 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:15:44.827 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:15:44.828 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:15:44.828 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:15:44.828 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:15:44.828 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:15:44.828 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:15:44.828 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:15:44.828 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:15:44.828 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:15:44.828 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:15:44.828 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:15:44.828 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:15:44.828 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:15:44.828 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:15:44.828 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:15:44.829 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:15:44.829 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:15:44.829 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:15:44.829 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:15:44.829 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:15:44.829 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:15:44.829 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:15:44.829 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:15:44.829 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:15:44.829 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:15:44.829 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:15:44.829 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:15:44.829 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:15:44.829 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:15:44.830 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:15:44.830 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:15:44.830 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:15:44.830 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:15:44.830 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:15:44.830 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:15:44.830 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:15:44.830 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:15:44.830 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:15:44.830 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:15:44.830 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:15:44.830 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:15:44.830 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:15:44.831 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:15:44.831 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:15:44.831 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:15:44.831 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:15:44.831 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:15:44.831 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:15:44.831 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:15:44.831 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:15:44.831 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:15:44.831 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:15:44.831 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:15:44.831 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:15:44.831 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:15:44.832 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:15:44.832 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:15:44.832 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:15:44.832 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:15:44.832 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:15:44.832 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:15:44.832 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:15:44.832 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:15:44.832 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:15:44.832 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:15:44.832 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:15:44.832 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:15:44.832 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:15:44.832 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:15:44.833 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:15:44.833 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:15:44.833 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:15:44.833 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:15:44.833 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:15:44.833 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:15:44.833 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:15:44.833 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:15:44.833 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:15:44.833 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:15:44.833 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:15:44.833 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:15:44.833 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:15:44.834 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:15:44.834 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:15:44.834 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:15:44.834 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:15:44.834 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:15:44.834 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:15:44.834 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:15:44.834 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:15:44.834 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:15:44.834 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:15:44.834 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:15:44.834 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:15:44.834 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:15:44.834 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:15:44.835 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:15:44.835 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:15:44.835 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:15:44.835 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:15:44.835 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:15:44.835 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:15:44.835 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:15:44.835 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:15:44.835 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:15:44.835 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:15:44.835 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:15:44.835 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:15:44.836 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:15:44.836 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:15:44.836 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:15:44.836 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:15:44.836 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:15:44.836 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:15:44.836 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:15:44.836 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:15:44.836 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:15:44.836 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:15:44.836 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:15:44.837 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:15:44.837 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:15:44.837 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:15:44.837 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:15:44.837 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:15:44.837 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:15:44.837 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:15:44.837 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:15:44.837 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:15:44.837 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:15:44.837 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:15:44.837 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:15:44.837 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:15:44.837 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:15:44.838 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:15:44.838 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:15:44.838 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:15:44.838 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:15:44.838 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:15:44.838 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:15:44.838 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:15:44.838 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:15:44.838 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:15:44.838 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:15:44.838 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:15:44.838 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:15:44.838 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:15:44.838 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:15:44.839 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:15:44.839 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:15:44.839 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:15:44.839 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:15:44.839 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:15:44.839 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:15:44.839 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:15:44.839 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:15:44.839 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:15:44.839 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:15:44.839 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:15:44.839 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:15:44.839 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:15:44.840 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:15:44.840 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:15:44.840 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:15:44.840 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:15:44.840 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:15:44.840 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:15:44.840 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:15:44.840 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:15:44.840 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:15:44.840 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:15:44.840 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:15:44.840 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:15:44.840 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:15:44.841 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:15:44.841 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:15:44.841 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:15:44.841 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:15:44.841 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:15:44.841 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:15:44.841 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:15:44.841 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:15:44.841 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:15:44.841 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:15:44.841 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:15:44.841 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:15:44.841 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:15:44.842 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:15:44.842 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:15:44.842 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:15:44.842 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:15:44.842 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:15:44.842 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:15:44.842 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:15:44.842 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:15:44.842 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:15:44.842 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:15:44.842 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:15:44.842 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:15:44.842 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:15:44.843 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:15:44.843 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:15:44.843 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:15:44.843 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:15:44.843 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:15:44.843 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:15:44.843 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:15:44.843 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:15:44.843 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:15:44.843 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:15:44.843 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:15:44.843 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:15:44.843 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:15:44.843 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:15:44.844 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:15:44.844 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:15:44.844 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:15:44.844 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:15:44.844 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:15:44.844 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:15:44.844 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:15:44.844 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:15:44.844 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:15:44.844 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:15:44.844 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:15:44.844 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:15:44.844 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:15:44.845 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:15:44.845 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:15:44.845 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:15:44.845 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:15:44.845 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:15:44.845 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:15:44.845 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:15:44.845 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:15:44.845 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:15:44.845 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:15:44.845 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:15:44.845 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:15:44.846 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:15:44.846 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:15:44.846 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:15:44.846 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:15:44.846 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:15:44.846 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:15:44.846 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:15:44.846 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:15:44.846 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:15:44.846 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:15:44.846 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:15:44.846 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:15:44.846 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:15:44.847 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:15:44.847 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:15:44.847 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:15:44.847 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:15:44.847 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:15:44.847 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:15:44.847 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:15:44.847 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:15:44.847 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:15:44.848 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:15:44.848 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:15:44.848 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:15:44.848 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:15:44.848 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:15:44.848 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:15:44.848 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:15:44.848 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:15:44.848 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:15:44.848 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:15:44.848 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:15:44.849 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:15:44.849 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:15:44.849 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:15:44.849 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:15:44.849 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:15:44.849 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:15:44.849 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:15:44.849 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:15:44.849 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:15:44.849 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:15:44.849 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:15:44.849 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:15:44.849 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:15:44.850 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:15:44.850 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:15:44.850 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:15:44.850 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:15:44.850 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:15:44.850 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:15:44.850 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:15:44.850 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:15:44.850 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:15:44.850 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:15:44.850 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:15:44.850 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:15:44.850 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:15:44.850 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:15:44.851 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:15:44.851 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:15:44.851 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:15:44.851 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:15:44.851 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:15:44.851 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:15:44.851 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:15:44.851 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:15:44.851 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:15:44.851 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:15:44.851 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:15:44.851 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:15:44.851 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:15:44.851 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:15:44.852 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:15:44.852 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:15:44.852 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:15:44.852 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:15:44.852 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:15:44.852 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:15:44.852 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:15:44.852 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:15:44.852 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:15:44.852 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:15:44.852 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:15:44.852 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:15:44.852 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:15:44.852 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:15:44.853 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:15:44.853 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:15:44.853 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:15:44.853 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:15:44.853 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:15:44.853 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:15:44.853 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:15:44.853 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:15:44.853 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:15:44.853 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:15:44.853 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:15:44.853 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:15:44.853 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:15:44.854 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:15:44.854 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:15:44.854 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:15:44.854 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:15:44.854 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:15:44.854 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:15:44.854 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:15:44.854 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:15:44.854 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:15:44.854 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:15:44.855 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:15:44.855 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:15:44.855 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:15:44.855 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:15:44.855 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:15:44.855 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:15:44.855 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:15:44.855 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:15:44.855 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:15:44.855 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:15:44.855 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:15:44.855 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:15:44.855 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:15:44.856 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:15:44.856 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:15:44.856 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:15:44.856 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:15:44.856 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:15:44.856 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:15:44.856 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:15:44.856 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:15:44.856 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:15:44.856 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:15:44.856 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:15:44.856 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:15:44.856 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:15:44.857 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:15:44.857 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:15:44.857 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:15:44.857 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:15:44.857 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:15:44.857 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:15:44.857 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:15:44.857 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:15:44.857 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:15:44.857 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:15:44.857 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:15:44.857 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:15:44.857 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:15:44.857 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:15:44.858 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:15:44.858 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:15:44.858 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:15:44.858 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:15:44.858 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:15:44.858 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:15:44.858 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:15:44.858 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:15:44.858 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:15:44.858 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:15:44.858 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:15:44.858 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:15:44.859 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:15:44.859 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:15:44.859 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:15:44.859 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:15:44.859 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:15:44.859 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:15:44.859 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:15:44.859 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:15:44.859 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:15:44.859 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:15:44.859 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:15:44.859 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:15:44.859 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:15:44.859 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:15:44.860 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:15:44.860 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:15:44.860 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:15:44.860 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:15:44.860 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:15:44.860 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:15:44.860 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:15:44.860 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:15:44.860 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:15:44.860 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:15:44.860 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:15:44.860 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:15:44.860 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:15:44.860 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:15:44.861 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:15:44.861 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:15:44.861 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:15:44.861 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:15:44.861 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:15:44.861 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:15:44.861 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:15:44.861 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:15:44.861 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:15:44.861 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:15:44.861 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:15:44.861 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:15:44.861 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:15:44.861 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:15:44.862 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:15:44.862 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:15:44.862 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:15:44.862 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:15:44.862 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:15:44.862 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:15:44.862 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:15:44.862 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:15:44.862 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:15:44.862 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:15:44.862 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:15:44.862 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:15:44.862 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:15:44.862 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:15:44.862 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:15:44.863 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:15:44.863 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:15:44.863 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:15:44.863 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:15:44.863 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:15:44.863 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:15:44.863 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:15:44.863 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:15:44.863 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:15:44.863 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:15:44.863 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:15:44.863 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:15:44.863 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:15:44.863 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:15:44.864 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:15:44.864 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:15:44.864 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:15:44.864 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:15:44.864 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:15:44.864 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:15:44.864 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:15:44.864 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:15:44.864 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:15:44.864 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:15:44.864 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:15:44.864 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:15:44.864 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:15:44.864 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:15:44.865 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:15:44.865 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:15:44.865 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:15:44.865 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:15:44.865 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:15:44.865 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:15:44.865 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:15:44.865 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:15:44.865 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:15:44.865 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:15:44.865 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:15:44.865 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:15:44.865 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:15:44.866 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:15:44.866 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:15:44.866 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:15:44.866 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:15:44.866 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:15:44.866 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:15:44.866 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:15:44.868 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:15:44.868 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:15:44.869 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:15:44.869 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:15:44.869 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:15:44.869 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:15:44.869 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:15:44.869 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:15:44.869 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:15:44.869 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:15:44.870 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:15:44.870 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:15:44.870 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:15:44.870 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:15:44.870 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:15:44.870 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:15:44.871 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:15:44.871 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:15:44.871 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:15:44.871 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:15:44.871 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:15:44.871 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:15:44.871 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:15:44.871 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:15:44.871 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:15:44.871 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:15:44.871 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:15:44.871 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:15:44.871 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:15:44.872 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:15:44.872 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:15:44.872 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:15:44.872 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:15:44.872 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:15:44.872 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:15:44.872 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:15:44.872 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:15:44.872 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:15:44.872 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:15:44.872 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:15:44.872 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:15:44.872 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:15:44.873 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:15:44.873 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:15:44.873 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:15:44.873 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:15:44.873 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:15:44.873 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:15:44.873 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:15:44.873 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:15:44.873 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:15:44.873 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:15:44.873 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:15:44.873 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:15:44.873 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:15:44.873 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:15:44.873 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:15:44.874 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:15:44.874 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:15:44.874 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:15:44.874 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:15:44.874 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:15:44.874 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:15:44.874 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:15:44.874 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:15:44.874 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:15:44.874 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:15:44.874 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:15:44.874 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:15:44.874 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:15:44.875 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:15:44.875 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:15:44.875 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:15:44.875 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:15:44.875 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:15:44.875 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:15:44.875 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:15:44.875 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:15:44.875 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:15:44.875 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:15:44.875 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:15:44.875 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:15:44.876 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:15:44.876 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:15:44.876 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:15:44.876 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:15:44.876 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:15:44.876 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:15:44.876 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:15:44.876 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:15:44.877 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:15:44.877 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:15:44.877 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:15:44.877 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:15:44.877 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:15:44.877 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:15:44.877 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:15:44.877 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:15:44.877 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:15:44.877 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:15:44.877 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:15:44.877 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:15:44.877 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:15:44.877 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:15:44.878 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:15:44.878 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:15:44.878 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:15:44.878 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:15:44.878 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:15:44.878 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:15:44.878 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:15:44.878 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:15:44.878 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:15:44.878 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:15:44.878 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:15:44.878 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:15:44.879 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:15:44.879 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:15:44.879 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:15:44.879 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:15:44.879 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:15:44.879 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:15:44.879 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:15:44.879 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:15:44.879 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:15:44.879 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:15:44.879 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:15:44.879 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:15:44.879 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:15:44.880 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:15:44.880 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:15:44.880 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:15:44.880 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:15:44.880 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:15:44.880 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:15:44.880 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:15:44.880 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:15:44.880 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:15:44.880 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:15:44.880 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:15:44.880 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:15:44.880 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:15:44.880 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:15:44.881 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:15:44.881 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:15:44.881 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:15:44.881 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:15:44.881 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:15:44.881 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:15:44.881 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:15:44.881 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:15:44.881 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:15:44.881 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:15:44.881 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:15:44.881 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:15:44.881 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:15:44.882 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:15:44.882 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:15:44.882 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:15:44.882 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:15:44.882 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:15:44.882 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:15:44.882 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:15:44.882 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:15:44.882 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:15:44.882 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:15:44.882 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:15:44.882 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:15:44.882 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:15:44.882 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:15:44.883 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:15:44.883 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:15:44.883 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:15:44.883 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:15:44.883 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:15:44.883 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:15:44.883 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:15:44.883 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:15:44.883 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:15:44.883 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:15:44.883 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:15:44.883 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:15:44.883 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:15:44.884 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:15:44.884 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:15:44.884 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:15:44.884 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:15:44.884 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:15:44.884 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:15:44.884 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:15:44.884 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:15:44.884 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:15:44.884 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:15:44.884 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:15:44.884 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:15:44.885 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:15:44.885 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:15:44.886 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:15:44.886 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:15:44.886 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:15:44.886 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:15:44.886 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:15:44.886 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:15:44.886 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:15:44.886 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:15:44.886 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:15:44.886 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:15:44.886 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:15:44.886 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:15:44.887 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:15:44.887 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:15:44.887 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:15:44.887 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:15:44.887 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:15:44.887 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:15:44.887 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:15:44.887 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:15:44.887 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:15:44.887 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:15:44.887 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:15:44.887 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:15:44.888 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:15:44.888 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:15:44.888 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:15:44.888 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:15:44.888 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:15:44.888 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:15:44.888 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:15:44.888 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:15:44.888 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:15:44.888 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:15:44.888 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:15:44.888 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:15:44.888 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:15:44.888 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:15:44.889 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:15:44.889 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:15:44.889 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:15:44.889 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:15:44.889 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:15:44.889 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:15:44.889 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:15:44.889 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:15:44.889 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:15:44.889 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:15:44.889 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:15:44.889 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:15:44.889 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:15:44.889 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:15:44.890 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:15:44.890 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:15:44.890 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:15:44.890 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:15:44.890 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:15:44.890 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:15:44.890 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:15:44.890 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:15:44.890 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:15:44.890 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:15:44.890 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:15:44.890 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:15:44.890 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:15:44.891 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:15:44.891 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:15:44.891 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:15:44.891 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:15:44.891 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:15:44.891 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:15:44.891 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:15:44.891 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:15:44.891 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:15:44.891 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:15:44.892 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:15:44.892 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:15:44.892 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:15:44.892 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:15:44.892 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:15:44.892 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:15:44.892 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:15:44.892 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:15:44.892 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:15:44.892 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:15:44.892 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:15:44.892 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:15:44.892 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:15:44.892 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:15:44.893 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:15:44.893 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:15:44.893 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:15:44.893 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:15:44.893 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:15:44.893 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:15:44.893 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:15:44.893 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:15:44.893 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:15:44.893 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:15:44.893 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:15:44.893 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:15:44.894 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:15:44.894 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:15:44.894 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:15:44.894 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:15:44.894 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:15:44.894 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:15:44.894 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:15:44.894 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:15:44.894 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:15:44.894 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:15:44.895 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:15:44.895 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:15:44.895 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:15:44.895 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:15:44.895 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:15:44.895 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:15:44.895 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:15:44.895 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:15:44.895 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:15:44.895 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:15:44.895 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:15:44.895 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:15:44.895 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:15:44.895 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:15:44.896 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:15:44.896 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:15:44.896 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:15:44.896 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:15:44.896 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:15:44.896 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:15:44.896 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:15:44.896 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:15:44.896 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:15:44.896 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:15:44.896 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:15:44.896 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:15:44.896 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:15:44.896 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:15:44.897 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:15:44.897 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:15:44.897 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:15:44.897 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:15:44.897 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:15:44.897 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:15:44.897 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:15:44.897 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:15:44.897 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:15:44.897 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:15:44.897 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:15:44.897 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:15:44.897 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:15:44.897 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:15:44.898 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:15:44.898 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:15:44.898 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:15:44.898 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:15:44.898 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:15:44.898 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:15:44.898 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:15:44.898 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:15:44.898 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:15:44.898 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:15:44.898 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:15:44.898 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:15:44.898 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:15:44.899 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:15:44.899 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:15:44.899 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:15:44.899 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:15:44.899 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:15:44.899 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:15:44.899 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:15:44.899 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:15:44.899 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:15:44.899 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:15:44.899 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:15:44.899 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:15:44.899 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:15:44.899 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:15:44.900 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:15:44.900 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:15:44.900 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:15:44.900 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:15:44.900 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:15:44.900 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:15:44.900 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:15:44.900 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:15:44.900 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:15:44.900 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:15:44.900 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:15:44.900 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:15:44.900 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:15:44.900 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:15:44.900 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:15:44.901 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:15:44.901 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:15:44.901 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:15:44.901 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:15:44.901 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:15:44.901 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:15:44.901 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:15:44.901 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:15:44.901 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:15:44.901 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:15:44.901 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:15:44.901 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:15:44.901 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:15:44.901 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:15:44.902 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:15:44.902 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:15:44.902 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:15:44.902 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:15:44.902 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:15:44.902 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:15:44.902 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:15:44.902 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:15:44.902 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:15:44.902 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:15:44.902 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:15:44.902 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:15:44.902 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:15:44.902 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:15:44.903 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:15:44.903 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:15:44.903 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:15:44.903 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:15:44.903 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:15:44.903 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:15:44.903 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:15:44.903 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:15:44.903 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:15:44.903 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:15:44.903 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:15:44.903 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:15:44.903 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:15:44.904 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:15:44.904 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:15:44.904 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:15:44.904 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:15:44.904 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:15:44.904 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:15:44.904 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:15:44.904 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:15:44.904 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:15:44.904 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:15:44.904 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:15:44.904 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:15:44.904 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:15:44.904 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:15:44.905 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:15:44.905 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:15:44.905 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:15:44.905 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:15:44.905 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:15:44.905 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:15:44.905 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:15:44.905 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:15:44.905 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:15:44.905 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:15:44.905 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:15:44.905 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:15:44.905 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:15:44.905 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:15:44.906 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:15:44.906 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:15:44.906 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:15:44.906 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:15:44.906 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:15:44.906 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:15:44.906 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:15:44.906 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:15:44.906 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:15:44.906 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:15:44.906 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:15:44.906 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:15:44.906 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:15:44.906 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:15:44.907 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:15:44.907 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:15:44.907 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:15:44.907 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:15:44.907 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:15:44.907 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:15:44.907 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:15:44.907 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:15:44.907 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:15:44.907 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:15:44.908 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:15:44.908 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:15:44.908 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:15:44.908 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:15:44.908 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:15:44.908 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:15:44.908 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:15:44.908 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:15:44.908 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:15:44.908 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:15:44.909 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:15:44.909 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:15:44.909 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:15:44.909 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:15:44.909 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:15:44.909 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:15:44.909 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:15:44.909 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:15:44.909 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:15:44.909 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:15:44.909 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:15:44.909 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:15:44.909 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:15:44.909 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:15:44.910 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:15:44.910 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:15:44.910 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:15:44.910 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:15:44.910 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:15:44.910 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:15:44.910 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:15:44.910 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:15:44.910 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:15:44.910 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:15:44.910 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:15:44.910 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:15:44.910 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:15:44.911 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:15:44.911 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:15:44.911 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:15:44.911 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:15:44.911 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:15:44.911 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:15:44.911 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:15:44.911 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:15:44.911 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:15:44.911 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:15:44.911 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:15:44.911 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:15:44.911 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:15:44.912 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:15:44.912 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:15:44.912 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:15:44.912 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:15:44.912 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:15:44.912 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:15:44.912 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:15:44.912 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:15:44.912 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:15:44.912 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:15:44.912 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:15:44.912 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:15:44.912 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:15:44.912 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:15:44.913 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:15:44.913 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:15:44.913 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:15:44.913 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:15:44.913 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:15:44.913 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:15:44.913 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:15:44.913 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:15:44.913 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:15:44.913 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:15:44.913 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:15:44.913 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:15:44.913 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:15:44.913 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:15:44.914 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:15:44.914 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:15:44.914 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:15:44.914 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:15:44.914 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:15:44.914 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:15:44.914 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:15:44.914 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:15:44.914 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:15:44.914 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:15:44.914 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:15:44.914 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:15:44.914 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:15:44.915 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:15:44.915 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:15:44.915 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:15:44.915 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:15:44.915 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:15:44.915 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:15:44.915 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:15:44.915 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:15:44.915 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:15:44.915 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:15:44.915 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:15:44.915 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:15:44.915 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:15:44.915 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:15:44.915 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:15:44.916 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:15:44.916 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:15:44.916 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:15:44.916 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:15:44.916 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:15:44.916 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:15:44.916 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:15:44.916 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:15:44.916 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:15:44.916 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:15:44.916 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:15:44.916 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:15:44.916 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:15:44.916 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:15:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:15:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:15:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:15:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:15:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:15:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:15:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:15:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:15:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:15:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:15:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:15:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:15:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:15:44.917 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:15:44.918 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:15:44.918 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:15:44.918 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:15:44.918 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:15:44.918 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:15:44.918 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:15:44.918 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:15:44.918 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:15:44.918 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:15:44.918 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:15:44.918 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:15:44.919 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:15:44.919 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:15:44.919 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:15:44.919 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:15:44.919 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:15:44.919 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:15:44.919 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:15:44.919 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:15:44.919 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:15:44.919 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:15:44.919 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:15:44.920 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:15:44.920 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:15:44.920 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:15:44.920 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:15:44.920 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:15:44.920 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:15:44.920 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:15:44.920 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:15:44.920 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:15:44.920 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:15:44.920 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:15:44.920 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:15:44.920 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:15:44.920 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:15:44.921 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:15:44.921 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:15:44.921 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:15:44.921 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:15:44.921 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:15:44.921 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:15:44.921 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:15:44.921 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:15:44.921 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:15:44.921 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:15:44.921 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:15:44.921 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:15:44.921 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:15:44.922 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:15:44.922 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:15:44.922 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:15:44.922 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:15:44.922 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:15:44.922 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:15:44.922 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:15:44.922 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:15:44.922 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:15:44.922 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:15:44.922 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:15:44.922 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:15:44.922 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:15:44.922 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:15:44.923 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:15:44.923 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:15:44.923 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:15:44.923 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:15:44.923 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:15:44.923 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:15:44.923 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:15:44.923 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:15:44.923 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:15:44.923 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:15:44.923 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:15:44.923 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:15:44.923 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:15:44.923 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:15:44.924 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:15:44.924 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:15:44.924 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:15:44.924 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:15:44.924 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:15:44.924 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:15:44.924 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:15:44.924 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:15:44.924 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:15:44.924 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:15:44.924 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:15:44.924 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:15:44.924 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:15:44.924 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:15:44.925 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:15:44.925 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:15:44.925 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:15:44.925 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:15:44.925 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:15:44.925 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:15:44.925 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:15:44.925 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:15:44.925 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:15:44.925 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:15:44.925 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:15:44.925 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:15:44.925 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:15:44.925 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:15:44.925 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:15:44.926 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:15:44.926 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:15:44.926 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:15:44.926 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:15:44.926 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:15:44.926 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:15:44.926 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:15:44.926 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:15:44.926 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:15:44.926 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:15:44.926 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:15:44.926 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:15:44.926 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:15:44.927 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:15:44.927 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:15:44.927 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:15:44.927 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:15:44.927 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:15:44.927 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:15:44.927 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:15:44.927 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:15:44.927 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:15:44.927 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:15:44.927 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:15:44.927 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:15:44.927 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:15:44.927 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:15:44.928 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:15:44.928 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:15:44.928 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:15:44.928 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:15:44.928 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:15:44.928 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:15:44.928 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:15:44.928 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:15:44.928 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:15:44.928 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:15:44.928 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:15:44.928 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:15:44.928 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:15:44.928 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:15:44.928 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:15:44.929 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:15:44.929 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:15:44.929 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:15:44.929 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:15:44.929 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:15:44.929 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:15:44.929 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:15:44.929 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:15:44.929 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:15:44.929 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:15:44.929 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:15:44.929 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:15:44.929 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:15:44.930 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:15:44.930 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:15:44.930 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:15:44.930 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:15:44.930 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:15:44.930 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:15:44.930 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:15:44.930 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:15:44.930 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:15:44.930 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:15:44.931 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:15:44.931 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:15:44.931 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:15:44.931 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:15:44.931 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:15:44.931 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:15:44.931 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:15:44.931 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:15:44.931 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:15:44.931 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:15:44.931 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:15:44.931 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:15:44.931 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:15:44.932 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:15:44.932 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:15:44.932 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:15:44.932 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:15:44.932 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:15:44.932 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:15:44.932 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:15:44.932 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:15:44.932 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:15:44.932 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:15:44.932 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:15:44.932 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:15:44.932 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:15:44.932 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:15:44.933 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:15:44.933 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:15:44.933 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:15:44.933 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:15:44.933 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:15:44.933 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:15:44.933 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:15:44.933 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:15:44.933 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:15:44.933 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:15:44.933 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:15:44.933 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:15:44.933 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:15:44.933 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:15:44.934 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:15:44.934 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:15:44.934 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:15:44.934 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:15:44.934 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:15:44.934 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:15:44.934 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:15:44.934 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:15:44.934 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:15:44.934 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:15:44.934 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:15:44.934 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:15:44.934 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:15:44.935 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:15:44.935 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:15:44.935 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:15:44.935 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:15:44.935 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:15:44.935 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:15:44.935 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:15:44.935 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:15:44.935 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:15:44.935 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:15:44.935 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:15:44.935 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:15:44.935 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:15:44.935 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:15:44.936 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:15:44.936 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:15:44.936 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:15:44.936 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:15:44.936 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:15:44.936 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:15:44.936 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:15:44.936 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:15:44.936 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:15:44.936 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:15:44.936 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:15:44.936 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:15:44.936 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:15:44.936 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:15:44.937 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:15:44.937 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:15:44.937 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:15:44.937 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:15:44.937 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:15:44.937 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:15:44.937 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:15:44.937 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:15:44.937 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:15:44.937 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:15:44.937 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:15:44.937 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:15:44.937 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:15:44.937 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:15:44.938 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:15:44.938 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:15:44.938 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:15:44.938 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:15:44.938 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:15:44.938 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:15:44.938 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:15:44.938 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:15:44.938 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:15:44.938 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:15:44.938 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:15:44.938 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:15:44.938 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:15:44.938 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:15:44.939 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:15:44.939 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:15:44.939 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:15:44.939 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:15:44.939 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:15:44.939 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:15:44.939 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:15:44.939 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:15:44.939 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:15:44.939 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:15:44.939 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:15:44.939 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:15:44.939 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:15:44.939 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:15:44.940 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:15:44.940 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:15:44.940 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:15:44.940 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:15:44.940 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:15:44.940 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:15:44.940 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:15:44.940 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:15:44.940 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:15:44.940 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:15:44.940 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:15:44.940 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:15:44.940 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:15:44.940 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:15:44.941 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:15:44.941 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:15:44.941 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:15:44.941 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:15:44.941 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:15:44.941 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:15:44.941 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:15:44.941 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:15:44.941 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:15:44.941 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:15:44.941 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:15:44.941 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:15:44.941 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:15:44.941 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:15:44.942 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:15:44.942 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:15:44.942 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:15:44.942 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:15:44.942 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:15:44.942 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:15:44.942 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:15:44.942 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:15:44.942 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:15:44.942 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:15:44.942 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:15:44.942 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:15:44.942 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:15:44.942 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:15:44.943 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:15:44.943 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:15:44.943 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:15:44.943 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:15:44.943 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:15:44.943 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:15:44.943 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:15:44.943 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:15:44.943 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:15:44.943 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:15:44.943 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:15:44.943 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:15:44.943 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:15:44.943 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:15:44.944 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:15:44.944 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:15:44.944 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:15:44.944 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:15:44.944 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:15:44.944 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:15:44.944 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:15:44.944 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:15:44.944 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:15:44.944 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:15:44.944 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:15:44.944 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:15:44.944 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:15:44.944 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:15:44.945 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:15:44.945 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:15:44.945 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:15:44.945 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:15:44.945 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:15:44.945 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:15:44.945 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:15:44.945 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:15:44.945 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:15:44.945 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:15:44.945 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:15:44.945 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:15:44.945 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:15:44.945 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:15:44.945 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:15:44.946 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:15:44.946 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:15:44.946 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:15:44.946 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:15:44.946 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:15:44.946 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:15:44.946 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:15:44.946 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:15:44.946 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:15:44.946 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:15:44.946 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:15:44.946 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:15:44.946 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:15:44.947 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:15:44.947 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:15:44.947 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:15:44.947 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:15:44.947 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:15:44.947 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:15:44.947 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:15:44.947 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:15:44.947 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:15:44.947 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:15:44.947 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:15:44.947 INFO:teuthology.orchestra.run.smithi106.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:15:44.951 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:44.952 DEBUG:teuthology.orchestra.run.smithi106:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:15:44.974 INFO:teuthology.orchestra.run.smithi106.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:15:44.974 INFO:teuthology.orchestra.run.smithi106.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:15:44.974 INFO:teuthology.orchestra.run.smithi106.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:15:44.974 INFO:teuthology.orchestra.run.smithi106.stdout:fi 2024-08-17T02:15:44.975 INFO:teuthology.orchestra.run.smithi106.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:15:44.975 INFO:teuthology.orchestra.run.smithi106.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:15:44.975 INFO:teuthology.orchestra.run.smithi106.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:15:44.975 INFO:teuthology.orchestra.run.smithi106.stdout: fi 2024-08-17T02:15:44.975 INFO:teuthology.orchestra.run.smithi106.stdout:done 2024-08-17T02:15:44.975 INFO:teuthology.orchestra.run.smithi106.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:15:44.975 INFO:teuthology.orchestra.run.smithi106.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:15:44.975 INFO:teuthology.orchestra.run.smithi106.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:15:44.975 INFO:teuthology.orchestra.run.smithi106.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:15:44.975 INFO:teuthology.orchestra.run.smithi106.stdout:fi 2024-08-17T02:15:44.975 INFO:teuthology.orchestra.run.smithi106.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:15:44.975 INFO:teuthology.orchestra.run.smithi106.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:44.975 INFO:teuthology.orchestra.run.smithi106.stdout:fi 2024-08-17T02:15:44.976 INFO:teuthology.orchestra.run.smithi106.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:15:44.976 INFO:teuthology.orchestra.run.smithi106.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:15:44.976 INFO:teuthology.orchestra.run.smithi106.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:44.976 INFO:teuthology.orchestra.run.smithi106.stdout:fi 2024-08-17T02:15:44.976 DEBUG:teuthology.orchestra.run.smithi106:> sudo rpm -qi grub2-tools 2024-08-17T02:15:45.054 INFO:teuthology.orchestra.run.smithi106.stdout:Name : grub2-tools 2024-08-17T02:15:45.055 INFO:teuthology.orchestra.run.smithi106.stdout:Epoch : 1 2024-08-17T02:15:45.055 INFO:teuthology.orchestra.run.smithi106.stdout:Version : 2.06 2024-08-17T02:15:45.055 INFO:teuthology.orchestra.run.smithi106.stdout:Release : 68.el9 2024-08-17T02:15:45.055 INFO:teuthology.orchestra.run.smithi106.stdout:Architecture: x86_64 2024-08-17T02:15:45.055 INFO:teuthology.orchestra.run.smithi106.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:15:45.055 INFO:teuthology.orchestra.run.smithi106.stdout:Group : Unspecified 2024-08-17T02:15:45.055 INFO:teuthology.orchestra.run.smithi106.stdout:Size : 8264254 2024-08-17T02:15:45.055 INFO:teuthology.orchestra.run.smithi106.stdout:License : GPLv3+ 2024-08-17T02:15:45.055 INFO:teuthology.orchestra.run.smithi106.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:15:45.055 INFO:teuthology.orchestra.run.smithi106.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:15:45.055 INFO:teuthology.orchestra.run.smithi106.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:15:45.055 INFO:teuthology.orchestra.run.smithi106.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:15:45.055 INFO:teuthology.orchestra.run.smithi106.stdout:Packager : builder@centos.org 2024-08-17T02:15:45.056 INFO:teuthology.orchestra.run.smithi106.stdout:Vendor : CentOS 2024-08-17T02:15:45.056 INFO:teuthology.orchestra.run.smithi106.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:15:45.056 INFO:teuthology.orchestra.run.smithi106.stdout:Summary : Support tools for GRUB. 2024-08-17T02:15:45.056 INFO:teuthology.orchestra.run.smithi106.stdout:Description : 2024-08-17T02:15:45.056 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:15:45.056 INFO:teuthology.orchestra.run.smithi106.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:15:45.056 INFO:teuthology.orchestra.run.smithi106.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:15:45.056 INFO:teuthology.orchestra.run.smithi106.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:15:45.056 INFO:teuthology.orchestra.run.smithi106.stdout:hardware devices. 2024-08-17T02:15:45.056 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:15:45.056 INFO:teuthology.orchestra.run.smithi106.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:15:45.057 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:15:45.057 INFO:teuthology.task.kernel:Updating grub on smithi106 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:45.057 DEBUG:teuthology.orchestra.run.smithi106:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:15:45.558 INFO:teuthology.orchestra.run.smithi106.stderr:Generating grub configuration file ... 2024-08-17T02:15:46.916 INFO:teuthology.orchestra.run.smithi106.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:15:46.947 INFO:teuthology.orchestra.run.smithi106.stderr:done 2024-08-17T02:15:46.949 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2024-08-17T02:15:46.964 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.HZN376uio0 2024-08-17T02:15:46.964 DEBUG:teuthology.orchestra.run.smithi106:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.HZN376uio0 2024-08-17T02:15:47.030 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.HZN376uio0 2024-08-17T02:15:47.162 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.HZN376uio0 is 6KB 2024-08-17T02:15:47.211 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.HZN376uio0 2024-08-17T02:15:47.225 DEBUG:teuthology.orchestra.run.smithi106:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:15:47.287 INFO:teuthology.orchestra.run.smithi106.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:15:47.287 INFO:teuthology.orchestra.run.smithi106.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:15:47.287 INFO:teuthology.orchestra.run.smithi106.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:15:47.287 INFO:teuthology.orchestra.run.smithi106.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:15:47.288 DEBUG:teuthology.orchestra.run.smithi106:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:15:47.437 DEBUG:teuthology.orchestra.run.smithi106:> sudo shutdown -r now 2024-08-17T02:16:17.440 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-08-17T02:16:17.484 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-08-17T02:16:17.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:16:22.227 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi171.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:16:22.227 DEBUG:teuthology.orchestra.run.smithi171:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:16:22.318 INFO:teuthology.orchestra.run.smithi171.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:22.318 INFO:teuthology.orchestra.run.smithi171.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:22.318 INFO:teuthology.orchestra.run.smithi171.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:22.319 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:22.319 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:16:22.319 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:16:22.319 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:16:22.319 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:16:22.319 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:16:22.319 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:16:22.319 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:16:22.319 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:16:22.319 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:16:22.319 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:16:22.319 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:16:22.319 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:16:22.320 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:16:22.320 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:16:22.320 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:16:22.320 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:16:22.320 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:16:22.320 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:16:22.320 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:16:22.320 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:16:22.320 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:16:22.320 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:16:22.320 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:16:22.320 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:16:22.320 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:16:22.320 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:16:22.321 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:16:22.321 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:16:22.321 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:16:22.321 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:16:22.321 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:16:22.321 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:16:22.321 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:16:22.321 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:16:22.321 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:16:22.321 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:16:22.321 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:16:22.321 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:16:22.321 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:16:22.321 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:16:22.322 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:16:22.322 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:16:22.322 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:16:22.322 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:16:22.322 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:16:22.322 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:16:22.322 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:16:22.322 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:16:22.322 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:16:22.322 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:16:22.322 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:16:22.322 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:16:22.323 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:16:22.323 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:16:22.323 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:16:22.323 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:16:22.323 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:16:22.323 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:16:22.323 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:16:22.323 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:16:22.323 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:16:22.324 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:16:22.324 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:16:22.324 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:16:22.324 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:16:22.324 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:16:22.324 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:16:22.324 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:16:22.324 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:16:22.324 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:16:22.324 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:16:22.324 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:16:22.324 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:16:22.324 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:16:22.324 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:16:22.325 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:16:22.325 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:16:22.325 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:16:22.325 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:16:22.325 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:16:22.325 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:16:22.325 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:16:22.325 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:16:22.325 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:16:22.325 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:16:22.325 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:16:22.325 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:16:22.325 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:16:22.325 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:16:22.326 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:16:22.326 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:16:22.326 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:16:22.326 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:16:22.326 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:16:22.326 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:16:22.326 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:16:22.326 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:16:22.326 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:16:22.326 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:16:22.326 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:16:22.326 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:16:22.326 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:16:22.327 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:16:22.327 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:16:22.327 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:16:22.327 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:16:22.327 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:16:22.327 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:16:22.327 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:16:22.327 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:16:22.327 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:16:22.327 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:16:22.327 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:16:22.327 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:16:22.327 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:16:22.327 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:16:22.328 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:16:22.328 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:16:22.328 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:16:22.328 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:16:22.328 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:16:22.328 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:16:22.328 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:16:22.328 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:16:22.328 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:16:22.328 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:16:22.328 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:16:22.328 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:16:22.328 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:16:22.329 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:16:22.329 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:16:22.329 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:16:22.329 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:16:22.329 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:16:22.329 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:16:22.329 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:16:22.329 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:16:22.329 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:16:22.329 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:16:22.329 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:16:22.329 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:16:22.329 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:16:22.329 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:16:22.330 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:16:22.330 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:16:22.330 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:16:22.330 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:16:22.330 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:16:22.330 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:16:22.330 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:16:22.330 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:16:22.330 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:16:22.330 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:16:22.330 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:16:22.330 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:16:22.330 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:16:22.331 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:16:22.331 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:16:22.331 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:16:22.331 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:16:22.331 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:16:22.331 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:16:22.331 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:16:22.331 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:16:22.331 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:16:22.331 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:16:22.331 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:16:22.331 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:16:22.331 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:16:22.332 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:16:22.332 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:16:22.332 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:16:22.332 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:16:22.332 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:16:22.332 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:16:22.332 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:16:22.332 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:16:22.332 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:16:22.332 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:16:22.332 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:16:22.332 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:16:22.332 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:16:22.332 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:16:22.333 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:16:22.333 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:16:22.333 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:16:22.333 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:16:22.333 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:16:22.333 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:16:22.333 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:16:22.333 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:16:22.333 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:16:22.333 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:16:22.333 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:16:22.333 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:16:22.333 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:16:22.333 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:16:22.334 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:16:22.334 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:16:22.334 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:16:22.334 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:16:22.334 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:16:22.334 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:16:22.334 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:16:22.334 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:16:22.334 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:16:22.334 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:16:22.334 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:16:22.334 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:16:22.334 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:16:22.335 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:16:22.335 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:16:22.335 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:16:22.335 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:16:22.335 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:16:22.335 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:16:22.335 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:16:22.335 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:16:22.335 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:16:22.335 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:16:22.335 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:16:22.335 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:16:22.335 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:16:22.335 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:16:22.336 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:16:22.336 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:16:22.336 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:16:22.336 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:16:22.336 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:16:22.336 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:16:22.336 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:16:22.336 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:16:22.336 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:16:22.336 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:16:22.336 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:16:22.336 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:16:22.336 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:16:22.337 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:16:22.337 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:16:22.337 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:16:22.337 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:16:22.337 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:16:22.337 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:16:22.337 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:16:22.337 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:16:22.337 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:16:22.337 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:16:22.337 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:16:22.337 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:16:22.337 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:16:22.337 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:16:22.338 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:16:22.338 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:16:22.338 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:16:22.338 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:16:22.338 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:16:22.338 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:16:22.338 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:16:22.338 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:16:22.338 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:16:22.338 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:16:22.338 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:16:22.338 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:16:22.338 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:16:22.339 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:16:22.339 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:16:22.339 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:16:22.339 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:16:22.339 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:16:22.339 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:16:22.339 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:16:22.339 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:16:22.339 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:16:22.339 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:16:22.339 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:16:22.339 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:16:22.339 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:16:22.339 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:16:22.340 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:16:22.340 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:16:22.340 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:16:22.340 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:16:22.340 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:16:22.340 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:16:22.340 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:16:22.340 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:16:22.340 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:16:22.340 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:16:22.340 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:16:22.340 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:16:22.340 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:16:22.340 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:16:22.341 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:16:22.341 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:16:22.341 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:16:22.341 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:16:22.341 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:16:22.341 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:16:22.341 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:16:22.341 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:16:22.341 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:16:22.341 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:16:22.341 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:16:22.341 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:16:22.341 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:16:22.341 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:16:22.342 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:16:22.342 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:16:22.342 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:16:22.342 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:16:22.342 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:16:22.342 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:16:22.342 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:16:22.342 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:16:22.342 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:16:22.342 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:16:22.342 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:16:22.342 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:16:22.342 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:16:22.342 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:16:22.343 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:16:22.343 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:16:22.343 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:16:22.343 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:16:22.343 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:16:22.343 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:16:22.343 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:16:22.343 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:16:22.343 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:16:22.343 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:16:22.343 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:16:22.343 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:16:22.343 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:16:22.344 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:16:22.344 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:16:22.344 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:16:22.344 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:16:22.344 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:16:22.344 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:16:22.344 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:16:22.344 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:16:22.344 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:16:22.344 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:16:22.344 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:16:22.344 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:16:22.344 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:16:22.344 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:16:22.345 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:16:22.345 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:16:22.345 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:16:22.345 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:16:22.345 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:16:22.345 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:16:22.345 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:16:22.345 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:16:22.345 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:16:22.345 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:16:22.345 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:16:22.345 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:16:22.345 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:16:22.345 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:16:22.346 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:16:22.346 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:16:22.346 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:16:22.346 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:16:22.346 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:16:22.346 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:16:22.346 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:16:22.346 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:16:22.346 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:16:22.346 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:16:22.346 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:16:22.346 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:16:22.346 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:16:22.347 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:16:22.347 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:16:22.347 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:16:22.347 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:16:22.347 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:16:22.347 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:16:22.347 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:16:22.347 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:16:22.347 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:16:22.347 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:16:22.347 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:16:22.347 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:16:22.347 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:16:22.347 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:16:22.348 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:16:22.348 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:16:22.348 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:16:22.348 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:16:22.348 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:16:22.348 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:16:22.348 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:16:22.348 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:16:22.348 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:16:22.348 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:16:22.348 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:16:22.348 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:16:22.348 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:16:22.348 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:16:22.349 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:16:22.349 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:16:22.349 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:16:22.349 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:16:22.349 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:16:22.349 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:16:22.349 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:16:22.349 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:16:22.349 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:16:22.349 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:16:22.349 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:16:22.349 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:16:22.349 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:16:22.349 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:16:22.350 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:16:22.350 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:16:22.350 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:16:22.350 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:16:22.350 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:16:22.350 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:16:22.350 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:16:22.350 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:16:22.350 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:16:22.350 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:16:22.350 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:16:22.350 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:16:22.350 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:16:22.351 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:16:22.351 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:16:22.351 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:16:22.351 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:16:22.351 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:16:22.351 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:16:22.351 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:16:22.351 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:16:22.351 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:16:22.351 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:16:22.351 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:16:22.351 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:16:22.351 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:16:22.351 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:16:22.351 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:16:22.352 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:16:22.352 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:16:22.352 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:16:22.352 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:16:22.352 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:16:22.352 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:16:22.352 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:16:22.352 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:16:22.352 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:16:22.352 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:16:22.352 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:16:22.352 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:16:22.352 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:16:22.352 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:16:22.353 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:16:22.353 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:16:22.353 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:16:22.353 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:16:22.353 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:16:22.353 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:16:22.353 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:16:22.353 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:16:22.353 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:16:22.353 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:16:22.353 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:16:22.353 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:16:22.353 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:16:22.354 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:16:22.354 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:16:22.354 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:16:22.354 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:16:22.354 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:16:22.354 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:16:22.354 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:16:22.354 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:16:22.354 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:16:22.354 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:16:22.354 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:16:22.354 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:16:22.354 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:16:22.354 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:16:22.355 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:16:22.355 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:16:22.355 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:16:22.355 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:16:22.355 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:16:22.355 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:16:22.355 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:16:22.355 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:16:22.355 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:16:22.355 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:16:22.355 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:16:22.355 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:16:22.355 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:16:22.355 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:16:22.356 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:16:22.356 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:16:22.356 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:16:22.356 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:16:22.356 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:16:22.356 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:16:22.356 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:16:22.356 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:16:22.356 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:16:22.356 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:16:22.356 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:16:22.356 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:16:22.356 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:16:22.356 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:16:22.357 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:16:22.357 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:16:22.357 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:16:22.357 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:16:22.357 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:16:22.357 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:16:22.357 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:16:22.357 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:16:22.357 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:16:22.357 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:16:22.357 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:16:22.357 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:16:22.357 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:16:22.357 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:16:22.358 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:16:22.358 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:16:22.358 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:16:22.358 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:16:22.358 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:16:22.358 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:16:22.358 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:16:22.358 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:16:22.358 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:16:22.358 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:16:22.358 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:16:22.358 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:16:22.358 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:16:22.359 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:16:22.359 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:16:22.359 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:16:22.359 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:16:22.359 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:16:22.359 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:16:22.359 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:16:22.359 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:16:22.359 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:16:22.359 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:16:22.359 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:16:22.359 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:16:22.359 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:16:22.359 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:16:22.360 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:16:22.360 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:16:22.360 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:16:22.360 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:16:22.360 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:16:22.360 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:16:22.360 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:16:22.360 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:16:22.360 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:16:22.360 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:16:22.360 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:16:22.360 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:16:22.360 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:16:22.360 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:16:22.361 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:16:22.361 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:16:22.361 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:16:22.361 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:16:22.361 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:16:22.361 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:16:22.361 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:16:22.361 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:16:22.361 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:16:22.361 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:16:22.361 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:16:22.361 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:16:22.361 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:16:22.361 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:16:22.362 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:16:22.362 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:16:22.362 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:16:22.362 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:16:22.362 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:16:22.362 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:16:22.362 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:16:22.362 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:16:22.362 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:16:22.362 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:16:22.362 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:16:22.362 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:16:22.362 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:16:22.363 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:16:22.363 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:16:22.363 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:16:22.363 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:16:22.363 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:16:22.363 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:16:22.363 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:16:22.363 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:16:22.363 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:16:22.363 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:16:22.363 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:16:22.363 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:16:22.363 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:16:22.363 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:16:22.364 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:16:22.364 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:16:22.364 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:16:22.364 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:16:22.364 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:16:22.364 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:16:22.364 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:16:22.364 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:16:22.364 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:16:22.364 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:16:22.364 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:16:22.364 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:16:22.364 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:16:22.364 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:16:22.365 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:16:22.365 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:16:22.365 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:16:22.365 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:16:22.365 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:16:22.365 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:16:22.365 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:16:22.365 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:16:22.365 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:16:22.365 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:16:22.365 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:16:22.365 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:16:22.365 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:16:22.365 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:16:22.366 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:16:22.366 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:16:22.366 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:16:22.366 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:16:22.366 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:16:22.366 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:16:22.366 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:16:22.366 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:16:22.366 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:16:22.366 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:16:22.366 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:16:22.366 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:16:22.366 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:16:22.366 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:16:22.367 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:16:22.367 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:16:22.367 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:16:22.367 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:16:22.367 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:16:22.367 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:16:22.367 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:16:22.367 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:16:22.367 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:16:22.367 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:16:22.367 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:16:22.367 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:16:22.367 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:16:22.367 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:16:22.368 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:16:22.368 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:16:22.368 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:16:22.368 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:16:22.368 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:16:22.368 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:16:22.368 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:16:22.368 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:16:22.368 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:16:22.368 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:16:22.368 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:16:22.368 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:16:22.368 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:16:22.368 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:16:22.369 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:16:22.369 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:16:22.369 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:16:22.369 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:16:22.369 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:16:22.369 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:16:22.369 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:16:22.369 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:16:22.369 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:16:22.369 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:16:22.369 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:16:22.369 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:16:22.369 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:16:22.370 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:16:22.370 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:16:22.370 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:16:22.370 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:16:22.370 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:16:22.370 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:16:22.370 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:16:22.370 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:16:22.370 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:16:22.370 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:16:22.370 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:16:22.370 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:16:22.370 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:16:22.371 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:16:22.371 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:16:22.371 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:16:22.371 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:16:22.371 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:16:22.371 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:16:22.371 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:16:22.371 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:16:22.371 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:16:22.371 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:16:22.371 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:16:22.371 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:16:22.371 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:16:22.371 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:16:22.372 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:16:22.372 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:16:22.372 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:16:22.372 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:16:22.372 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:16:22.372 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:16:22.372 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:16:22.372 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:16:22.372 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:16:22.372 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:16:22.372 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:16:22.372 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:16:22.372 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:16:22.372 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:16:22.373 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:16:22.373 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:16:22.373 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:16:22.373 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:16:22.373 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:16:22.373 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:16:22.373 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:16:22.373 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:16:22.373 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:16:22.373 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:16:22.373 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:16:22.373 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:16:22.373 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:16:22.373 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:16:22.374 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:16:22.374 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:16:22.374 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:16:22.374 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:16:22.374 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:16:22.374 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:16:22.374 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:16:22.374 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:16:22.374 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:16:22.374 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:16:22.374 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:16:22.374 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:16:22.375 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:16:22.375 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:16:22.375 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:16:22.375 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:16:22.375 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:16:22.375 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:16:22.375 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:16:22.375 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:16:22.375 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:16:22.375 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:16:22.375 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:16:22.375 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:16:22.375 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:16:22.375 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:16:22.376 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:16:22.376 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:16:22.376 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:16:22.376 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:16:22.376 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:16:22.376 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:16:22.376 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:16:22.376 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:16:22.376 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:16:22.376 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:16:22.376 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:16:22.376 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:16:22.376 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:16:22.377 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:16:22.377 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:16:22.377 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:16:22.377 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:16:22.377 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:16:22.377 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:16:22.377 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:16:22.377 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:16:22.377 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:16:22.377 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:16:22.377 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:16:22.377 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:16:22.377 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:16:22.377 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:16:22.378 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:16:22.378 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:16:22.378 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:16:22.378 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:16:22.378 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:16:22.378 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:16:22.378 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:16:22.378 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:16:22.378 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:16:22.378 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:16:22.378 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:16:22.378 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:16:22.378 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:16:22.378 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:16:22.379 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:16:22.379 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:16:22.379 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:16:22.379 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:16:22.379 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:16:22.379 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:16:22.379 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:16:22.379 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:16:22.379 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:16:22.379 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:16:22.379 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:16:22.379 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:16:22.379 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:16:22.379 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:16:22.380 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:16:22.380 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:16:22.380 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:16:22.380 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:16:22.380 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:16:22.380 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:16:22.380 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:16:22.380 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:16:22.380 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:16:22.380 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:16:22.380 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:16:22.380 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:16:22.380 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:16:22.381 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:16:22.381 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:16:22.381 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:16:22.381 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:16:22.381 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:16:22.381 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:16:22.381 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:16:22.381 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:16:22.381 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:16:22.381 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:16:22.381 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:16:22.381 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:16:22.381 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:16:22.381 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:16:22.382 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:16:22.382 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:16:22.382 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:16:22.382 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:16:22.382 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:16:22.382 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:16:22.382 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:16:22.382 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:16:22.382 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:16:22.382 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:16:22.382 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:16:22.382 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:16:22.382 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:16:22.382 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:16:22.383 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:16:22.383 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:16:22.383 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:16:22.383 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:16:22.383 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:16:22.383 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:16:22.383 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:16:22.383 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:16:22.383 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:16:22.383 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:16:22.383 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:16:22.383 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:16:22.383 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:16:22.383 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:16:22.384 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:16:22.384 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:16:22.384 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:16:22.384 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:16:22.384 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:16:22.384 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:16:22.384 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:16:22.384 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:16:22.384 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:16:22.384 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:16:22.384 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:16:22.384 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:16:22.384 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:16:22.384 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:16:22.385 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:16:22.385 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:16:22.385 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:16:22.385 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:16:22.385 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:16:22.385 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:16:22.385 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:16:22.385 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:16:22.385 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:16:22.385 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:16:22.385 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:16:22.385 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:16:22.385 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:16:22.385 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:16:22.386 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:16:22.386 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:16:22.386 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:16:22.386 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:16:22.386 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:16:22.386 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:16:22.386 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:16:22.386 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:16:22.386 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:16:22.386 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:16:22.386 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:16:22.386 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:16:22.386 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:16:22.386 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:16:22.387 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:16:22.387 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:16:22.387 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:16:22.387 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:16:22.387 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:16:22.387 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:16:22.387 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:16:22.387 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:16:22.387 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:16:22.387 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:16:22.387 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:16:22.387 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:16:22.387 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:16:22.387 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:16:22.388 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:16:22.388 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:16:22.388 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:16:22.388 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:16:22.388 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:16:22.388 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:16:22.388 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:16:22.388 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:16:22.388 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:16:22.388 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:16:22.388 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:16:22.388 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:16:22.388 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:16:22.388 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:16:22.389 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:16:22.389 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:16:22.389 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:16:22.389 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:16:22.389 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:16:22.389 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:16:22.389 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:16:22.389 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:16:22.389 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:16:22.389 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:16:22.389 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:16:22.389 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:16:22.389 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:16:22.389 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:16:22.390 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:16:22.390 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:16:22.390 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:16:22.390 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:16:22.390 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:16:22.390 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:16:22.390 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:16:22.390 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:16:22.390 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:16:22.390 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:16:22.390 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:16:22.390 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:16:22.390 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:16:22.390 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:16:22.391 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:16:22.391 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:16:22.391 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:16:22.391 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:16:22.391 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:16:22.391 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:16:22.391 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:16:22.391 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:16:22.391 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:16:22.391 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:16:22.391 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:16:22.391 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:16:22.391 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:16:22.391 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:16:22.392 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:16:22.392 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:16:22.392 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:16:22.392 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:16:22.392 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:16:22.392 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:16:22.392 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:16:22.392 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:16:22.392 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:16:22.392 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:16:22.392 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:16:22.392 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:16:22.392 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:16:22.392 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:16:22.393 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:16:22.393 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:16:22.393 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:16:22.393 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:16:22.393 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:16:22.393 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:16:22.393 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:16:22.393 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:16:22.393 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:16:22.393 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:16:22.393 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:16:22.393 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:16:22.393 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:16:22.393 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:16:22.394 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:16:22.394 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:16:22.394 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:16:22.394 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:16:22.394 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:16:22.394 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:16:22.394 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:16:22.394 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:16:22.394 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:16:22.394 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:16:22.394 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:16:22.394 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:16:22.394 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:16:22.395 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:16:22.395 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:16:22.395 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:16:22.395 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:16:22.395 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:16:22.395 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:16:22.395 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:16:22.395 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:16:22.395 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:16:22.395 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:16:22.395 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:16:22.395 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:16:22.395 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:16:22.395 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:16:22.396 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:16:22.396 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:16:22.396 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:16:22.396 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:16:22.396 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:16:22.396 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:16:22.396 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:16:22.396 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:16:22.396 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:16:22.396 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:16:22.396 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:16:22.396 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:16:22.396 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:16:22.396 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:16:22.397 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:16:22.397 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:16:22.397 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:16:22.397 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:16:22.397 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:16:22.397 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:16:22.397 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:16:22.397 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:16:22.397 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:16:22.397 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:16:22.397 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:16:22.397 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:16:22.397 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:16:22.397 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:16:22.398 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:16:22.398 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:16:22.398 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:16:22.398 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:16:22.398 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:16:22.398 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:16:22.398 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:16:22.398 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:16:22.398 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:16:22.398 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:16:22.398 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:16:22.398 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:16:22.398 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:16:22.398 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:16:22.399 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:16:22.399 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:16:22.399 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:16:22.399 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:16:22.399 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:16:22.399 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:16:22.399 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:16:22.399 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:16:22.399 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:16:22.399 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:16:22.399 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:16:22.399 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:16:22.399 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:16:22.399 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:16:22.400 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:16:22.400 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:16:22.400 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:16:22.400 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:16:22.400 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:16:22.400 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:16:22.400 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:16:22.400 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:16:22.400 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:16:22.400 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:16:22.400 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:16:22.400 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:16:22.400 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:16:22.400 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:16:22.401 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:16:22.401 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:16:22.401 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:16:22.401 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:16:22.401 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:16:22.401 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:16:22.401 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:16:22.401 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:16:22.401 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:16:22.401 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:16:22.401 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:16:22.401 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:16:22.401 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:16:22.402 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:16:22.402 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:16:22.402 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:16:22.402 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:16:22.402 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:16:22.402 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:16:22.402 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:16:22.402 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:16:22.402 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:16:22.402 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:16:22.402 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:16:22.402 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:16:22.402 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:16:22.402 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:16:22.403 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:16:22.403 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:16:22.403 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:16:22.403 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:16:22.403 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:16:22.403 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:16:22.403 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:16:22.403 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:16:22.403 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:16:22.403 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:16:22.403 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:16:22.403 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:16:22.403 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:16:22.404 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:16:22.404 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:16:22.404 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:16:22.404 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:16:22.404 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:16:22.404 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:16:22.404 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:16:22.404 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:16:22.404 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:16:22.404 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:16:22.404 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:16:22.404 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:16:22.404 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:16:22.404 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:16:22.404 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:16:22.405 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:16:22.405 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:16:22.405 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:16:22.405 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:16:22.405 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:16:22.405 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:16:22.405 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:16:22.405 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:16:22.405 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:16:22.405 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:16:22.405 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:16:22.405 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:16:22.405 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:16:22.405 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:16:22.406 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:16:22.406 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:16:22.406 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:16:22.406 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:16:22.406 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:16:22.406 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:16:22.406 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:16:22.406 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:16:22.406 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:16:22.406 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:16:22.406 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:16:22.406 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:16:22.406 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:16:22.407 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:16:22.407 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:16:22.407 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:16:22.407 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:16:22.407 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:16:22.407 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:16:22.407 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:16:22.407 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:16:22.407 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:16:22.407 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:16:22.407 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:16:22.407 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:16:22.407 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:16:22.407 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:16:22.408 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:16:22.408 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:16:22.408 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:16:22.408 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:16:22.408 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:16:22.408 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:16:22.408 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:16:22.408 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:16:22.408 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:16:22.408 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:16:22.408 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:16:22.408 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:16:22.408 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:16:22.408 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:16:22.409 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:16:22.409 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:16:22.409 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:16:22.409 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:16:22.409 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:16:22.409 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:16:22.409 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:16:22.409 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:16:22.409 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:16:22.409 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:16:22.409 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:16:22.409 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:16:22.409 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:16:22.410 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:16:22.410 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:16:22.410 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:16:22.410 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:16:22.410 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:16:22.410 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:16:22.410 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:16:22.410 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:16:22.410 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:16:22.410 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:16:22.410 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:16:22.410 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:16:22.411 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:16:22.411 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:16:22.411 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:16:22.411 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:16:22.411 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:16:22.411 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:16:22.411 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:16:22.411 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:16:22.411 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:16:22.411 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:16:22.411 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:16:22.411 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:16:22.411 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:16:22.411 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:16:22.412 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:16:22.412 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:16:22.412 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:16:22.412 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:16:22.412 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:16:22.412 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:16:22.412 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:16:22.412 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:16:22.412 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:16:22.412 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:16:22.412 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:16:22.412 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:16:22.412 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:16:22.412 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:16:22.413 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:16:22.413 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:16:22.413 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:16:22.413 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:16:22.413 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:16:22.413 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:16:22.413 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:16:22.413 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:16:22.413 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:16:22.413 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:16:22.413 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:16:22.413 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:16:22.413 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:16:22.414 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:16:22.414 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:16:22.414 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:16:22.414 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:16:22.414 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:16:22.414 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:16:22.414 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:16:22.414 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:16:22.414 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:16:22.414 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:16:22.414 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:16:22.414 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:16:22.414 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:16:22.414 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:16:22.415 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:16:22.415 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:16:22.415 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:16:22.415 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:16:22.415 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:16:22.415 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:16:22.415 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:16:22.415 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:16:22.415 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:16:22.415 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:16:22.415 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:16:22.415 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:16:22.415 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:16:22.416 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:16:22.416 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:16:22.416 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:16:22.416 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:16:22.416 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:16:22.416 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:16:22.416 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:16:22.416 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:16:22.416 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:16:22.416 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:16:22.416 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:16:22.416 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:16:22.416 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:16:22.416 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:16:22.417 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:16:22.417 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:16:22.417 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:16:22.417 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:16:22.417 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:16:22.417 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:16:22.417 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:16:22.417 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:16:22.417 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:16:22.417 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:16:22.417 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:16:22.417 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:16:22.417 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:16:22.417 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:16:22.418 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:16:22.418 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:16:22.418 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:16:22.418 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:16:22.418 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:16:22.418 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:16:22.418 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:16:22.418 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:16:22.418 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:16:22.418 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:16:22.418 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:16:22.418 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:16:22.418 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:16:22.419 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:16:22.419 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:16:22.419 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:16:22.419 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:16:22.419 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:16:22.419 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:16:22.419 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:16:22.419 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:16:22.419 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:16:22.419 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:16:22.419 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:16:22.419 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:16:22.419 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:16:22.419 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:16:22.420 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:16:22.420 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:16:22.420 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:16:22.420 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:16:22.420 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:16:22.420 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:16:22.420 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:16:22.420 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:16:22.420 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:16:22.420 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:16:22.420 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:16:22.420 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:16:22.420 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:16:22.420 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:16:22.421 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:16:22.421 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:16:22.421 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:16:22.421 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:16:22.421 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:16:22.421 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:16:22.421 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:16:22.421 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:16:22.421 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:16:22.421 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:16:22.421 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:16:22.421 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:16:22.421 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:16:22.421 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:16:22.422 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:16:22.422 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:16:22.422 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:16:22.422 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:16:22.422 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:16:22.422 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:16:22.422 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:16:22.422 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:16:22.422 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:16:22.422 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:16:22.422 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:16:22.422 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:16:22.422 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:16:22.423 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:16:22.423 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:16:22.423 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:16:22.423 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:16:22.423 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:16:22.423 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:16:22.423 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:16:22.423 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:16:22.424 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:16:22.424 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:16:22.424 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:16:22.424 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:16:22.424 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:16:22.424 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:16:22.424 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:16:22.424 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:16:22.424 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:16:22.424 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:16:22.424 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:16:22.424 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:16:22.424 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:16:22.425 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:16:22.425 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:16:22.425 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:16:22.425 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:16:22.425 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:16:22.425 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:16:22.425 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:16:22.425 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:16:22.425 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:16:22.425 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:16:22.425 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:16:22.425 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:16:22.425 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:16:22.425 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:16:22.426 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:16:22.426 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:16:22.426 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:16:22.426 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:16:22.426 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:16:22.426 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:16:22.426 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:16:22.426 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:16:22.426 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:16:22.426 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:16:22.426 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:16:22.426 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:16:22.426 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:16:22.427 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:16:22.427 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:16:22.427 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:16:22.427 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:16:22.427 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:16:22.427 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:16:22.427 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:16:22.427 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:16:22.427 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:16:22.427 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:16:22.427 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:16:22.427 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:16:22.427 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:16:22.427 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:16:22.428 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:16:22.428 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:16:22.428 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:16:22.428 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:16:22.428 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:16:22.428 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:16:22.428 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:16:22.428 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:16:22.428 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:16:22.428 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:16:22.428 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:16:22.428 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:16:22.428 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:16:22.428 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:16:22.429 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:16:22.429 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:16:22.429 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:16:22.429 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:16:22.429 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:16:22.429 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:16:22.429 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:16:22.429 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:16:22.429 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:16:22.429 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:16:22.429 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:16:22.429 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:16:22.429 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:16:22.429 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:16:22.429 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:16:22.430 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:16:22.430 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:16:22.430 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:16:22.430 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:16:22.430 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:16:22.430 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:16:22.430 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:16:22.430 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:16:22.430 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:16:22.430 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:16:22.430 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:16:22.430 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:16:22.430 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:16:22.431 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:16:22.431 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:16:22.431 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:16:22.431 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:16:22.431 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:16:22.431 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:16:22.431 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:16:22.431 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:16:22.431 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:16:22.431 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:16:22.431 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:16:22.431 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:16:22.431 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:16:22.431 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:16:22.432 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:16:22.432 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:16:22.432 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:16:22.432 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:16:22.432 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:16:22.432 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:16:22.432 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:16:22.432 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:16:22.432 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:16:22.432 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:16:22.432 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:16:22.432 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:16:22.432 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:16:22.432 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:16:22.433 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:16:22.433 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:16:22.433 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:16:22.433 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:16:22.433 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:16:22.433 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:16:22.433 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:16:22.433 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:16:22.433 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:16:22.433 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:16:22.433 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:16:22.433 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:16:22.433 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:16:22.433 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:16:22.434 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:16:22.434 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:16:22.434 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:16:22.434 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:16:22.434 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:16:22.434 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:16:22.434 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:16:22.434 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:16:22.434 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:16:22.434 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:16:22.434 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:16:22.434 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:16:22.434 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:16:22.434 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:16:22.435 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:16:22.435 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:16:22.435 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:16:22.435 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:16:22.435 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:16:22.435 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:16:22.435 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:16:22.435 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:16:22.435 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:16:22.435 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:16:22.435 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:16:22.435 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:16:22.435 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:16:22.436 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:16:22.436 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:16:22.436 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:16:22.436 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:16:22.436 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:16:22.436 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:16:22.436 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:16:22.436 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:16:22.436 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:16:22.436 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:16:22.436 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:16:22.436 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:16:22.436 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:16:22.436 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:16:22.437 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:16:22.437 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:16:22.437 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:16:22.437 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:16:22.437 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:16:22.437 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:16:22.437 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:16:22.437 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:16:22.437 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:16:22.437 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:16:22.437 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:16:22.437 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:16:22.437 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:16:22.437 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:16:22.438 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:16:22.438 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:16:22.438 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:16:22.438 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:16:22.438 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:16:22.438 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:16:22.438 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:16:22.438 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:16:22.438 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:16:22.438 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:16:22.438 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:16:22.438 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:16:22.438 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:16:22.438 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:16:22.439 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:16:22.439 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:16:22.439 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:16:22.439 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:16:22.439 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:16:22.439 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:16:22.439 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:16:22.439 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:16:22.439 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:16:22.439 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:16:22.439 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:16:22.439 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:16:22.439 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:16:22.439 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:16:22.440 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:16:22.440 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:16:22.440 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:16:22.440 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:16:22.440 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:16:22.440 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:16:22.440 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:16:22.440 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:16:22.440 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:16:22.440 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:16:22.440 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:16:22.440 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:16:22.440 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:16:22.440 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:16:22.441 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:16:22.441 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:16:22.441 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:16:22.441 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:16:22.441 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:16:22.441 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:16:22.441 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:16:22.441 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:16:22.441 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:16:22.441 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:16:22.441 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:16:22.441 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:16:22.441 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:16:22.441 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:16:22.442 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:16:22.442 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:16:22.442 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:16:22.442 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:16:22.442 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:16:22.442 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:16:22.442 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:16:22.442 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:16:22.442 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:16:22.442 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:16:22.442 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:16:22.442 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:16:22.442 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:16:22.442 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:16:22.443 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:16:22.443 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:16:22.443 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:16:22.443 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:16:22.443 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:16:22.443 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:16:22.443 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:16:22.443 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:16:22.443 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:16:22.443 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:16:22.443 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:16:22.443 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:16:22.443 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:16:22.444 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:16:22.444 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:16:22.444 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:16:22.444 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:16:22.444 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:16:22.444 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:16:22.444 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:16:22.444 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:16:22.444 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:16:22.444 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:16:22.444 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:16:22.444 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:16:22.444 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:16:22.444 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:16:22.445 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:16:22.445 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:16:22.445 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:16:22.445 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:16:22.445 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:16:22.445 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:16:22.445 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:16:22.445 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:16:22.445 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:16:22.445 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:16:22.445 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:16:22.445 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:16:22.445 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:16:22.445 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:16:22.446 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:16:22.446 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:16:22.446 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:16:22.446 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:16:22.446 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:16:22.446 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:16:22.446 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:16:22.446 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:16:22.446 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:16:22.446 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:16:22.446 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:16:22.446 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:16:22.446 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:16:22.447 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:16:22.447 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:16:22.447 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:16:22.447 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:16:22.447 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:16:22.447 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:16:22.447 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:16:22.447 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:16:22.447 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:16:22.447 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:16:22.447 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:16:22.447 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:16:22.447 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:16:22.447 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:16:22.448 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:16:22.448 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:16:22.448 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:16:22.448 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:16:22.448 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:16:22.448 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:16:22.448 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:16:22.448 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:16:22.448 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:16:22.448 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:16:22.448 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:16:22.448 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:16:22.448 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:16:22.448 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:16:22.449 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:16:22.449 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:16:22.449 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:16:22.449 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:16:22.449 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:16:22.449 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:16:22.449 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:16:22.449 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:16:22.449 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:16:22.449 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:16:22.449 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:16:22.449 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:16:22.449 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:16:22.449 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:16:22.450 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:16:22.450 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:16:22.450 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:16:22.450 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:16:22.450 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:16:22.450 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:16:22.450 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:16:22.450 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:16:22.450 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:16:22.450 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:16:22.450 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:16:22.450 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:16:22.450 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:16:22.450 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:16:22.451 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:16:22.451 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:16:22.451 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:16:22.451 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:16:22.451 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:16:22.451 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:16:22.451 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:16:22.451 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:16:22.451 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:16:22.451 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:16:22.451 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:16:22.451 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:16:22.451 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:16:22.452 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:16:22.452 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:16:22.452 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:16:22.452 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:16:22.452 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:16:22.452 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:16:22.452 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:16:22.452 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:16:22.452 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:16:22.452 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:16:22.452 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:16:22.452 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:16:22.452 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:16:22.452 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:16:22.453 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:16:22.453 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:16:22.453 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:16:22.453 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:16:22.453 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:16:22.453 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:16:22.453 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:16:22.453 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:16:22.453 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:16:22.453 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:16:22.453 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:16:22.453 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:16:22.453 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:16:22.453 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:16:22.454 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:16:22.454 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:16:22.454 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:16:22.454 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:16:22.454 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:16:22.454 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:16:22.454 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:16:22.454 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:16:22.454 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:16:22.454 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:16:22.454 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:16:22.454 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:16:22.454 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:16:22.455 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:16:22.455 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:16:22.455 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:16:22.455 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:16:22.455 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:16:22.455 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:16:22.455 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:16:22.455 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:16:22.455 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:16:22.455 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:16:22.455 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:16:22.455 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:16:22.455 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:16:22.455 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:16:22.456 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:16:22.456 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:16:22.456 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:16:22.456 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:16:22.456 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:16:22.456 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:16:22.456 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:16:22.456 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:16:22.456 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:16:22.456 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:16:22.456 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:16:22.456 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:16:22.456 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:16:22.456 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:16:22.457 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:16:22.457 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:16:22.457 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:16:22.457 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:16:22.457 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:16:22.457 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:16:22.457 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:16:22.457 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:16:22.457 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:16:22.457 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:16:22.457 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:16:22.457 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:16:22.457 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:16:22.457 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:16:22.458 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:16:22.458 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:16:22.458 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:16:22.458 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:16:22.458 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:16:22.458 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:16:22.458 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:16:22.458 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:16:22.458 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:16:22.458 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:16:22.458 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:16:22.458 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:16:22.458 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:16:22.458 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:16:22.459 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:16:22.459 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:16:22.459 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:16:22.459 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:16:22.459 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:16:22.459 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:16:22.459 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:16:22.459 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:16:22.459 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:16:22.459 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:16:22.459 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:16:22.459 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:16:22.459 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:16:22.459 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:16:22.460 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:16:22.460 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:16:22.460 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:16:22.460 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:16:22.460 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:16:22.460 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:16:22.460 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:16:22.460 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:16:22.460 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:16:22.460 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:16:22.460 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:16:22.460 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:16:22.460 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:16:22.461 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:16:22.461 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:16:22.461 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:16:22.461 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:16:22.461 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:16:22.461 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:16:22.461 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:16:22.461 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:16:22.461 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:16:22.461 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:16:22.461 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:16:22.461 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:16:22.461 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:16:22.461 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:16:22.465 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:22.465 DEBUG:teuthology.orchestra.run.smithi171:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:16:22.488 INFO:teuthology.orchestra.run.smithi171.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:16:22.488 INFO:teuthology.orchestra.run.smithi171.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:16:22.488 INFO:teuthology.orchestra.run.smithi171.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:16:22.488 INFO:teuthology.orchestra.run.smithi171.stdout:fi 2024-08-17T02:16:22.488 INFO:teuthology.orchestra.run.smithi171.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:16:22.488 INFO:teuthology.orchestra.run.smithi171.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:16:22.488 INFO:teuthology.orchestra.run.smithi171.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:16:22.489 INFO:teuthology.orchestra.run.smithi171.stdout: fi 2024-08-17T02:16:22.489 INFO:teuthology.orchestra.run.smithi171.stdout:done 2024-08-17T02:16:22.489 INFO:teuthology.orchestra.run.smithi171.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:16:22.489 INFO:teuthology.orchestra.run.smithi171.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:16:22.489 INFO:teuthology.orchestra.run.smithi171.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:16:22.489 INFO:teuthology.orchestra.run.smithi171.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:16:22.489 INFO:teuthology.orchestra.run.smithi171.stdout:fi 2024-08-17T02:16:22.489 INFO:teuthology.orchestra.run.smithi171.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:16:22.489 INFO:teuthology.orchestra.run.smithi171.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:22.489 INFO:teuthology.orchestra.run.smithi171.stdout:fi 2024-08-17T02:16:22.489 INFO:teuthology.orchestra.run.smithi171.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:16:22.489 INFO:teuthology.orchestra.run.smithi171.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:16:22.489 INFO:teuthology.orchestra.run.smithi171.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:22.489 INFO:teuthology.orchestra.run.smithi171.stdout:fi 2024-08-17T02:16:22.490 DEBUG:teuthology.orchestra.run.smithi171:> sudo rpm -qi grub2-tools 2024-08-17T02:16:22.566 INFO:teuthology.orchestra.run.smithi171.stdout:Name : grub2-tools 2024-08-17T02:16:22.567 INFO:teuthology.orchestra.run.smithi171.stdout:Epoch : 1 2024-08-17T02:16:22.567 INFO:teuthology.orchestra.run.smithi171.stdout:Version : 2.06 2024-08-17T02:16:22.567 INFO:teuthology.orchestra.run.smithi171.stdout:Release : 68.el9 2024-08-17T02:16:22.567 INFO:teuthology.orchestra.run.smithi171.stdout:Architecture: x86_64 2024-08-17T02:16:22.567 INFO:teuthology.orchestra.run.smithi171.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:16:22.567 INFO:teuthology.orchestra.run.smithi171.stdout:Group : Unspecified 2024-08-17T02:16:22.567 INFO:teuthology.orchestra.run.smithi171.stdout:Size : 8264254 2024-08-17T02:16:22.567 INFO:teuthology.orchestra.run.smithi171.stdout:License : GPLv3+ 2024-08-17T02:16:22.567 INFO:teuthology.orchestra.run.smithi171.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:16:22.567 INFO:teuthology.orchestra.run.smithi171.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:16:22.567 INFO:teuthology.orchestra.run.smithi171.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:16:22.567 INFO:teuthology.orchestra.run.smithi171.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:16:22.568 INFO:teuthology.orchestra.run.smithi171.stdout:Packager : builder@centos.org 2024-08-17T02:16:22.568 INFO:teuthology.orchestra.run.smithi171.stdout:Vendor : CentOS 2024-08-17T02:16:22.568 INFO:teuthology.orchestra.run.smithi171.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:16:22.568 INFO:teuthology.orchestra.run.smithi171.stdout:Summary : Support tools for GRUB. 2024-08-17T02:16:22.568 INFO:teuthology.orchestra.run.smithi171.stdout:Description : 2024-08-17T02:16:22.568 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:16:22.568 INFO:teuthology.orchestra.run.smithi171.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:16:22.568 INFO:teuthology.orchestra.run.smithi171.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:16:22.568 INFO:teuthology.orchestra.run.smithi171.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:16:22.568 INFO:teuthology.orchestra.run.smithi171.stdout:hardware devices. 2024-08-17T02:16:22.568 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:16:22.568 INFO:teuthology.orchestra.run.smithi171.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:16:22.569 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:16:22.569 INFO:teuthology.task.kernel:Updating grub on smithi171 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:22.569 DEBUG:teuthology.orchestra.run.smithi171:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:16:23.136 INFO:teuthology.orchestra.run.smithi171.stderr:Generating grub configuration file ... 2024-08-17T02:16:24.490 INFO:teuthology.orchestra.run.smithi171.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:16:24.520 INFO:teuthology.orchestra.run.smithi171.stderr:done 2024-08-17T02:16:24.523 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-08-17T02:16:24.539 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.JxHmT2f9iB 2024-08-17T02:16:24.540 DEBUG:teuthology.orchestra.run.smithi171:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JxHmT2f9iB 2024-08-17T02:16:24.615 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.JxHmT2f9iB 2024-08-17T02:16:24.760 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.JxHmT2f9iB is 6KB 2024-08-17T02:16:24.807 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.JxHmT2f9iB 2024-08-17T02:16:24.822 DEBUG:teuthology.orchestra.run.smithi171:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:16:24.883 INFO:teuthology.orchestra.run.smithi171.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:16:24.883 INFO:teuthology.orchestra.run.smithi171.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:16:24.883 INFO:teuthology.orchestra.run.smithi171.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:16:24.883 INFO:teuthology.orchestra.run.smithi171.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:16:24.884 DEBUG:teuthology.orchestra.run.smithi171:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:25.019 DEBUG:teuthology.orchestra.run.smithi171:> sudo shutdown -r now 2024-08-17T02:16:35.811 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-08-17T02:16:44.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-08-17T02:16:44.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:16:55.031 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-08-17T02:16:55.031 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-08-17T02:16:55.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:17:13.439 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-08-17T02:17:22.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-08-17T02:17:22.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:17:25.502 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-08-17T02:17:37.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-08-17T02:17:37.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:17:40.574 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-08-17T02:17:44.824 DEBUG:teuthology.orchestra.remote:timed out 2024-08-17T02:17:55.582 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-08-17T02:17:55.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:17:56.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-08-17T02:17:56.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:17:57.171 DEBUG:teuthology.orchestra.run.smithi106:> true 2024-08-17T02:17:57.685 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-08-17T02:17:57.685 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:17:57.685 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2024-08-17T02:17:57.721 INFO:teuthology.orchestra.run.smithi106.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:17:57.721 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:17:57.721 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:17:57.721 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:17:58.722 DEBUG:teuthology.parallel:result is None 2024-08-17T02:18:55.586 DEBUG:teuthology.orchestra.remote:timed out 2024-08-17T02:19:13.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-08-17T02:19:13.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:19:13.919 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-08-17T02:19:14.443 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-08-17T02:19:14.443 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:19:14.444 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2024-08-17T02:19:14.478 INFO:teuthology.orchestra.run.smithi171.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:19:14.478 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:19:14.478 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:19:14.478 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:19:15.481 DEBUG:teuthology.parallel:result is None 2024-08-17T02:19:15.481 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-17T02:19:15.489 INFO:teuthology.task.internal:Creating test directory... 2024-08-17T02:19:15.489 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:19:15.494 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:19:15.533 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-17T02:19:15.539 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-17T02:19:15.549 INFO:teuthology.task.internal:Creating archive directory... 2024-08-17T02:19:15.550 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:19:15.573 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:19:15.640 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-17T02:19:15.646 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-17T02:19:15.647 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:19:15.651 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:19:15.741 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:19:15.770 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:19:15.791 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:19:15.814 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:19:15.818 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-17T02:19:15.825 INFO:teuthology.task.internal:Configuring sudo... 2024-08-17T02:19:15.825 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:19:15.829 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:19:15.885 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-17T02:19:15.896 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-17T02:19:15.897 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:19:15.900 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:19:15.935 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:19:16.034 DEBUG:teuthology.orchestra.run.smithi106:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:19:16.108 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:19:16.172 DEBUG:teuthology.orchestra.run.smithi106:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:19:16.241 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-17T02:19:16.242 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:19:16.298 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:19:16.363 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:19:16.443 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:19:16.506 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:19:16.576 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-17T02:19:16.577 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:19:16.631 DEBUG:teuthology.orchestra.run.smithi106:> sudo service rsyslog restart 2024-08-17T02:19:16.635 DEBUG:teuthology.orchestra.run.smithi171:> sudo service rsyslog restart 2024-08-17T02:19:16.719 INFO:teuthology.orchestra.run.smithi106.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:19:16.745 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:19:17.229 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-17T02:19:17.237 INFO:teuthology.task.internal:Starting timer... 2024-08-17T02:19:17.237 INFO:teuthology.run_tasks:Running task pcp... 2024-08-17T02:19:17.247 INFO:teuthology.run_tasks:Running task selinux... 2024-08-17T02:19:17.256 DEBUG:teuthology.orchestra.run.smithi106:> sudo service auditd rotate 2024-08-17T02:19:17.342 INFO:teuthology.orchestra.run.smithi106.stdout:Rotating logs: 2024-08-17T02:19:17.345 DEBUG:teuthology.orchestra.run.smithi171:> sudo service auditd rotate 2024-08-17T02:19:17.433 INFO:teuthology.orchestra.run.smithi171.stdout:Rotating logs: 2024-08-17T02:19:17.436 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-17T02:19:17.436 DEBUG:teuthology.orchestra.run.smithi106:> /usr/sbin/getenforce 2024-08-17T02:19:17.481 INFO:teuthology.orchestra.run.smithi106.stdout:Permissive 2024-08-17T02:19:17.481 DEBUG:teuthology.orchestra.run.smithi171:> /usr/sbin/getenforce 2024-08-17T02:19:17.527 INFO:teuthology.orchestra.run.smithi171.stdout:Permissive 2024-08-17T02:19:17.528 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi106.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi171.front.sepia.ceph.com': 'permissive'} 2024-08-17T02:19:17.528 DEBUG:teuthology.orchestra.run.smithi106:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:19:17.585 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:19:17.585 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:19:17.642 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:19:17.642 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-17T02:19:17.642 DEBUG:teuthology.orchestra.run.smithi106:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:19:17.698 DEBUG:teuthology.orchestra.run.smithi171:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:19:17.755 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-17T02:19:17.767 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-08-17T02:19:17.770 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-08-17T02:19:17.883 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-17T02:19:17.895 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-17T02:19:17.896 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi106.front.sepia.ceph.com,smithi171.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-17T02:24:52.103 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi106.front.sepia.ceph.com'), Remote(name='ubuntu@smithi171.front.sepia.ceph.com')] 2024-08-17T02:24:52.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-08-17T02:24:52.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:24:52.197 DEBUG:teuthology.orchestra.run.smithi106:> true 2024-08-17T02:24:52.299 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-08-17T02:24:52.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-08-17T02:24:52.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:24:52.387 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-08-17T02:24:52.495 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-08-17T02:24:52.495 INFO:teuthology.run_tasks:Running task clock... 2024-08-17T02:24:52.505 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-17T02:24:52.505 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:24:52.506 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:24:52.510 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:24:52.510 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:24:52.566 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:24:52.596 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:24:52.596 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:24:52.625 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:24:52.646 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: ntpd: command not found 2024-08-17T02:24:52.670 INFO:teuthology.orchestra.run.smithi106.stdout:506 Cannot talk to daemon 2024-08-17T02:24:52.681 INFO:teuthology.orchestra.run.smithi171.stderr:sudo: ntpd: command not found 2024-08-17T02:24:52.699 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:24:52.712 INFO:teuthology.orchestra.run.smithi171.stdout:506 Cannot talk to daemon 2024-08-17T02:24:52.728 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:24:52.741 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:24:52.771 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:24:52.828 INFO:teuthology.orchestra.run.smithi106.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:24:52.835 INFO:teuthology.orchestra.run.smithi106.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:24:52.835 INFO:teuthology.orchestra.run.smithi106.stdout:=============================================================================== 2024-08-17T02:24:52.835 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:24:52.835 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:24:52.835 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:24:52.835 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:24:52.861 INFO:teuthology.orchestra.run.smithi171.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:24:52.868 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:24:52.868 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2024-08-17T02:24:52.868 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:24:52.868 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:24:52.868 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:24:52.868 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:24:52.869 INFO:teuthology.run_tasks:Running task install... 2024-08-17T02:24:52.877 DEBUG:teuthology.task.install:project ceph 2024-08-17T02:24:52.877 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}} 2024-08-17T02:24:52.877 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'} 2024-08-17T02:24:52.878 INFO:teuthology.task.install:Using flavor: default 2024-08-17T02:24:52.883 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-17T02:24:52.883 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-08-17T02:24:52.884 DEBUG:teuthology.orchestra.run.smithi106:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:24:52.884 DEBUG:teuthology.orchestra.run.smithi171:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:24:53.583 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:19 ago on Sat 17 Aug 2024 02:23:34 AM UTC. 2024-08-17T02:24:53.593 INFO:teuthology.orchestra.run.smithi171.stdout:Last metadata expiration check: 0:01:17 ago on Sat 17 Aug 2024 02:23:36 AM UTC. 2024-08-17T02:24:53.671 INFO:teuthology.orchestra.run.smithi106.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:24:53.681 INFO:teuthology.orchestra.run.smithi171.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:24:53.713 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-08-17T02:24:53.714 INFO:teuthology.orchestra.run.smithi106.stdout:Nothing to do. 2024-08-17T02:24:53.714 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-08-17T02:24:53.723 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-08-17T02:24:53.725 INFO:teuthology.orchestra.run.smithi171.stdout:Nothing to do. 2024-08-17T02:24:53.725 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-08-17T02:24:53.792 DEBUG:teuthology.orchestra.run.smithi106:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:24:53.799 DEBUG:teuthology.orchestra.run.smithi171:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:24:54.054 INFO:teuthology.orchestra.run.smithi106.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:24:54.054 INFO:teuthology.orchestra.run.smithi106.stderr:of the main distribution, and quality may vary. 2024-08-17T02:24:54.054 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-08-17T02:24:54.054 INFO:teuthology.orchestra.run.smithi106.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:24:54.054 INFO:teuthology.orchestra.run.smithi106.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:24:54.054 INFO:teuthology.orchestra.run.smithi106.stderr:, 2024-08-17T02:24:54.055 INFO:teuthology.orchestra.run.smithi106.stderr:and packages are not held to any quality or security level. 2024-08-17T02:24:54.055 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-08-17T02:24:54.055 INFO:teuthology.orchestra.run.smithi106.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:24:54.055 INFO:teuthology.orchestra.run.smithi106.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:24:54.058 INFO:teuthology.orchestra.run.smithi171.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:24:54.059 INFO:teuthology.orchestra.run.smithi171.stderr:of the main distribution, and quality may vary. 2024-08-17T02:24:54.059 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-08-17T02:24:54.059 INFO:teuthology.orchestra.run.smithi171.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:24:54.059 INFO:teuthology.orchestra.run.smithi171.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:24:54.059 INFO:teuthology.orchestra.run.smithi171.stderr:, 2024-08-17T02:24:54.059 INFO:teuthology.orchestra.run.smithi171.stderr:and packages are not held to any quality or security level. 2024-08-17T02:24:54.059 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-08-17T02:24:54.059 INFO:teuthology.orchestra.run.smithi171.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:24:54.059 INFO:teuthology.orchestra.run.smithi171.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:24:54.143 INFO:teuthology.orchestra.run.smithi106.stdout:Repository successfully enabled. 2024-08-17T02:24:54.143 INFO:teuthology.orchestra.run.smithi171.stdout:Repository successfully enabled. 2024-08-17T02:24:54.186 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:24:54.187 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:24:54.191 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:24:54.192 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:24:54.330 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:24:54.331 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:24:54.337 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:24:54.337 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:24:54.597 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:24:54.597 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-17T02:24:54.597 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:24:54.600 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:24:54.600 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-17T02:24:54.600 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:24:54.655 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:24:54.655 DEBUG:teuthology.orchestra.run.smithi171:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:24:54.656 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:24:54.656 DEBUG:teuthology.orchestra.run.smithi106:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:24:54.752 DEBUG:teuthology.orchestra.run.smithi171:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:24:54.754 DEBUG:teuthology.orchestra.run.smithi106:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:24:54.831 DEBUG:teuthology.orchestra.run.smithi106:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:24:54.833 DEBUG:teuthology.orchestra.run.smithi171:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:24:54.887 INFO:teuthology.orchestra.run.smithi106.stdout:check_obsoletes = 1 2024-08-17T02:24:54.888 INFO:teuthology.orchestra.run.smithi171.stdout:check_obsoletes = 1 2024-08-17T02:24:54.891 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum clean all 2024-08-17T02:24:54.892 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum clean all 2024-08-17T02:24:55.159 INFO:teuthology.orchestra.run.smithi106.stdout:45 files removed 2024-08-17T02:24:55.178 INFO:teuthology.orchestra.run.smithi171.stdout:45 files removed 2024-08-17T02:24:55.192 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:24:55.211 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:24:56.079 INFO:teuthology.orchestra.run.smithi106.stdout:ceph packages for x86_64 148 kB/s | 77 kB 00:00 2024-08-17T02:24:56.189 INFO:teuthology.orchestra.run.smithi171.stdout:ceph packages for x86_64 126 kB/s | 77 kB 00:00 2024-08-17T02:24:56.730 INFO:teuthology.orchestra.run.smithi106.stdout:ceph noarch packages 18 kB/s | 11 kB 00:00 2024-08-17T02:24:56.782 INFO:teuthology.orchestra.run.smithi171.stdout:ceph noarch packages 20 kB/s | 11 kB 00:00 2024-08-17T02:24:57.306 INFO:teuthology.orchestra.run.smithi106.stdout:ceph source packages 3.3 kB/s | 1.8 kB 00:00 2024-08-17T02:24:57.383 INFO:teuthology.orchestra.run.smithi171.stdout:ceph source packages 3.2 kB/s | 1.8 kB 00:00 2024-08-17T02:24:57.531 INFO:teuthology.orchestra.run.smithi106.stdout:Copr repo for el9 owned by ceph 40 kB/s | 7.6 kB 00:00 2024-08-17T02:24:57.592 INFO:teuthology.orchestra.run.smithi171.stdout:Copr repo for el9 owned by ceph 44 kB/s | 7.6 kB 00:00 2024-08-17T02:24:58.150 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-08-17T02:24:58.273 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-08-17T02:25:00.018 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-08-17T02:25:01.058 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - AppStream 12 MB/s | 20 MB 00:01 2024-08-17T02:25:06.317 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 6.6 MB 00:01 2024-08-17T02:25:06.585 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.6 MB 00:02 2024-08-17T02:25:07.834 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - Extras packages 98 kB/s | 18 kB 00:00 2024-08-17T02:25:08.202 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 18 kB 00:00 2024-08-17T02:25:08.830 INFO:teuthology.orchestra.run.smithi106.stdout:Extra Packages for Enterprise Linux 26 MB/s | 22 MB 00:00 2024-08-17T02:25:09.190 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux 26 MB/s | 22 MB 00:00 2024-08-17T02:25:15.103 INFO:teuthology.orchestra.run.smithi106.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-08-17T02:25:15.546 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-08-17T02:25:17.623 INFO:teuthology.orchestra.run.smithi106.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:25:17.624 INFO:teuthology.orchestra.run.smithi106.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:25:17.634 INFO:teuthology.orchestra.run.smithi106.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:25:17.635 INFO:teuthology.orchestra.run.smithi106.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:25:17.636 INFO:teuthology.orchestra.run.smithi106.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:25:17.637 INFO:teuthology.orchestra.run.smithi106.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:25:17.639 INFO:teuthology.orchestra.run.smithi106.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:25:17.641 INFO:teuthology.orchestra.run.smithi106.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:25:17.642 INFO:teuthology.orchestra.run.smithi106.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:25:17.704 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-08-17T02:25:17.722 INFO:teuthology.orchestra.run.smithi106.stdout:======================================================================================= 2024-08-17T02:25:17.723 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2024-08-17T02:25:17.723 INFO:teuthology.orchestra.run.smithi106.stdout:======================================================================================= 2024-08-17T02:25:17.723 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2024-08-17T02:25:17.723 INFO:teuthology.orchestra.run.smithi106.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:25:17.723 INFO:teuthology.orchestra.run.smithi106.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:25:17.723 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:25:17.723 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:25:17.723 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:25:17.723 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:25:17.723 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:25:17.723 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:25:17.723 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:25:17.723 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:25:17.724 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:25:17.724 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:25:17.724 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:25:17.724 INFO:teuthology.orchestra.run.smithi106.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:25:17.724 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:25:17.724 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:25:17.724 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:25:17.724 INFO:teuthology.orchestra.run.smithi106.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:25:17.724 INFO:teuthology.orchestra.run.smithi106.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:25:17.724 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:25:17.724 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:25:17.724 INFO:teuthology.orchestra.run.smithi106.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:25:17.724 INFO:teuthology.orchestra.run.smithi106.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:25:17.725 INFO:teuthology.orchestra.run.smithi106.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:25:17.725 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:25:17.725 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:25:17.725 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:25:17.725 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:25:17.725 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:25:17.725 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:25:17.725 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:25:17.725 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:25:17.725 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:25:17.725 INFO:teuthology.orchestra.run.smithi106.stdout:Upgrading: 2024-08-17T02:25:17.725 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:25:17.725 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:25:17.726 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:25:17.726 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:25:17.726 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:25:17.726 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:25:17.726 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:25:17.726 INFO:teuthology.orchestra.run.smithi106.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:25:17.726 INFO:teuthology.orchestra.run.smithi106.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:25:17.726 INFO:teuthology.orchestra.run.smithi106.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:25:17.726 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:25:17.726 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:25:17.726 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2024-08-17T02:25:17.726 INFO:teuthology.orchestra.run.smithi106.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:25:17.727 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:25:17.727 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:25:17.727 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:25:17.727 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:25:17.727 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:25:17.727 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:25:17.727 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:25:17.727 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:25:17.727 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:25:17.727 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:25:17.728 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:25:17.728 INFO:teuthology.orchestra.run.smithi106.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:25:17.728 INFO:teuthology.orchestra.run.smithi106.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:25:17.728 INFO:teuthology.orchestra.run.smithi106.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:25:17.728 INFO:teuthology.orchestra.run.smithi106.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:25:17.728 INFO:teuthology.orchestra.run.smithi106.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:25:17.728 INFO:teuthology.orchestra.run.smithi106.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:25:17.728 INFO:teuthology.orchestra.run.smithi106.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:25:17.728 INFO:teuthology.orchestra.run.smithi106.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:25:17.729 INFO:teuthology.orchestra.run.smithi106.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:25:17.729 INFO:teuthology.orchestra.run.smithi106.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:25:17.729 INFO:teuthology.orchestra.run.smithi106.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:25:17.729 INFO:teuthology.orchestra.run.smithi106.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:25:17.729 INFO:teuthology.orchestra.run.smithi106.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:25:17.729 INFO:teuthology.orchestra.run.smithi106.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:25:17.729 INFO:teuthology.orchestra.run.smithi106.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:25:17.729 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:25:17.729 INFO:teuthology.orchestra.run.smithi106.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:25:17.729 INFO:teuthology.orchestra.run.smithi106.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:25:17.730 INFO:teuthology.orchestra.run.smithi106.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:25:17.730 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:25:17.730 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:25:17.730 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:25:17.730 INFO:teuthology.orchestra.run.smithi106.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:25:17.730 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:25:17.730 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:25:17.730 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:25:17.730 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:25:17.730 INFO:teuthology.orchestra.run.smithi106.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:25:17.730 INFO:teuthology.orchestra.run.smithi106.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:25:17.730 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:25:17.730 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:25:17.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:25:17.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:25:17.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:25:17.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:25:17.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:25:17.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:25:17.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:25:17.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:25:17.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:25:17.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:25:17.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:25:17.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:25:17.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:25:17.731 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:25:17.732 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:25:17.732 INFO:teuthology.orchestra.run.smithi106.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:25:17.732 INFO:teuthology.orchestra.run.smithi106.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:25:17.732 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:25:17.732 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:25:17.732 INFO:teuthology.orchestra.run.smithi106.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:25:17.732 INFO:teuthology.orchestra.run.smithi106.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:25:17.732 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:25:17.732 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:25:17.732 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:25:17.732 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:25:17.732 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:25:17.732 INFO:teuthology.orchestra.run.smithi106.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:25:17.732 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:25:17.733 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:25:17.733 INFO:teuthology.orchestra.run.smithi106.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:25:17.733 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:25:17.733 INFO:teuthology.orchestra.run.smithi106.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:25:17.733 INFO:teuthology.orchestra.run.smithi106.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:25:17.733 INFO:teuthology.orchestra.run.smithi106.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:25:17.733 INFO:teuthology.orchestra.run.smithi106.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:25:17.733 INFO:teuthology.orchestra.run.smithi106.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:25:17.733 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:25:17.733 INFO:teuthology.orchestra.run.smithi106.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:25:17.733 INFO:teuthology.orchestra.run.smithi106.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:25:17.733 INFO:teuthology.orchestra.run.smithi106.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:25:17.733 INFO:teuthology.orchestra.run.smithi106.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:25:17.733 INFO:teuthology.orchestra.run.smithi106.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:25:17.734 INFO:teuthology.orchestra.run.smithi106.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:25:17.734 INFO:teuthology.orchestra.run.smithi106.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:25:17.734 INFO:teuthology.orchestra.run.smithi106.stdout:Installing weak dependencies: 2024-08-17T02:25:17.734 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:25:17.734 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:25:17.734 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-08-17T02:25:17.734 INFO:teuthology.orchestra.run.smithi106.stdout:======================================================================================= 2024-08-17T02:25:17.734 INFO:teuthology.orchestra.run.smithi106.stdout:Install 121 Packages 2024-08-17T02:25:17.734 INFO:teuthology.orchestra.run.smithi106.stdout:Upgrade 12 Packages 2024-08-17T02:25:17.735 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:25:17.735 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 206 M 2024-08-17T02:25:17.735 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2024-08-17T02:25:18.256 INFO:teuthology.orchestra.run.smithi171.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:25:18.257 INFO:teuthology.orchestra.run.smithi171.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:25:18.268 INFO:teuthology.orchestra.run.smithi171.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:25:18.269 INFO:teuthology.orchestra.run.smithi171.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:25:18.270 INFO:teuthology.orchestra.run.smithi171.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:25:18.271 INFO:teuthology.orchestra.run.smithi171.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:25:18.273 INFO:teuthology.orchestra.run.smithi171.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:25:18.275 INFO:teuthology.orchestra.run.smithi171.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:25:18.276 INFO:teuthology.orchestra.run.smithi171.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:25:18.337 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-08-17T02:25:18.357 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================= 2024-08-17T02:25:18.357 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repository Size 2024-08-17T02:25:18.357 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================= 2024-08-17T02:25:18.357 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-08-17T02:25:18.357 INFO:teuthology.orchestra.run.smithi171.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:25:18.357 INFO:teuthology.orchestra.run.smithi171.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:25:18.358 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:25:18.358 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:25:18.358 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:25:18.358 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:25:18.358 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:25:18.358 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:25:18.358 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:25:18.358 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:25:18.358 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:25:18.358 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:25:18.358 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:25:18.359 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:25:18.359 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:25:18.359 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:25:18.359 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:25:18.359 INFO:teuthology.orchestra.run.smithi171.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:25:18.359 INFO:teuthology.orchestra.run.smithi171.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:25:18.359 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:25:18.359 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:25:18.359 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:25:18.359 INFO:teuthology.orchestra.run.smithi171.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:25:18.359 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:25:18.359 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:25:18.359 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:25:18.360 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:25:18.360 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:25:18.360 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:25:18.360 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:25:18.360 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:25:18.360 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:25:18.360 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:25:18.360 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrading: 2024-08-17T02:25:18.360 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:25:18.360 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:25:18.360 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:25:18.360 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:25:18.361 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:25:18.361 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:25:18.361 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:25:18.361 INFO:teuthology.orchestra.run.smithi171.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:25:18.361 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:25:18.361 INFO:teuthology.orchestra.run.smithi171.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:25:18.361 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:25:18.361 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:25:18.361 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-08-17T02:25:18.361 INFO:teuthology.orchestra.run.smithi171.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:25:18.361 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:25:18.361 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:25:18.361 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:25:18.362 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:25:18.362 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:25:18.362 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:25:18.362 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:25:18.362 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:25:18.362 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:25:18.362 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:25:18.362 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:25:18.362 INFO:teuthology.orchestra.run.smithi171.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:25:18.362 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:25:18.362 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:25:18.362 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:25:18.362 INFO:teuthology.orchestra.run.smithi171.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:25:18.362 INFO:teuthology.orchestra.run.smithi171.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:25:18.363 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:25:18.363 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:25:18.363 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:25:18.363 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:25:18.363 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:25:18.363 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:25:18.363 INFO:teuthology.orchestra.run.smithi171.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:25:18.363 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:25:18.363 INFO:teuthology.orchestra.run.smithi171.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:25:18.363 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:25:18.363 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:25:18.363 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:25:18.363 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:25:18.363 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:25:18.364 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:25:18.364 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:25:18.364 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:25:18.364 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:25:18.364 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:25:18.364 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:25:18.364 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:25:18.364 INFO:teuthology.orchestra.run.smithi171.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:25:18.364 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:25:18.364 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:25:18.364 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:25:18.364 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:25:18.364 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:25:18.364 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:25:18.364 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:25:18.365 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:25:18.365 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:25:18.365 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:25:18.365 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:25:18.365 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:25:18.365 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:25:18.365 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:25:18.365 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:25:18.365 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:25:18.365 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:25:18.365 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:25:18.365 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:25:18.365 INFO:teuthology.orchestra.run.smithi171.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:25:18.366 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:25:18.366 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:25:18.366 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:25:18.366 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:25:18.366 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:25:18.366 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:25:18.366 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:25:18.366 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:25:18.366 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:25:18.366 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:25:18.366 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:25:18.366 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:25:18.366 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:25:18.367 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:25:18.367 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:25:18.367 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:25:18.367 INFO:teuthology.orchestra.run.smithi171.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:25:18.367 INFO:teuthology.orchestra.run.smithi171.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:25:18.367 INFO:teuthology.orchestra.run.smithi171.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:25:18.367 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:25:18.367 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:25:18.367 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:25:18.367 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:25:18.367 INFO:teuthology.orchestra.run.smithi171.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:25:18.367 INFO:teuthology.orchestra.run.smithi171.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:25:18.367 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:25:18.368 INFO:teuthology.orchestra.run.smithi171.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:25:18.368 INFO:teuthology.orchestra.run.smithi171.stdout:Installing weak dependencies: 2024-08-17T02:25:18.368 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:25:18.368 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:25:18.368 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-08-17T02:25:18.368 INFO:teuthology.orchestra.run.smithi171.stdout:======================================================================================= 2024-08-17T02:25:18.368 INFO:teuthology.orchestra.run.smithi171.stdout:Install 121 Packages 2024-08-17T02:25:18.368 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrade 12 Packages 2024-08-17T02:25:18.368 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:25:18.369 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 206 M 2024-08-17T02:25:18.369 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-08-17T02:25:18.629 INFO:teuthology.orchestra.run.smithi106.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 31 kB/s | 6.5 kB 00:00 2024-08-17T02:25:18.843 INFO:teuthology.orchestra.run.smithi106.stdout:(2/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 3.7 MB/s | 813 kB 00:00 2024-08-17T02:25:18.921 INFO:teuthology.orchestra.run.smithi106.stdout:(3/133): ceph-base-17.2.7-1375.g2577e813.el9.x8 9.9 MB/s | 5.0 MB 00:00 2024-08-17T02:25:18.930 INFO:teuthology.orchestra.run.smithi171.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 33 kB/s | 6.5 kB 00:00 2024-08-17T02:25:18.946 INFO:teuthology.orchestra.run.smithi106.stdout:(4/133): ceph-immutable-object-cache-17.2.7-137 1.3 MB/s | 137 kB 00:00 2024-08-17T02:25:19.038 INFO:teuthology.orchestra.run.smithi106.stdout:(5/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 18 MB/s | 2.1 MB 00:00 2024-08-17T02:25:19.147 INFO:teuthology.orchestra.run.smithi106.stdout:(6/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 7.0 MB/s | 1.4 MB 00:00 2024-08-17T02:25:19.255 INFO:teuthology.orchestra.run.smithi106.stdout:(7/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 18 MB/s | 3.9 MB 00:00 2024-08-17T02:25:19.531 INFO:teuthology.orchestra.run.smithi171.stdout:(2/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 1.3 MB/s | 813 kB 00:00 2024-08-17T02:25:19.789 INFO:teuthology.orchestra.run.smithi171.stdout:(3/133): ceph-immutable-object-cache-17.2.7-137 533 kB/s | 137 kB 00:00 2024-08-17T02:25:19.950 INFO:teuthology.orchestra.run.smithi106.stdout:(8/133): ceph-common-17.2.7-1375.g2577e813.el9. 15 MB/s | 22 MB 00:01 2024-08-17T02:25:19.990 INFO:teuthology.orchestra.run.smithi106.stdout:(9/133): ceph-selinux-17.2.7-1375.g2577e813.el9 605 kB/s | 25 kB 00:00 2024-08-17T02:25:20.164 INFO:teuthology.orchestra.run.smithi106.stdout:(10/133): ceph-radosgw-17.2.7-1375.g2577e813.el 16 MB/s | 14 MB 00:00 2024-08-17T02:25:20.226 INFO:teuthology.orchestra.run.smithi106.stdout:(11/133): cephfs-mirror-17.2.7-1375.g2577e813.e 3.6 MB/s | 215 kB 00:00 2024-08-17T02:25:20.290 INFO:teuthology.orchestra.run.smithi106.stdout:(12/133): libcephfs-devel-17.2.7-1375.g2577e813 375 kB/s | 25 kB 00:00 2024-08-17T02:25:20.416 INFO:teuthology.orchestra.run.smithi106.stdout:(13/133): libcephfs2-17.2.7-1375.g2577e813.el9. 5.0 MB/s | 636 kB 00:00 2024-08-17T02:25:20.482 INFO:teuthology.orchestra.run.smithi106.stdout:(14/133): libcephsqlite-17.2.7-1375.g2577e813.e 2.4 MB/s | 163 kB 00:00 2024-08-17T02:25:20.548 INFO:teuthology.orchestra.run.smithi171.stdout:(4/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 2.7 MB/s | 2.1 MB 00:00 2024-08-17T02:25:20.549 INFO:teuthology.orchestra.run.smithi106.stdout:(15/133): librados-devel-17.2.7-1375.g2577e813. 1.9 MB/s | 126 kB 00:00 2024-08-17T02:25:20.631 INFO:teuthology.orchestra.run.smithi171.stdout:(5/133): ceph-base-17.2.7-1375.g2577e813.el9.x8 2.6 MB/s | 5.0 MB 00:01 2024-08-17T02:25:20.633 INFO:teuthology.orchestra.run.smithi106.stdout:(16/133): libradosstriper1-17.2.7-1375.g2577e81 5.4 MB/s | 458 kB 00:00 2024-08-17T02:25:20.875 INFO:teuthology.orchestra.run.smithi106.stdout:(17/133): ceph-osd-17.2.7-1375.g2577e813.el9.x8 8.9 MB/s | 15 MB 00:01 2024-08-17T02:25:20.917 INFO:teuthology.orchestra.run.smithi106.stdout:(18/133): python3-ceph-argparse-17.2.7-1375.g25 1.1 MB/s | 45 kB 00:00 2024-08-17T02:25:21.001 INFO:teuthology.orchestra.run.smithi106.stdout:(19/133): librgw2-17.2.7-1375.g2577e813.el9.x86 13 MB/s | 4.9 MB 00:00 2024-08-17T02:25:21.026 INFO:teuthology.orchestra.run.smithi106.stdout:(20/133): python3-ceph-common-17.2.7-1375.g2577 1.1 MB/s | 120 kB 00:00 2024-08-17T02:25:21.051 INFO:teuthology.orchestra.run.smithi106.stdout:(21/133): python3-cephfs-17.2.7-1375.g2577e813. 3.6 MB/s | 182 kB 00:00 2024-08-17T02:25:21.076 INFO:teuthology.orchestra.run.smithi106.stdout:(22/133): python3-rados-17.2.7-1375.g2577e813.e 7.2 MB/s | 369 kB 00:00 2024-08-17T02:25:21.090 INFO:teuthology.orchestra.run.smithi171.stdout:(6/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 2.6 MB/s | 1.4 MB 00:00 2024-08-17T02:25:21.102 INFO:teuthology.orchestra.run.smithi106.stdout:(23/133): python3-rbd-17.2.7-1375.g2577e813.el9 6.7 MB/s | 344 kB 00:00 2024-08-17T02:25:21.127 INFO:teuthology.orchestra.run.smithi106.stdout:(24/133): python3-rgw-17.2.7-1375.g2577e813.el9 2.3 MB/s | 116 kB 00:00 2024-08-17T02:25:21.152 INFO:teuthology.orchestra.run.smithi106.stdout:(25/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 1.6 MB/s | 82 kB 00:00 2024-08-17T02:25:21.211 INFO:teuthology.orchestra.run.smithi106.stdout:(26/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 2.8 MB/s | 165 kB 00:00 2024-08-17T02:25:21.278 INFO:teuthology.orchestra.run.smithi106.stdout:(27/133): ceph-grafana-dashboards-17.2.7-1375.g 367 kB/s | 24 kB 00:00 2024-08-17T02:25:21.345 INFO:teuthology.orchestra.run.smithi106.stdout:(28/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 1.8 MB/s | 124 kB 00:00 2024-08-17T02:25:21.445 INFO:teuthology.orchestra.run.smithi106.stdout:(29/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 9.2 MB/s | 2.9 MB 00:00 2024-08-17T02:25:21.637 INFO:teuthology.orchestra.run.smithi106.stdout:(30/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 11 MB/s | 3.4 MB 00:00 2024-08-17T02:25:21.673 INFO:teuthology.orchestra.run.smithi171.stdout:(7/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 3.8 MB/s | 3.9 MB 00:01 2024-08-17T02:25:22.138 INFO:teuthology.orchestra.run.smithi106.stdout:(31/133): ceph-test-17.2.7-1375.g2577e813.el9.x 22 MB/s | 48 MB 00:02 2024-08-17T02:25:22.163 INFO:teuthology.orchestra.run.smithi106.stdout:(32/133): ceph-mgr-modules-core-17.2.7-1375.g25 457 kB/s | 240 kB 00:00 2024-08-17T02:25:22.188 INFO:teuthology.orchestra.run.smithi106.stdout:(33/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 953 kB/s | 47 kB 00:00 2024-08-17T02:25:22.213 INFO:teuthology.orchestra.run.smithi106.stdout:(34/133): ceph-prometheus-alerts-17.2.7-1375.g2 293 kB/s | 15 kB 00:00 2024-08-17T02:25:22.239 INFO:teuthology.orchestra.run.smithi106.stdout:(35/133): ceph-volume-17.2.7-1375.g2577e813.el9 5.3 MB/s | 269 kB 00:00 2024-08-17T02:25:22.264 INFO:teuthology.orchestra.run.smithi106.stdout:(36/133): cephadm-17.2.7-1375.g2577e813.el9.noa 1.6 MB/s | 83 kB 00:00 2024-08-17T02:25:22.289 INFO:teuthology.orchestra.run.smithi106.stdout:(37/133): cephfs-top-17.2.7-1375.g2577e813.el9. 363 kB/s | 18 kB 00:00 2024-08-17T02:25:22.365 INFO:teuthology.orchestra.run.smithi106.stdout:(38/133): fuse-2.9.9-16.el9.x86_64.rpm 797 kB/s | 80 kB 00:00 2024-08-17T02:25:22.432 INFO:teuthology.orchestra.run.smithi106.stdout:(39/133): libgfortran-11.4.1-3.el9.x86_64.rpm 5.5 MB/s | 803 kB 00:00 2024-08-17T02:25:22.497 INFO:teuthology.orchestra.run.smithi106.stdout:(40/133): libquadmath-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 195 kB 00:00 2024-08-17T02:25:22.524 INFO:teuthology.orchestra.run.smithi106.stdout:(41/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-08-17T02:25:22.616 INFO:teuthology.orchestra.run.smithi106.stdout:(42/133): ceph-mgr-diskprediction-local-17.2.7- 6.3 MB/s | 7.4 MB 00:01 2024-08-17T02:25:22.641 INFO:teuthology.orchestra.run.smithi106.stdout:(43/133): python3-ply-3.11-14.el9.noarch.rpm 910 kB/s | 106 kB 00:00 2024-08-17T02:25:22.683 INFO:teuthology.orchestra.run.smithi106.stdout:(44/133): python3-cryptography-36.0.1-4.el9.x86 6.6 MB/s | 1.2 MB 00:00 2024-08-17T02:25:22.709 INFO:teuthology.orchestra.run.smithi106.stdout:(45/133): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-08-17T02:25:22.742 INFO:teuthology.orchestra.run.smithi106.stdout:(46/133): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-08-17T02:25:22.759 INFO:teuthology.orchestra.run.smithi106.stdout:(47/133): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-08-17T02:25:23.318 INFO:teuthology.orchestra.run.smithi106.stdout:(48/133): elfutils-libelf-devel-0.191-4.el9.x86 39 kB/s | 22 kB 00:00 2024-08-17T02:25:23.593 INFO:teuthology.orchestra.run.smithi106.stdout:(49/133): automake-1.16.2-8.el9.noarch.rpm 779 kB/s | 689 kB 00:00 2024-08-17T02:25:23.677 INFO:teuthology.orchestra.run.smithi106.stdout:(50/133): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-08-17T02:25:24.118 INFO:teuthology.orchestra.run.smithi106.stdout:(51/133): flex-2.6.4-9.el9.x86_64.rpm 392 kB/s | 313 kB 00:00 2024-08-17T02:25:24.189 INFO:teuthology.orchestra.run.smithi106.stdout:(52/133): flexiblas-3.0.4-8.el9.x86_64.rpm 55 kB/s | 33 kB 00:00 2024-08-17T02:25:24.440 INFO:teuthology.orchestra.run.smithi171.stdout:(8/133): ceph-common-17.2.7-1375.g2577e813.el9. 3.9 MB/s | 22 MB 00:05 2024-08-17T02:25:24.619 INFO:teuthology.orchestra.run.smithi106.stdout:(53/133): flexiblas-openblas-openmp-3.0.4-8.el9 36 kB/s | 18 kB 00:00 2024-08-17T02:25:24.624 INFO:teuthology.orchestra.run.smithi171.stdout:(9/133): ceph-radosgw-17.2.7-1375.g2577e813.el9 4.8 MB/s | 14 MB 00:02 2024-08-17T02:25:24.649 INFO:teuthology.orchestra.run.smithi171.stdout:(10/133): ceph-selinux-17.2.7-1375.g2577e813.el 121 kB/s | 25 kB 00:00 2024-08-17T02:25:24.736 INFO:teuthology.orchestra.run.smithi106.stdout:(54/133): libaio-devel-0.3.111-13.el9.x86_64.rp 20 kB/s | 11 kB 00:00 2024-08-17T02:25:24.766 INFO:teuthology.orchestra.run.smithi171.stdout:(11/133): cephfs-mirror-17.2.7-1375.g2577e813.e 1.8 MB/s | 215 kB 00:00 2024-08-17T02:25:24.803 INFO:teuthology.orchestra.run.smithi106.stdout:(55/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.7 MB/s | 3.0 MB 00:01 2024-08-17T02:25:24.816 INFO:teuthology.orchestra.run.smithi171.stdout:(12/133): libcephfs-devel-17.2.7-1375.g2577e813 500 kB/s | 25 kB 00:00 2024-08-17T02:25:25.083 INFO:teuthology.orchestra.run.smithi171.stdout:(13/133): libcephfs2-17.2.7-1375.g2577e813.el9. 2.3 MB/s | 636 kB 00:00 2024-08-17T02:25:25.314 INFO:teuthology.orchestra.run.smithi171.stdout:(14/133): ceph-osd-17.2.7-1375.g2577e813.el9.x8 3.6 MB/s | 15 MB 00:04 2024-08-17T02:25:25.342 INFO:teuthology.orchestra.run.smithi171.stdout:(15/133): libcephsqlite-17.2.7-1375.g2577e813.e 629 kB/s | 163 kB 00:00 2024-08-17T02:25:25.386 INFO:teuthology.orchestra.run.smithi106.stdout:(56/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 70 kB/s | 45 kB 00:00 2024-08-17T02:25:25.437 INFO:teuthology.orchestra.run.smithi106.stdout:(57/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 196 kB/s | 160 kB 00:00 2024-08-17T02:25:25.462 INFO:teuthology.orchestra.run.smithi171.stdout:(16/133): librados-devel-17.2.7-1375.g2577e813. 869 kB/s | 126 kB 00:00 2024-08-17T02:25:25.551 INFO:teuthology.orchestra.run.smithi171.stdout:(17/133): libradosstriper1-17.2.7-1375.g2577e81 2.1 MB/s | 458 kB 00:00 2024-08-17T02:25:25.745 INFO:teuthology.orchestra.run.smithi106.stdout:(58/133): librdkafka-1.6.1-102.el9.x86_64.rpm 704 kB/s | 662 kB 00:00 2024-08-17T02:25:26.012 INFO:teuthology.orchestra.run.smithi106.stdout:(59/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 44 kB/s | 25 kB 00:00 2024-08-17T02:25:26.135 INFO:teuthology.orchestra.run.smithi171.stdout:(18/133): python3-ceph-argparse-17.2.7-1375.g25 77 kB/s | 45 kB 00:00 2024-08-17T02:25:26.226 INFO:teuthology.orchestra.run.smithi171.stdout:(19/133): python3-ceph-common-17.2.7-1375.g2577 1.3 MB/s | 120 kB 00:00 2024-08-17T02:25:26.287 INFO:teuthology.orchestra.run.smithi106.stdout:(60/133): libtool-2.4.6-46.el9.x86_64.rpm 645 kB/s | 581 kB 00:00 2024-08-17T02:25:26.346 INFO:teuthology.orchestra.run.smithi106.stdout:(61/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 79 kB/s | 47 kB 00:00 2024-08-17T02:25:26.360 INFO:teuthology.orchestra.run.smithi171.stdout:(20/133): python3-cephfs-17.2.7-1375.g2577e813. 1.3 MB/s | 182 kB 00:00 2024-08-17T02:25:26.569 INFO:teuthology.orchestra.run.smithi171.stdout:(21/133): python3-rados-17.2.7-1375.g2577e813.e 1.7 MB/s | 369 kB 00:00 2024-08-17T02:25:26.777 INFO:teuthology.orchestra.run.smithi171.stdout:(22/133): python3-rbd-17.2.7-1375.g2577e813.el9 1.6 MB/s | 344 kB 00:00 2024-08-17T02:25:26.838 INFO:teuthology.orchestra.run.smithi106.stdout:(62/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 354 kB/s | 292 kB 00:00 2024-08-17T02:25:26.871 INFO:teuthology.orchestra.run.smithi106.stdout:(63/133): openblas-0.3.21-2.el9.x86_64.rpm 60 kB/s | 35 kB 00:00 2024-08-17T02:25:26.886 INFO:teuthology.orchestra.run.smithi171.stdout:(23/133): python3-rgw-17.2.7-1375.g2577e813.el9 1.0 MB/s | 116 kB 00:00 2024-08-17T02:25:27.012 INFO:teuthology.orchestra.run.smithi171.stdout:(24/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 654 kB/s | 82 kB 00:00 2024-08-17T02:25:27.472 INFO:teuthology.orchestra.run.smithi106.stdout:(64/133): openblas-openmp-0.3.21-2.el9.x86_64.r 4.2 MB/s | 4.7 MB 00:01 2024-08-17T02:25:27.570 INFO:teuthology.orchestra.run.smithi171.stdout:(25/133): librgw2-17.2.7-1375.g2577e813.el9.x86 2.3 MB/s | 4.9 MB 00:02 2024-08-17T02:25:27.620 INFO:teuthology.orchestra.run.smithi171.stdout:(26/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 3.2 MB/s | 165 kB 00:00 2024-08-17T02:25:27.693 INFO:teuthology.orchestra.run.smithi171.stdout:(27/133): ceph-grafana-dashboards-17.2.7-1375.g 338 kB/s | 24 kB 00:00 2024-08-17T02:25:27.779 INFO:teuthology.orchestra.run.smithi171.stdout:(28/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 1.4 MB/s | 124 kB 00:00 2024-08-17T02:25:27.947 INFO:teuthology.orchestra.run.smithi106.stdout:(65/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 4.0 MB/s | 4.4 MB 00:01 2024-08-17T02:25:27.980 INFO:teuthology.orchestra.run.smithi171.stdout:(29/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 3.0 MB/s | 2.9 MB 00:00 2024-08-17T02:25:28.047 INFO:teuthology.orchestra.run.smithi106.stdout:(66/133): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2024-08-17T02:25:28.248 INFO:teuthology.orchestra.run.smithi106.stdout:(67/133): python3-devel-3.9.18-3.el9.x86_64.rpm 315 kB/s | 244 kB 00:00 2024-08-17T02:25:28.672 INFO:teuthology.orchestra.run.smithi106.stdout:(68/133): python3-jsonpatch-1.21-16.el9.noarch. 41 kB/s | 26 kB 00:00 2024-08-17T02:25:28.738 INFO:teuthology.orchestra.run.smithi171.stdout:(30/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 3.5 MB/s | 3.4 MB 00:00 2024-08-17T02:25:28.773 INFO:teuthology.orchestra.run.smithi106.stdout:(69/133): python3-jinja2-2.11.3-6.el9.noarch.rp 301 kB/s | 248 kB 00:00 2024-08-17T02:25:28.798 INFO:teuthology.orchestra.run.smithi106.stdout:(70/133): python3-jsonpointer-2.0-4.el9.noarch. 35 kB/s | 19 kB 00:00 2024-08-17T02:25:28.888 INFO:teuthology.orchestra.run.smithi171.stdout:(31/133): ceph-mgr-modules-core-17.2.7-1375.g25 1.6 MB/s | 240 kB 00:00 2024-08-17T02:25:28.964 INFO:teuthology.orchestra.run.smithi171.stdout:(32/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 634 kB/s | 47 kB 00:00 2024-08-17T02:25:29.056 INFO:teuthology.orchestra.run.smithi171.stdout:(33/133): ceph-prometheus-alerts-17.2.7-1375.g2 159 kB/s | 15 kB 00:00 2024-08-17T02:25:29.164 INFO:teuthology.orchestra.run.smithi171.stdout:(34/133): ceph-volume-17.2.7-1375.g2577e813.el9 2.4 MB/s | 269 kB 00:00 2024-08-17T02:25:29.323 INFO:teuthology.orchestra.run.smithi171.stdout:(35/133): cephadm-17.2.7-1375.g2577e813.el9.noa 521 kB/s | 83 kB 00:00 2024-08-17T02:25:29.365 INFO:teuthology.orchestra.run.smithi106.stdout:(71/133): python3-markupsafe-1.1.1-12.el9.x86_6 59 kB/s | 35 kB 00:00 2024-08-17T02:25:29.423 INFO:teuthology.orchestra.run.smithi171.stdout:(36/133): cephfs-top-17.2.7-1375.g2577e813.el9. 182 kB/s | 18 kB 00:00 2024-08-17T02:25:29.432 INFO:teuthology.orchestra.run.smithi106.stdout:(72/133): python3-mako-1.1.4-6.el9.noarch.rpm 227 kB/s | 172 kB 00:00 2024-08-17T02:25:29.532 INFO:teuthology.orchestra.run.smithi171.stdout:(37/133): fuse-2.9.9-16.el9.x86_64.rpm 738 kB/s | 80 kB 00:00 2024-08-17T02:25:29.766 INFO:teuthology.orchestra.run.smithi171.stdout:(38/133): libgfortran-11.4.1-3.el9.x86_64.rpm 3.4 MB/s | 803 kB 00:00 2024-08-17T02:25:29.866 INFO:teuthology.orchestra.run.smithi171.stdout:(39/133): ceph-mgr-diskprediction-local-17.2.7- 3.9 MB/s | 7.4 MB 00:01 2024-08-17T02:25:29.891 INFO:teuthology.orchestra.run.smithi171.stdout:(40/133): libquadmath-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 195 kB 00:00 2024-08-17T02:25:30.025 INFO:teuthology.orchestra.run.smithi171.stdout:(41/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.6 MB/s | 253 kB 00:00 2024-08-17T02:25:30.049 INFO:teuthology.orchestra.run.smithi106.stdout:(73/133): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.1 MB/s | 5.1 MB 00:01 2024-08-17T02:25:30.092 INFO:teuthology.orchestra.run.smithi171.stdout:(42/133): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-08-17T02:25:30.134 INFO:teuthology.orchestra.run.smithi171.stdout:(43/133): python3-cryptography-36.0.1-4.el9.x86 5.1 MB/s | 1.2 MB 00:00 2024-08-17T02:25:30.158 INFO:teuthology.orchestra.run.smithi106.stdout:(74/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 316 kB/s | 250 kB 00:00 2024-08-17T02:25:30.162 INFO:teuthology.orchestra.run.smithi171.stdout:(44/133): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-08-17T02:25:30.184 INFO:teuthology.orchestra.run.smithi171.stdout:(45/133): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-08-17T02:25:30.243 INFO:teuthology.orchestra.run.smithi171.stdout:(46/133): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-08-17T02:25:30.310 INFO:teuthology.orchestra.run.smithi171.stdout:(47/133): automake-1.16.2-8.el9.noarch.rpm 5.4 MB/s | 689 kB 00:00 2024-08-17T02:25:30.325 INFO:teuthology.orchestra.run.smithi106.stdout:(75/133): python3-oauthlib-3.1.1-5.el9.noarch.r 249 kB/s | 222 kB 00:00 2024-08-17T02:25:30.352 INFO:teuthology.orchestra.run.smithi171.stdout:(48/133): elfutils-libelf-devel-0.191-4.el9.x86 523 kB/s | 22 kB 00:00 2024-08-17T02:25:30.419 INFO:teuthology.orchestra.run.smithi171.stdout:(49/133): bison-3.7.4-5.el9.x86_64.rpm 5.2 MB/s | 943 kB 00:00 2024-08-17T02:25:30.444 INFO:teuthology.orchestra.run.smithi171.stdout:(50/133): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-08-17T02:25:30.470 INFO:teuthology.orchestra.run.smithi171.stdout:(51/133): flexiblas-3.0.4-8.el9.x86_64.rpm 653 kB/s | 33 kB 00:00 2024-08-17T02:25:30.545 INFO:teuthology.orchestra.run.smithi171.stdout:(52/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 30 MB/s | 3.0 MB 00:00 2024-08-17T02:25:30.562 INFO:teuthology.orchestra.run.smithi171.stdout:(53/133): flexiblas-openblas-openmp-3.0.4-8.el9 198 kB/s | 18 kB 00:00 2024-08-17T02:25:30.587 INFO:teuthology.orchestra.run.smithi171.stdout:(54/133): libaio-devel-0.3.111-13.el9.x86_64.rp 267 kB/s | 11 kB 00:00 2024-08-17T02:25:30.612 INFO:teuthology.orchestra.run.smithi171.stdout:(55/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-08-17T02:25:30.630 INFO:teuthology.orchestra.run.smithi171.stdout:(56/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-08-17T02:25:30.680 INFO:teuthology.orchestra.run.smithi171.stdout:(57/133): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-08-17T02:25:30.700 INFO:teuthology.orchestra.run.smithi106.stdout:(76/133): python3-packaging-20.9-5.el9.noarch.r 119 kB/s | 77 kB 00:00 2024-08-17T02:25:30.775 INFO:teuthology.orchestra.run.smithi106.stdout:(77/133): python3-prettytable-0.7.2-27.el9.noar 68 kB/s | 42 kB 00:00 2024-08-17T02:25:30.780 INFO:teuthology.orchestra.run.smithi171.stdout:(58/133): libtool-2.4.6-46.el9.x86_64.rpm 3.8 MB/s | 581 kB 00:00 2024-08-17T02:25:30.830 INFO:teuthology.orchestra.run.smithi171.stdout:(59/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 170 kB/s | 25 kB 00:00 2024-08-17T02:25:30.856 INFO:teuthology.orchestra.run.smithi171.stdout:(60/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 631 kB/s | 47 kB 00:00 2024-08-17T02:25:30.889 INFO:teuthology.orchestra.run.smithi171.stdout:(61/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-08-17T02:25:30.915 INFO:teuthology.orchestra.run.smithi171.stdout:(62/133): openblas-0.3.21-2.el9.x86_64.rpm 604 kB/s | 35 kB 00:00 2024-08-17T02:25:31.032 INFO:teuthology.orchestra.run.smithi171.stdout:(63/133): openblas-openmp-0.3.21-2.el9.x86_64.r 33 MB/s | 4.7 MB 00:00 2024-08-17T02:25:31.075 INFO:teuthology.orchestra.run.smithi106.stdout:(78/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 212 kB/s | 159 kB 00:00 2024-08-17T02:25:31.098 INFO:teuthology.orchestra.run.smithi171.stdout:(64/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2024-08-17T02:25:31.174 INFO:teuthology.orchestra.run.smithi171.stdout:(65/133): python3-devel-3.9.18-3.el9.x86_64.rpm 3.2 MB/s | 244 kB 00:00 2024-08-17T02:25:31.249 INFO:teuthology.orchestra.run.smithi171.stdout:(66/133): python3-babel-2.9.1-2.el9.noarch.rpm 27 MB/s | 6.0 MB 00:00 2024-08-17T02:25:31.274 INFO:teuthology.orchestra.run.smithi171.stdout:(67/133): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-08-17T02:25:31.308 INFO:teuthology.orchestra.run.smithi171.stdout:(68/133): python3-jsonpatch-1.21-16.el9.noarch. 440 kB/s | 26 kB 00:00 2024-08-17T02:25:31.333 INFO:teuthology.orchestra.run.smithi171.stdout:(69/133): python3-jsonpointer-2.0-4.el9.noarch. 327 kB/s | 19 kB 00:00 2024-08-17T02:25:31.358 INFO:teuthology.orchestra.run.smithi171.stdout:(70/133): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-08-17T02:25:31.384 INFO:teuthology.orchestra.run.smithi171.stdout:(71/133): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-08-17T02:25:31.425 INFO:teuthology.orchestra.run.smithi106.stdout:(79/133): python3-pytz-2021.1-5.el9.noarch.rpm 78 kB/s | 51 kB 00:00 2024-08-17T02:25:31.494 INFO:teuthology.orchestra.run.smithi171.stdout:(72/133): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 5.1 MB 00:00 2024-08-17T02:25:31.514 INFO:teuthology.orchestra.run.smithi106.stdout:(80/133): python3-pyasn1-modules-0.4.8-6.el9.no 342 kB/s | 279 kB 00:00 2024-08-17T02:25:31.526 INFO:teuthology.orchestra.run.smithi171.stdout:(73/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.7 MB/s | 250 kB 00:00 2024-08-17T02:25:31.552 INFO:teuthology.orchestra.run.smithi171.stdout:(74/133): python3-oauthlib-3.1.1-5.el9.noarch.r 3.8 MB/s | 222 kB 00:00 2024-08-17T02:25:31.577 INFO:teuthology.orchestra.run.smithi171.stdout:(75/133): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-08-17T02:25:31.594 INFO:teuthology.orchestra.run.smithi171.stdout:(76/133): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-08-17T02:25:31.619 INFO:teuthology.orchestra.run.smithi171.stdout:(77/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.7 MB/s | 159 kB 00:00 2024-08-17T02:25:31.653 INFO:teuthology.orchestra.run.smithi171.stdout:(78/133): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-08-17T02:25:31.670 INFO:teuthology.orchestra.run.smithi171.stdout:(79/133): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-17T02:25:31.695 INFO:teuthology.orchestra.run.smithi171.stdout:(80/133): python3-requests-oauthlib-1.3.0-12.el 1.2 MB/s | 54 kB 00:00 2024-08-17T02:25:31.745 INFO:teuthology.orchestra.run.smithi171.stdout:(81/133): python3-toml-0.10.2-6.el9.noarch.rpm 838 kB/s | 42 kB 00:00 2024-08-17T02:25:31.751 INFO:teuthology.orchestra.run.smithi106.stdout:(81/133): python3-requests-oauthlib-1.3.0-12.el 79 kB/s | 54 kB 00:00 2024-08-17T02:25:31.804 INFO:teuthology.orchestra.run.smithi171.stdout:(82/133): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-08-17T02:25:31.979 INFO:teuthology.orchestra.run.smithi171.stdout:(83/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 53 MB/s | 16 MB 00:00 2024-08-17T02:25:32.006 INFO:teuthology.orchestra.run.smithi171.stdout:(84/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 478 kB/s | 96 kB 00:00 2024-08-17T02:25:32.021 INFO:teuthology.orchestra.run.smithi171.stdout:(85/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-08-17T02:25:32.072 INFO:teuthology.orchestra.run.smithi171.stdout:(86/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 672 kB/s | 45 kB 00:00 2024-08-17T02:25:32.130 INFO:teuthology.orchestra.run.smithi171.stdout:(87/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.8 MB/s | 309 kB 00:00 2024-08-17T02:25:32.135 INFO:teuthology.orchestra.run.smithi106.stdout:(82/133): python3-toml-0.10.2-6.el9.noarch.rpm 67 kB/s | 42 kB 00:00 2024-08-17T02:25:32.189 INFO:teuthology.orchestra.run.smithi171.stdout:(88/133): libunwind-1.6.2-1.el9.x86_64.rpm 1.2 MB/s | 67 kB 00:00 2024-08-17T02:25:32.206 INFO:teuthology.orchestra.run.smithi171.stdout:(89/133): liboath-2.6.7-2.el9.x86_64.rpm 369 kB/s | 49 kB 00:00 2024-08-17T02:25:32.231 INFO:teuthology.orchestra.run.smithi171.stdout:(90/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-08-17T02:25:32.248 INFO:teuthology.orchestra.run.smithi171.stdout:(91/133): python3-cachetools-4.2.4-1.el9.noarch 1.9 MB/s | 32 kB 00:00 2024-08-17T02:25:32.265 INFO:teuthology.orchestra.run.smithi171.stdout:(92/133): python3-certifi-2023.05.07-4.el9.noar 849 kB/s | 14 kB 00:00 2024-08-17T02:25:32.290 INFO:teuthology.orchestra.run.smithi171.stdout:(93/133): python3-cheroot-8.6.0-4.el9.noarch.rp 6.8 MB/s | 172 kB 00:00 2024-08-17T02:25:32.316 INFO:teuthology.orchestra.run.smithi171.stdout:(94/133): python3-asyncssh-2.13.2-5.el9.noarch. 4.2 MB/s | 548 kB 00:00 2024-08-17T02:25:32.350 INFO:teuthology.orchestra.run.smithi171.stdout:(95/133): python3-google-auth-2.33.0-1.el9.noar 6.4 MB/s | 220 kB 00:00 2024-08-17T02:25:32.366 INFO:teuthology.orchestra.run.smithi171.stdout:(96/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 654 kB/s | 11 kB 00:00 2024-08-17T02:25:32.392 INFO:teuthology.orchestra.run.smithi171.stdout:(97/133): python3-cherrypy-18.6.1-2.el9.noarch. 3.5 MB/s | 358 kB 00:00 2024-08-17T02:25:32.408 INFO:teuthology.orchestra.run.smithi171.stdout:(98/133): python3-jaraco-classes-3.2.1-5.el9.no 423 kB/s | 18 kB 00:00 2024-08-17T02:25:32.425 INFO:teuthology.orchestra.run.smithi171.stdout:(99/133): python3-jaraco-collections-3.0.0-8.el 689 kB/s | 23 kB 00:00 2024-08-17T02:25:32.442 INFO:teuthology.orchestra.run.smithi171.stdout:(100/133): python3-jaraco-functools-3.5.0-2.el9 577 kB/s | 19 kB 00:00 2024-08-17T02:25:32.459 INFO:teuthology.orchestra.run.smithi171.stdout:(101/133): python3-jaraco-text-3.2.0-6.el9.noar 589 kB/s | 20 kB 00:00 2024-08-17T02:25:32.476 INFO:teuthology.orchestra.run.smithi171.stdout:(102/133): python3-jwt+crypto-2.4.0-1.el9.noarc 271 kB/s | 9.0 kB 00:00 2024-08-17T02:25:32.528 INFO:teuthology.orchestra.run.smithi171.stdout:(103/133): python3-jwt-2.4.0-1.el9.noarch.rpm 599 kB/s | 41 kB 00:00 2024-08-17T02:25:32.560 INFO:teuthology.orchestra.run.smithi106.stdout:(83/133): socat-1.7.4.1-6.el9.x86_64.rpm 376 kB/s | 304 kB 00:00 2024-08-17T02:25:32.562 INFO:teuthology.orchestra.run.smithi171.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 1.3 MB/s | 46 kB 00:00 2024-08-17T02:25:32.588 INFO:teuthology.orchestra.run.smithi171.stdout:(105/133): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-17T02:25:32.613 INFO:teuthology.orchestra.run.smithi171.stdout:(106/133): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-17T02:25:32.647 INFO:teuthology.orchestra.run.smithi171.stdout:(107/133): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-08-17T02:25:32.672 INFO:teuthology.orchestra.run.smithi171.stdout:(108/133): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-08-17T02:25:32.697 INFO:teuthology.orchestra.run.smithi171.stdout:(109/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-08-17T02:25:32.723 INFO:teuthology.orchestra.run.smithi171.stdout:(110/133): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-08-17T02:25:32.756 INFO:teuthology.orchestra.run.smithi171.stdout:(111/133): python3-kubernetes-26.1.0-2.el9.noar 3.7 MB/s | 1.0 MB 00:00 2024-08-17T02:25:32.781 INFO:teuthology.orchestra.run.smithi171.stdout:(112/133): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-17T02:25:32.807 INFO:teuthology.orchestra.run.smithi171.stdout:(113/133): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-08-17T02:25:32.832 INFO:teuthology.orchestra.run.smithi171.stdout:(114/133): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-08-17T02:25:32.891 INFO:teuthology.orchestra.run.smithi171.stdout:(115/133): python3-typing-extensions-4.12.2-2.e 892 kB/s | 74 kB 00:00 2024-08-17T02:25:32.916 INFO:teuthology.orchestra.run.smithi171.stdout:(116/133): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-17T02:25:32.935 INFO:teuthology.orchestra.run.smithi106.stdout:(84/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-08-17T02:25:32.941 INFO:teuthology.orchestra.run.smithi171.stdout:(117/133): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-08-17T02:25:32.958 INFO:teuthology.orchestra.run.smithi171.stdout:(118/133): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-08-17T02:25:32.985 INFO:teuthology.orchestra.run.smithi106.stdout:(85/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 112 kB/s | 96 kB 00:00 2024-08-17T02:25:32.992 INFO:teuthology.orchestra.run.smithi171.stdout:(119/133): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-08-17T02:25:33.042 INFO:teuthology.orchestra.run.smithi171.stdout:(120/133): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-08-17T02:25:33.052 INFO:teuthology.orchestra.run.smithi106.stdout:(86/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 4.5 MB/s | 309 kB 00:00 2024-08-17T02:25:33.078 INFO:teuthology.orchestra.run.smithi106.stdout:(87/133): liboath-2.6.7-2.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2024-08-17T02:25:33.103 INFO:teuthology.orchestra.run.smithi106.stdout:(88/133): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-08-17T02:25:33.137 INFO:teuthology.orchestra.run.smithi106.stdout:(89/133): python3-asyncssh-2.13.2-5.el9.noarch. 16 MB/s | 548 kB 00:00 2024-08-17T02:25:33.162 INFO:teuthology.orchestra.run.smithi106.stdout:(90/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-08-17T02:25:33.187 INFO:teuthology.orchestra.run.smithi106.stdout:(91/133): python3-cachetools-4.2.4-1.el9.noarch 1.3 MB/s | 32 kB 00:00 2024-08-17T02:25:33.212 INFO:teuthology.orchestra.run.smithi106.stdout:(92/133): python3-certifi-2023.05.07-4.el9.noar 566 kB/s | 14 kB 00:00 2024-08-17T02:25:33.263 INFO:teuthology.orchestra.run.smithi106.stdout:(93/133): python3-cheroot-8.6.0-4.el9.noarch.rp 7.2 MB/s | 172 kB 00:00 2024-08-17T02:25:33.313 INFO:teuthology.orchestra.run.smithi106.stdout:(94/133): python3-cherrypy-18.6.1-2.el9.noarch. 7.0 MB/s | 358 kB 00:00 2024-08-17T02:25:33.347 INFO:teuthology.orchestra.run.smithi106.stdout:(95/133): python3-google-auth-2.33.0-1.el9.noar 6.7 MB/s | 220 kB 00:00 2024-08-17T02:25:33.372 INFO:teuthology.orchestra.run.smithi106.stdout:(96/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 430 kB/s | 11 kB 00:00 2024-08-17T02:25:33.397 INFO:teuthology.orchestra.run.smithi106.stdout:(97/133): python3-jaraco-classes-3.2.1-5.el9.no 710 kB/s | 18 kB 00:00 2024-08-17T02:25:33.422 INFO:teuthology.orchestra.run.smithi106.stdout:(98/133): python3-jaraco-collections-3.0.0-8.el 924 kB/s | 23 kB 00:00 2024-08-17T02:25:33.448 INFO:teuthology.orchestra.run.smithi106.stdout:(99/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 72 kB/s | 64 kB 00:00 2024-08-17T02:25:33.473 INFO:teuthology.orchestra.run.smithi106.stdout:(100/133): python3-jaraco-functools-3.5.0-2.el9 393 kB/s | 19 kB 00:00 2024-08-17T02:25:33.523 INFO:teuthology.orchestra.run.smithi106.stdout:(101/133): python3-jwt+crypto-2.4.0-1.el9.noarc 389 kB/s | 9.0 kB 00:00 2024-08-17T02:25:33.549 INFO:teuthology.orchestra.run.smithi106.stdout:(102/133): python3-jaraco-text-3.2.0-6.el9.noar 195 kB/s | 20 kB 00:00 2024-08-17T02:25:33.574 INFO:teuthology.orchestra.run.smithi106.stdout:(103/133): python3-jwt-2.4.0-1.el9.noarch.rpm 855 kB/s | 41 kB 00:00 2024-08-17T02:25:33.599 INFO:teuthology.orchestra.run.smithi106.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-17T02:25:33.624 INFO:teuthology.orchestra.run.smithi106.stdout:(105/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 68 kB/s | 45 kB 00:00 2024-08-17T02:25:33.650 INFO:teuthology.orchestra.run.smithi106.stdout:(106/133): python3-more-itertools-8.12.0-2.el9. 1.6 MB/s | 79 kB 00:00 2024-08-17T02:25:33.709 INFO:teuthology.orchestra.run.smithi106.stdout:(107/133): python3-pecan-1.4.2-3.el9.noarch.rpm 8.4 MB/s | 272 kB 00:00 2024-08-17T02:25:33.717 INFO:teuthology.orchestra.run.smithi171.stdout:(121/133): librbd1-17.2.7-1375.g2577e813.el9.x8 4.4 MB/s | 2.9 MB 00:00 2024-08-17T02:25:33.733 INFO:teuthology.orchestra.run.smithi106.stdout:(108/133): python3-portend-3.1.0-2.el9.noarch.r 733 kB/s | 16 kB 00:00 2024-08-17T02:25:33.759 INFO:teuthology.orchestra.run.smithi106.stdout:(109/133): python3-natsort-7.1.1-5.el9.noarch.r 431 kB/s | 58 kB 00:00 2024-08-17T02:25:33.792 INFO:teuthology.orchestra.run.smithi106.stdout:(110/133): python3-kubernetes-26.1.0-2.el9.noar 4.7 MB/s | 1.0 MB 00:00 2024-08-17T02:25:33.818 INFO:teuthology.orchestra.run.smithi106.stdout:(111/133): python3-repoze-lru-0.7-16.el9.noarch 523 kB/s | 31 kB 00:00 2024-08-17T02:25:33.834 INFO:teuthology.orchestra.run.smithi171.stdout:(122/133): librados2-17.2.7-1375.g2577e813.el9. 3.7 MB/s | 3.1 MB 00:00 2024-08-17T02:25:33.843 INFO:teuthology.orchestra.run.smithi106.stdout:(112/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 824 kB/s | 90 kB 00:00 2024-08-17T02:25:33.868 INFO:teuthology.orchestra.run.smithi106.stdout:(113/133): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-08-17T02:25:33.894 INFO:teuthology.orchestra.run.smithi106.stdout:(114/133): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-08-17T02:25:33.919 INFO:teuthology.orchestra.run.smithi106.stdout:(115/133): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-08-17T02:25:33.944 INFO:teuthology.orchestra.run.smithi106.stdout:(116/133): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-08-17T02:25:33.969 INFO:teuthology.orchestra.run.smithi106.stdout:(117/133): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-08-17T02:25:33.995 INFO:teuthology.orchestra.run.smithi106.stdout:(118/133): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-08-17T02:25:34.020 INFO:teuthology.orchestra.run.smithi106.stdout:(119/133): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-08-17T02:25:34.054 INFO:teuthology.orchestra.run.smithi106.stdout:(120/133): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-08-17T02:25:34.104 INFO:teuthology.orchestra.run.smithi106.stdout:(121/133): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-08-17T02:25:34.135 INFO:teuthology.orchestra.run.smithi171.stdout:(123/133): NetworkManager-1.48.2-2.el9.x86_64.r 5.5 MB/s | 2.3 MB 00:00 2024-08-17T02:25:34.176 INFO:teuthology.orchestra.run.smithi171.stdout:(124/133): NetworkManager-team-1.48.2-2.el9.x86 989 kB/s | 41 kB 00:00 2024-08-17T02:25:34.221 INFO:teuthology.orchestra.run.smithi106.stdout:(122/133): NetworkManager-1.48.2-2.el9.x86_64.r 20 MB/s | 2.3 MB 00:00 2024-08-17T02:25:34.243 INFO:teuthology.orchestra.run.smithi171.stdout:(125/133): NetworkManager-libnm-1.48.2-2.el9.x8 4.4 MB/s | 1.8 MB 00:00 2024-08-17T02:25:34.268 INFO:teuthology.orchestra.run.smithi171.stdout:(126/133): NetworkManager-tui-1.48.2-2.el9.x86_ 2.6 MB/s | 247 kB 00:00 2024-08-17T02:25:34.294 INFO:teuthology.orchestra.run.smithi171.stdout:(127/133): elfutils-debuginfod-client-0.191-4.e 732 kB/s | 37 kB 00:00 2024-08-17T02:25:34.304 INFO:teuthology.orchestra.run.smithi106.stdout:(123/133): NetworkManager-libnm-1.48.2-2.el9.x8 22 MB/s | 1.8 MB 00:00 2024-08-17T02:25:34.319 INFO:teuthology.orchestra.run.smithi171.stdout:(128/133): elfutils-libelf-0.191-4.el9.x86_64.r 4.0 MB/s | 207 kB 00:00 2024-08-17T02:25:34.388 INFO:teuthology.orchestra.run.smithi106.stdout:(124/133): librbd1-17.2.7-1375.g2577e813.el9.x8 8.8 MB/s | 2.9 MB 00:00 2024-08-17T02:25:34.413 INFO:teuthology.orchestra.run.smithi106.stdout:(125/133): NetworkManager-team-1.48.2-2.el9.x86 376 kB/s | 41 kB 00:00 2024-08-17T02:25:34.501 INFO:teuthology.orchestra.run.smithi106.stdout:(126/133): NetworkManager-tui-1.48.2-2.el9.x86_ 2.2 MB/s | 247 kB 00:00 2024-08-17T02:25:34.545 INFO:teuthology.orchestra.run.smithi171.stdout:(129/133): elfutils-libs-0.191-4.el9.x86_64.rpm 1.0 MB/s | 260 kB 00:00 2024-08-17T02:25:34.611 INFO:teuthology.orchestra.run.smithi171.stdout:(130/133): openssl-3.2.2-2.el9.x86_64.rpm 4.6 MB/s | 1.4 MB 00:00 2024-08-17T02:25:34.739 INFO:teuthology.orchestra.run.smithi106.stdout:(127/133): elfutils-debuginfod-client-0.191-4.e 113 kB/s | 37 kB 00:00 2024-08-17T02:25:34.789 INFO:teuthology.orchestra.run.smithi106.stdout:(128/133): librados2-17.2.7-1375.g2577e813.el9. 4.0 MB/s | 3.1 MB 00:00 2024-08-17T02:25:34.817 INFO:teuthology.orchestra.run.smithi106.stdout:(129/133): elfutils-libelf-0.191-4.el9.x86_64.r 654 kB/s | 207 kB 00:00 2024-08-17T02:25:34.842 INFO:teuthology.orchestra.run.smithi106.stdout:(130/133): elfutils-libs-0.191-4.el9.x86_64.rpm 2.5 MB/s | 260 kB 00:00 2024-08-17T02:25:34.901 INFO:teuthology.orchestra.run.smithi106.stdout:(131/133): openssl-3.2.2-2.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-08-17T02:25:34.943 INFO:teuthology.orchestra.run.smithi106.stdout:(132/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 11 MB/s | 1.1 MB 00:00 2024-08-17T02:25:34.970 INFO:teuthology.orchestra.run.smithi171.stdout:(131/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 5.6 MB/s | 2.4 MB 00:00 2024-08-17T02:25:34.992 INFO:teuthology.orchestra.run.smithi106.stdout:(133/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-08-17T02:25:34.997 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:25:34.997 INFO:teuthology.orchestra.run.smithi106.stdout:Total 12 MB/s | 206 MB 00:17 2024-08-17T02:25:35.012 INFO:teuthology.orchestra.run.smithi171.stdout:(132/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 2.7 MB/s | 1.1 MB 00:00 2024-08-17T02:25:35.512 INFO:teuthology.orchestra.run.smithi171.stdout:(133/133): ceph-test-17.2.7-1375.g2577e813.el9. 4.4 MB/s | 48 MB 00:10 2024-08-17T02:25:35.519 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:25:35.519 INFO:teuthology.orchestra.run.smithi171.stdout:Total 12 MB/s | 206 MB 00:17 2024-08-17T02:25:36.671 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2024-08-17T02:25:36.881 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2024-08-17T02:25:36.881 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2024-08-17T02:25:37.238 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-08-17T02:25:37.448 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-08-17T02:25:37.448 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-08-17T02:25:38.971 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2024-08-17T02:25:38.971 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2024-08-17T02:25:39.593 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-08-17T02:25:39.593 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-08-17T02:25:44.690 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2024-08-17T02:25:44.781 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:25:44.831 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:25:44.906 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:25:44.950 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:25:44.982 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:25:45.067 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:25:45.411 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:25:45.497 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-08-17T02:25:45.507 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:25:45.601 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:25:45.650 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:25:45.651 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:25:45.683 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:25:45.747 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:25:45.794 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:25:45.800 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:25:45.826 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:25:45.884 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:25:46.217 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:25:46.272 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:25:46.301 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:25:46.317 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:25:46.404 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:25:46.468 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:25:46.469 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:25:46.503 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:25:46.519 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:25:46.624 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:25:46.637 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:25:46.654 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:25:46.806 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:25:47.115 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:25:47.117 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:25:47.154 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:25:47.237 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:25:47.285 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:25:47.312 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:25:47.338 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:25:47.363 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:25:47.472 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:25:47.476 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:25:47.506 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:25:47.580 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:25:47.655 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:25:47.938 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:25:47.957 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:25:47.978 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:25:48.013 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:25:48.097 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:25:48.138 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:25:48.154 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:25:48.172 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:25:48.232 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:25:48.262 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:25:48.335 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:25:48.335 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:25:48.367 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:25:48.424 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:25:48.428 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:25:48.524 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:25:48.563 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:25:48.634 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:25:48.727 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:25:48.793 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:25:48.863 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:25:48.888 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:25:48.907 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:25:48.947 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:25:48.991 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:25:49.031 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:25:49.065 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:25:49.155 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:25:49.218 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:25:49.252 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:25:49.304 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:25:49.387 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:25:49.423 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:25:49.468 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:25:49.585 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:25:49.609 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:25:49.705 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:25:49.749 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:25:49.771 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:25:49.815 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:25:49.853 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:25:49.897 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:25:49.933 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:25:49.985 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:25:50.024 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:25:50.084 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:25:50.170 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:25:50.209 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:25:50.245 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:25:50.304 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:25:50.461 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:25:50.585 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:25:50.591 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:25:50.629 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:25:50.641 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:25:50.676 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:25:50.720 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:25:50.759 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:25:50.813 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:25:50.814 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:25:50.856 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:25:50.858 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:25:50.899 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:25:50.943 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:25:51.017 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:25:51.026 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:25:51.056 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:25:51.068 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:25:51.101 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:25:51.104 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:25:51.130 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:25:51.163 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:25:51.167 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:25:51.205 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:25:51.242 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:25:51.248 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:25:51.277 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:25:51.310 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:25:51.373 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:25:51.411 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:25:51.423 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:25:51.446 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:25:51.496 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:25:51.591 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:25:51.620 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:25:51.640 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:25:51.676 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:25:51.682 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:25:51.802 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:25:51.841 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:25:51.887 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:25:51.931 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:25:51.967 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:25:52.006 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:25:52.043 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:25:52.078 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:25:52.111 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:25:52.155 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:25:52.187 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:25:52.256 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:25:52.313 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:25:52.438 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:25:52.511 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:25:52.581 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:25:52.637 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:25:52.670 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:25:52.786 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:25:52.829 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:25:53.053 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:25:53.076 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:25:53.169 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:25:53.391 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:25:53.446 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:25:53.479 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:25:53.595 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:25:53.646 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:25:53.874 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:25:53.951 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:25:53.974 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:25:54.054 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:25:54.114 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:25:54.846 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:25:54.988 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:25:55.720 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:25:55.806 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:25:55.842 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:25:55.875 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:25:56.189 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:25:56.229 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:25:56.345 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:25:56.372 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:25:56.562 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:25:56.676 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:25:56.716 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:25:56.750 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:25:57.067 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:25:57.120 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:25:57.228 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:25:57.255 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:25:58.957 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:25:59.010 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:25:59.605 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:25:59.665 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:25:59.810 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:25:59.810 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:25:59.811 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:25:59.811 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:25:59.848 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:25:59.907 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:25:59.951 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:26:00.540 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:26:00.588 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:26:00.735 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:26:00.735 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:26:00.735 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:26:00.735 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:00.781 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:26:11.432 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:26:11.433 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /sys 2024-08-17T02:26:11.433 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /proc 2024-08-17T02:26:11.433 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /mnt 2024-08-17T02:26:11.433 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /var/tmp 2024-08-17T02:26:11.433 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /home 2024-08-17T02:26:11.433 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /root 2024-08-17T02:26:11.433 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /tmp 2024-08-17T02:26:11.433 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:11.632 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:26:11.668 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:26:11.668 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:11.668 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:26:11.668 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:12.791 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:26:12.791 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /sys 2024-08-17T02:26:12.791 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /proc 2024-08-17T02:26:12.792 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /mnt 2024-08-17T02:26:12.792 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /var/tmp 2024-08-17T02:26:12.792 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /home 2024-08-17T02:26:12.792 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /root 2024-08-17T02:26:12.792 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /tmp 2024-08-17T02:26:12.792 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:12.998 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:26:13.035 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:26:13.035 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:13.035 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:26:13.035 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:13.211 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:26:13.272 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:26:13.272 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:13.272 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:26:13.272 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:26:13.272 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:26:13.272 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:13.495 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:26:13.546 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:26:13.547 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:13.547 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:26:13.547 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:26:13.547 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:26:13.547 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:13.946 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:26:13.996 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:26:13.996 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:13.997 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:26:13.997 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:26:13.997 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:26:13.997 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:14.138 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:26:14.199 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:26:14.278 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:26:14.501 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:26:14.505 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:26:14.557 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:26:14.559 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:26:14.559 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:14.559 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:26:14.559 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:26:14.559 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:26:14.559 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:14.643 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:26:14.751 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:26:14.794 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:26:14.845 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:26:14.845 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:14.845 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:26:14.845 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:26:14.845 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:26:14.845 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:14.918 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:26:14.987 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:26:15.020 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:26:15.056 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:26:15.105 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:26:15.130 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:26:15.261 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:26:15.312 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:26:15.312 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:15.312 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:26:15.312 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:26:15.313 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:26:15.313 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:15.463 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:26:15.530 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:26:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:26:15.595 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:26:15.621 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:26:15.651 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:26:15.712 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:26:15.743 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:26:15.820 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:26:15.884 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:26:15.970 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:26:16.077 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:26:16.266 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:26:16.314 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:26:16.340 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:26:16.376 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:26:16.425 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:26:16.474 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:26:16.890 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:26:16.954 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:26:17.056 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:26:17.085 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:26:17.115 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:26:17.207 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:26:17.241 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:26:18.029 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:26:18.054 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:26:18.191 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:26:18.360 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:26:18.389 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:26:18.398 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:26:18.440 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:26:18.440 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:18.440 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:26:18.441 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:26:18.441 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:26:18.441 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:18.444 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:26:18.490 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:26:18.516 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:26:18.616 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:26:18.681 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:26:19.536 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:26:19.578 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:26:19.713 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:26:19.892 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:26:19.923 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:26:19.973 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:26:19.973 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:19.974 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:26:19.974 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:26:19.974 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:26:19.974 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:19.988 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:26:20.023 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:26:20.034 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:26:20.048 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:26:20.148 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:26:20.148 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:20.148 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:26:20.148 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:26:20.148 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:26:20.148 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:20.149 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:26:20.210 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:26:20.236 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:26:20.259 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:26:20.259 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:20.260 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:26:20.260 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:20.328 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:26:20.378 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:26:20.378 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:20.379 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:26:20.379 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:26:20.379 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:26:20.379 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:20.687 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:26:20.738 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:26:20.738 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:20.738 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:26:20.738 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:26:20.738 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:26:20.738 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:21.569 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:26:21.610 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:26:21.723 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:26:21.724 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:21.724 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:26:21.724 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:26:21.724 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:26:21.724 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:21.778 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:26:21.827 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:26:21.828 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:21.828 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:26:21.828 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:21.929 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:26:21.980 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:26:21.980 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:21.980 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:26:21.980 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:26:21.980 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:26:21.980 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:22.297 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:26:22.347 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:26:22.347 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:26:22.348 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:26:22.348 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:26:22.348 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:26:22.348 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:26:25.474 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:26:25.519 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:26:25.556 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:26:25.589 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:26:25.624 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:26:25.663 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:26:25.694 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:26:25.743 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:26:27.035 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:26:27.077 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:26:27.127 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:26:27.171 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:26:27.200 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:26:27.234 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:26:27.269 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:26:27.287 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:26:27.343 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:26:27.362 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:26:27.383 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:26:27.410 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:26:27.431 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:26:27.517 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:26:27.549 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:26:27.574 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:26:27.599 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:26:27.628 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:26:27.628 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:26:27.728 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:26:27.760 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:26:27.760 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:26:27.903 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:26:27.928 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:26:27.944 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:26:27.944 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:26:28.205 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:26:28.205 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:26:28.323 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:26:28.356 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:26:28.383 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:26:28.455 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:26:28.658 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:26:28.658 INFO:teuthology.orchestra.run.smithi106.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:26:28.658 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:28.744 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:26:29.006 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:26:29.081 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:26:29.137 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:26:29.246 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:26:29.286 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:26:29.340 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:26:29.379 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:26:29.407 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:26:29.407 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:26:29.508 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:26:29.540 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:26:29.540 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:26:29.650 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:26:29.716 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:26:29.742 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:26:29.742 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:26:29.994 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:26:29.994 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:26:30.122 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:26:30.154 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:26:30.183 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:26:30.262 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:26:30.450 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:26:30.450 INFO:teuthology.orchestra.run.smithi171.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:26:30.450 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:33.745 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:26:33.745 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:26:33.745 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:26:33.745 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:26:33.745 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:26:33.745 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:26:33.745 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:26:33.745 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:26:33.745 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:26:33.745 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:26:33.745 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:26:33.746 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:26:33.746 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:26:33.746 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:26:33.746 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:26:33.746 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:26:33.746 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:26:33.746 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:26:33.746 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:26:33.746 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:26:33.746 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:26:33.747 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:26:33.747 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:26:33.747 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:26:33.747 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:26:33.747 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:26:33.747 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:26:33.757 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:26:33.757 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:26:33.757 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:26:33.758 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:26:33.758 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:26:33.758 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:26:33.758 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:26:33.758 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:26:33.758 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:26:33.758 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:26:33.758 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:26:33.758 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:26:33.758 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:26:33.758 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:26:33.758 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:26:33.759 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:26:33.759 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:26:33.759 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:26:33.759 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:26:33.759 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:26:33.759 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:26:33.759 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:26:33.759 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:26:33.759 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:26:33.759 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:26:33.759 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:26:33.759 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:26:33.759 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:26:33.759 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:26:33.760 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:26:33.760 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:26:33.760 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:26:33.760 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:26:33.760 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:26:33.760 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:26:33.760 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:26:33.760 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:26:33.760 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:26:33.760 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:26:33.760 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:26:33.760 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:26:33.760 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:26:33.761 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:26:33.761 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:26:33.761 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:26:33.761 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:26:33.761 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:26:33.761 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:26:33.761 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:26:33.761 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:26:33.761 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:26:33.761 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:26:33.761 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:26:33.761 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:26:33.762 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:26:33.762 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:26:33.762 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:26:33.762 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:26:33.762 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:26:33.762 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:26:33.762 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:26:33.762 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:26:33.762 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:26:33.762 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:26:33.762 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:26:33.763 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:26:33.763 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:26:33.763 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:26:33.763 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:26:33.763 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:26:33.763 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:26:33.763 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:26:33.763 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:26:33.763 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:26:33.763 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:26:33.763 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:26:33.763 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:26:33.764 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:26:33.764 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:26:33.764 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:26:33.764 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:26:33.764 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:26:33.764 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:26:33.764 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:26:33.764 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:26:33.764 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:26:33.764 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:26:33.764 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:26:33.764 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:26:33.764 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:26:33.764 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:26:33.765 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:26:33.765 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:26:33.765 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:26:33.765 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:26:33.765 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:26:33.765 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:26:33.765 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:26:33.765 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:26:33.765 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:26:33.765 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:26:33.765 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:26:33.765 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:26:33.766 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:26:33.766 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:26:33.766 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:26:33.766 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:26:33.766 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:26:33.766 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:26:33.766 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:26:33.766 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:26:33.766 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:26:33.766 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:26:33.766 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:26:33.766 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:26:33.766 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:26:33.767 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:26:35.668 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:26:35.668 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:35.669 INFO:teuthology.orchestra.run.smithi106.stdout:Upgraded: 2024-08-17T02:26:35.669 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:26:35.669 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:26:35.669 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:26:35.669 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:26:35.669 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:26:35.669 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:26:35.669 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:26:35.669 INFO:teuthology.orchestra.run.smithi106.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.669 INFO:teuthology.orchestra.run.smithi106.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.669 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:26:35.669 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:26:35.670 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:26:35.670 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2024-08-17T02:26:35.670 INFO:teuthology.orchestra.run.smithi106.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:26:35.670 INFO:teuthology.orchestra.run.smithi106.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:26:35.670 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.670 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.670 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.670 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.670 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:35.670 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.670 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.670 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.671 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:35.671 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:35.671 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:35.671 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:35.671 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:35.671 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.671 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.671 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:35.671 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.671 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.671 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.671 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:35.671 INFO:teuthology.orchestra.run.smithi106.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:35.671 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.672 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:35.672 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:26:35.672 INFO:teuthology.orchestra.run.smithi106.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:26:35.672 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:26:35.672 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:26:35.672 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:26:35.672 INFO:teuthology.orchestra.run.smithi106.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:26:35.672 INFO:teuthology.orchestra.run.smithi106.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:26:35.672 INFO:teuthology.orchestra.run.smithi106.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:26:35.672 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.672 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.672 INFO:teuthology.orchestra.run.smithi106.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.672 INFO:teuthology.orchestra.run.smithi106.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:26:35.672 INFO:teuthology.orchestra.run.smithi106.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:26:35.673 INFO:teuthology.orchestra.run.smithi106.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:26:35.673 INFO:teuthology.orchestra.run.smithi106.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:26:35.673 INFO:teuthology.orchestra.run.smithi106.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:26:35.673 INFO:teuthology.orchestra.run.smithi106.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.673 INFO:teuthology.orchestra.run.smithi106.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.673 INFO:teuthology.orchestra.run.smithi106.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:26:35.673 INFO:teuthology.orchestra.run.smithi106.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.673 INFO:teuthology.orchestra.run.smithi106.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:26:35.673 INFO:teuthology.orchestra.run.smithi106.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:26:35.673 INFO:teuthology.orchestra.run.smithi106.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:26:35.673 INFO:teuthology.orchestra.run.smithi106.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:26:35.673 INFO:teuthology.orchestra.run.smithi106.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:26:35.673 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:26:35.673 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:26:35.673 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:26:35.674 INFO:teuthology.orchestra.run.smithi106.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:26:35.674 INFO:teuthology.orchestra.run.smithi106.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:26:35.674 INFO:teuthology.orchestra.run.smithi106.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:26:35.674 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:26:35.674 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.674 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.674 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.674 INFO:teuthology.orchestra.run.smithi106.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:26:35.674 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:26:35.675 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:26:35.675 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:26:35.675 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:26:35.675 INFO:teuthology.orchestra.run.smithi106.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:26:35.675 INFO:teuthology.orchestra.run.smithi106.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:26:35.675 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:26:35.675 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:26:35.675 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:26:35.675 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:26:35.675 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:26:35.675 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:26:35.675 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:26:35.675 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:26:35.676 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:26:35.676 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:26:35.676 INFO:teuthology.orchestra.run.smithi106.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:26:35.676 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:26:35.676 INFO:teuthology.orchestra.run.smithi106.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:26:35.676 INFO:teuthology.orchestra.run.smithi106.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:26:35.676 INFO:teuthology.orchestra.run.smithi106.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:26:35.676 INFO:teuthology.orchestra.run.smithi106.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:26:35.676 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:26:35.676 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:26:35.676 INFO:teuthology.orchestra.run.smithi106.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:26:35.676 INFO:teuthology.orchestra.run.smithi106.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:26:35.676 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:26:35.677 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:26:35.677 INFO:teuthology.orchestra.run.smithi106.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:26:35.677 INFO:teuthology.orchestra.run.smithi106.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:26:35.677 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:26:35.677 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:26:35.677 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:26:35.677 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:26:35.677 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:26:35.677 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.677 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.677 INFO:teuthology.orchestra.run.smithi106.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:26:35.677 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:26:35.678 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:26:35.678 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.678 INFO:teuthology.orchestra.run.smithi106.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:26:35.678 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:26:35.678 INFO:teuthology.orchestra.run.smithi106.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:26:35.678 INFO:teuthology.orchestra.run.smithi106.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:26:35.678 INFO:teuthology.orchestra.run.smithi106.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:26:35.678 INFO:teuthology.orchestra.run.smithi106.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:26:35.678 INFO:teuthology.orchestra.run.smithi106.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:26:35.678 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:26:35.678 INFO:teuthology.orchestra.run.smithi106.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:26:35.678 INFO:teuthology.orchestra.run.smithi106.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:26:35.678 INFO:teuthology.orchestra.run.smithi106.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:26:35.679 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.679 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.679 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:35.679 INFO:teuthology.orchestra.run.smithi106.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:26:35.679 INFO:teuthology.orchestra.run.smithi106.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:26:35.679 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:26:35.679 INFO:teuthology.orchestra.run.smithi106.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:26:35.679 INFO:teuthology.orchestra.run.smithi106.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:26:35.679 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:35.679 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-08-17T02:26:35.761 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:26:35.761 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:26:35.761 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:26:35.761 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:26:35.761 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:26:35.761 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:26:35.762 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:26:35.762 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:26:35.762 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:26:35.762 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:26:35.762 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:26:35.762 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:26:35.762 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:26:35.762 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:26:35.762 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:26:35.762 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:26:35.762 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:26:35.762 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:26:35.762 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:26:35.763 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:26:35.763 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:26:35.763 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:26:35.763 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:26:35.763 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:26:35.763 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:26:35.763 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:26:35.773 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:26:35.774 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:26:35.774 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:26:35.774 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:26:35.774 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:26:35.774 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:26:35.774 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:26:35.774 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:26:35.774 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:26:35.774 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:26:35.774 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:26:35.775 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:26:35.775 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:26:35.775 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:26:35.775 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:26:35.775 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:26:35.775 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:26:35.775 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:26:35.775 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:26:35.775 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:26:35.775 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:26:35.775 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:26:35.775 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:26:35.775 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:26:35.776 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:26:35.776 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:26:35.776 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:26:35.776 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:26:35.776 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:26:35.776 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:26:35.776 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:26:35.776 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:26:35.776 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:26:35.776 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:26:35.776 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:26:35.776 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:26:35.776 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:26:35.777 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:26:35.777 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:26:35.777 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:26:35.777 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:26:35.777 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:26:35.777 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:26:35.777 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:26:35.777 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:26:35.777 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:26:35.777 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:26:35.777 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:26:35.777 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:26:35.777 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:26:35.777 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:26:35.778 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:26:35.778 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:26:35.778 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:26:35.778 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:26:35.778 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:26:35.778 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:26:35.778 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:26:35.778 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:26:35.778 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:26:35.778 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:26:35.778 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:26:35.778 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:26:35.778 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:26:35.779 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:26:35.779 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:26:35.779 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:26:35.779 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:26:35.779 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:26:35.779 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:26:35.779 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:26:35.779 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:26:35.779 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:26:35.779 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:26:35.779 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:26:35.779 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:26:35.779 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:26:35.779 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:26:35.780 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:26:35.780 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:26:35.780 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:26:35.780 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:26:35.780 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:26:35.780 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:26:35.780 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:26:35.780 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:26:35.780 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:26:35.780 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:26:35.780 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:26:35.780 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:26:35.780 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:26:35.780 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:26:35.780 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:26:35.781 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:26:35.781 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:26:35.781 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:26:35.781 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:26:35.781 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:26:35.781 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:26:35.781 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:26:35.781 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:26:35.781 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:26:35.781 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:26:35.781 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:26:35.781 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:26:35.781 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:26:35.782 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:26:35.782 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:26:35.782 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:26:35.782 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:26:35.782 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:26:35.782 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:26:35.782 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:26:35.782 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:26:35.782 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:26:35.782 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:26:35.782 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:26:35.782 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:26:36.334 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:38.006 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:26:38.006 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:38.006 INFO:teuthology.orchestra.run.smithi171.stdout:Upgraded: 2024-08-17T02:26:38.006 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:26:38.007 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:26:38.007 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:26:38.007 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:26:38.007 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:26:38.007 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:26:38.007 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:26:38.007 INFO:teuthology.orchestra.run.smithi171.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.007 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.007 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:26:38.007 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:26:38.007 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:26:38.007 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-08-17T02:26:38.007 INFO:teuthology.orchestra.run.smithi171.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:26:38.008 INFO:teuthology.orchestra.run.smithi171.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:26:38.008 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.008 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.008 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.008 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.008 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:38.008 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.008 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.008 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.008 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:38.008 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:38.008 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:38.008 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:38.008 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:38.009 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.009 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.009 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:38.009 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.009 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.009 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.009 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:38.009 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:38.009 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.009 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:26:38.009 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:26:38.009 INFO:teuthology.orchestra.run.smithi171.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:26:38.009 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:26:38.009 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:26:38.010 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:26:38.010 INFO:teuthology.orchestra.run.smithi171.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:26:38.010 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:26:38.010 INFO:teuthology.orchestra.run.smithi171.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:26:38.010 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.010 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.010 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.010 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:26:38.010 INFO:teuthology.orchestra.run.smithi171.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:26:38.010 INFO:teuthology.orchestra.run.smithi171.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:26:38.010 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:26:38.010 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:26:38.010 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.011 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.011 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:26:38.011 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.011 INFO:teuthology.orchestra.run.smithi171.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:26:38.011 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:26:38.011 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:26:38.011 INFO:teuthology.orchestra.run.smithi171.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:26:38.011 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:26:38.011 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:26:38.011 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:26:38.011 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:26:38.011 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:26:38.011 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:26:38.012 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:26:38.012 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:26:38.012 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.012 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.012 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.012 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:26:38.012 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:26:38.012 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:26:38.012 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:26:38.012 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:26:38.012 INFO:teuthology.orchestra.run.smithi171.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:26:38.012 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:26:38.012 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:26:38.013 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:26:38.013 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:26:38.013 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:26:38.013 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:26:38.013 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:26:38.013 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:26:38.013 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:26:38.013 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:26:38.013 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:26:38.013 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:26:38.013 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:26:38.013 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:26:38.013 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:26:38.013 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:26:38.014 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:26:38.014 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:26:38.014 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:26:38.014 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:26:38.014 INFO:teuthology.orchestra.run.smithi171.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:26:38.014 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:26:38.014 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:26:38.014 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:26:38.014 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:26:38.014 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:26:38.014 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:26:38.014 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:26:38.014 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:26:38.015 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:26:38.015 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.015 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.015 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:26:38.015 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:26:38.015 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:26:38.015 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.015 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:26:38.015 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:26:38.015 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:26:38.015 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:26:38.015 INFO:teuthology.orchestra.run.smithi171.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:26:38.015 INFO:teuthology.orchestra.run.smithi171.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:26:38.016 INFO:teuthology.orchestra.run.smithi171.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:26:38.016 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:26:38.016 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:26:38.016 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:26:38.016 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:26:38.016 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.016 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.016 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:26:38.016 INFO:teuthology.orchestra.run.smithi171.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:26:38.016 INFO:teuthology.orchestra.run.smithi171.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:26:38.016 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:26:38.016 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:26:38.017 INFO:teuthology.orchestra.run.smithi171.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:26:38.017 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:38.017 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-08-17T02:26:38.711 DEBUG:teuthology.parallel:result is None 2024-08-17T02:26:38.711 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:26:38.852 DEBUG:teuthology.orchestra.run.smithi106:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:26:38.900 INFO:teuthology.orchestra.run.smithi106.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:26:38.900 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:26:38.901 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:26:38.902 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:26:39.050 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:26:39.095 INFO:teuthology.orchestra.run.smithi171.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:26:39.096 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:26:39.096 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:26:39.098 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-17T02:26:39.099 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-17T02:26:39.099 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:26:39.158 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-17T02:26:39.158 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:26:39.216 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-17T02:26:39.216 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-17T02:26:39.217 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:26:39.272 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:26:39.390 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-17T02:26:39.390 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:26:39.447 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:26:39.544 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-17T02:26:39.545 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-17T02:26:39.545 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:26:39.599 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:26:39.695 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-17T02:26:39.696 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:26:39.752 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:26:39.849 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-17T02:26:39.849 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-17T02:26:39.849 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:26:39.904 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:26:40.000 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-17T02:26:40.000 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:26:40.063 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:26:40.161 INFO:teuthology.run_tasks:Running task ceph... 2024-08-17T02:26:40.235 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-17T02:26:40.236 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 777 /var/log/ceph 2024-08-17T02:26:40.240 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 777 /var/log/ceph 2024-08-17T02:26:40.302 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-17T02:26:40.302 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:26:40.306 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:26:40.363 INFO:tasks.ceph:Creating extra log directories... 2024-08-17T02:26:40.364 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:26:40.368 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:26:40.431 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-08-17T02:26:40.432 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-08-17T02:26:40.432 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-08-17T02:26:40.432 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-17T02:26:40.432 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:26:40.467 DEBUG:teuthology.orchestra.run.smithi106:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:40.633 DEBUG:teuthology.orchestra.run.smithi106:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:40.688 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-17T02:26:40.688 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:26:40.723 DEBUG:teuthology.orchestra.run.smithi171:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:40.894 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:40.956 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-17T02:26:40.956 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-17T02:26:40.956 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858282', 'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7858282', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 25, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5995, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'targets': {'smithi106.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO1Ta5zL3w7mLnP283c23abNRd/7DV9crWcVL8qxYpe+l9Ry8CT4sFm0uBwVup3bNfa6BtiYk11Lkxb+nPleO+8=', 'smithi171.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNhJ++dhQ+d+AIxfFaqSLzfV5bE9AW1EXBCBdn4fShNwx8M33Eg8n91yuPiIU5weAfvyBPAQRsSs9HOyrAIGBlY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '67db276914d29505c9707d04f3a3b8fb9d8aee4b', 'timestamp': '2024-08-17_01:10:27', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-17T02:26:40.957 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:26:40.960 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:26:40.996 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:26:41.036 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:26:41.099 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-17T02:26:41.099 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:26:41.134 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:26:41.134 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_1 2024-08-17T02:26:41.208 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:26:41.209 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:41.209 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 638 Links: 1 2024-08-17T02:26:41.209 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:41.209 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:26:41.209 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-08-17 02:26:29.011281919 +0000 2024-08-17T02:26:41.209 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-08-17 02:24:02.932431284 +0000 2024-08-17T02:26:41.209 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-08-17 02:24:02.932431284 +0000 2024-08-17T02:26:41.209 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-08-17 02:24:02.932431284 +0000 2024-08-17T02:26:41.209 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:26:41.302 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-08-17T02:26:41.302 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-08-17T02:26:41.302 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000283812 s, 1.8 MB/s 2024-08-17T02:26:41.304 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:26:41.341 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_2 2024-08-17T02:26:41.415 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:26:41.415 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:41.416 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 657 Links: 1 2024-08-17T02:26:41.416 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:41.416 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:26:41.416 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-08-17 02:26:29.012281895 +0000 2024-08-17T02:26:41.416 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-08-17 02:24:03.434419356 +0000 2024-08-17T02:26:41.416 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-08-17 02:24:03.434419356 +0000 2024-08-17T02:26:41.416 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-08-17 02:24:03.434419356 +0000 2024-08-17T02:26:41.416 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:26:41.509 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-08-17T02:26:41.509 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-08-17T02:26:41.509 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000291961 s, 1.8 MB/s 2024-08-17T02:26:41.512 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:26:41.548 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_3 2024-08-17T02:26:41.624 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:26:41.624 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:41.624 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 678 Links: 1 2024-08-17T02:26:41.624 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:41.624 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:26:41.624 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-08-17 02:26:29.012281895 +0000 2024-08-17T02:26:41.624 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-08-17 02:24:03.911408021 +0000 2024-08-17T02:26:41.624 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-08-17 02:24:03.911408021 +0000 2024-08-17T02:26:41.624 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-08-17 02:24:03.911408021 +0000 2024-08-17T02:26:41.625 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:26:41.716 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-08-17T02:26:41.716 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-08-17T02:26:41.716 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000267149 s, 1.9 MB/s 2024-08-17T02:26:41.719 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:26:41.754 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_4 2024-08-17T02:26:41.830 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:26:41.830 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:41.830 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 696 Links: 1 2024-08-17T02:26:41.830 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:41.830 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:26:41.830 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-08-17 02:26:29.013281872 +0000 2024-08-17T02:26:41.830 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-08-17 02:24:04.417395998 +0000 2024-08-17T02:26:41.830 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-08-17 02:24:04.417395998 +0000 2024-08-17T02:26:41.830 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-08-17 02:24:04.417395998 +0000 2024-08-17T02:26:41.831 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:26:41.922 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-08-17T02:26:41.922 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-08-17T02:26:41.922 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000335117 s, 1.5 MB/s 2024-08-17T02:26:41.924 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:26:41.960 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:41.960 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-17T02:26:41.960 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:26:41.996 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:26:41.996 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_1 2024-08-17T02:26:42.072 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:26:42.072 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:42.072 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-08-17T02:26:42.072 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:42.072 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:26:42.072 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-08-17 02:26:30.922353840 +0000 2024-08-17T02:26:42.072 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-08-17 02:24:05.633568233 +0000 2024-08-17T02:26:42.072 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-08-17 02:24:05.633568233 +0000 2024-08-17T02:26:42.072 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-08-17 02:24:05.633568233 +0000 2024-08-17T02:26:42.072 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:26:42.166 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-08-17T02:26:42.166 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-08-17T02:26:42.166 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000324842 s, 1.6 MB/s 2024-08-17T02:26:42.168 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:26:42.205 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_2 2024-08-17T02:26:42.281 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:26:42.281 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:42.282 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-08-17T02:26:42.282 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:42.282 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:26:42.282 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-08-17 02:26:30.923353821 +0000 2024-08-17T02:26:42.282 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-08-17 02:24:06.108559207 +0000 2024-08-17T02:26:42.282 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-08-17 02:24:06.108559207 +0000 2024-08-17T02:26:42.282 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-08-17 02:24:06.108559207 +0000 2024-08-17T02:26:42.282 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:26:42.375 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-08-17T02:26:42.375 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-08-17T02:26:42.375 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000261256 s, 2.0 MB/s 2024-08-17T02:26:42.378 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:26:42.414 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_3 2024-08-17T02:26:42.490 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:26:42.490 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:42.490 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-08-17T02:26:42.490 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:42.490 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:26:42.490 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-08-17 02:26:30.923353821 +0000 2024-08-17T02:26:42.490 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-08-17 02:24:06.557550675 +0000 2024-08-17T02:26:42.490 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-08-17 02:24:06.557550675 +0000 2024-08-17T02:26:42.490 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-08-17 02:24:06.557550675 +0000 2024-08-17T02:26:42.490 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:26:42.583 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-08-17T02:26:42.583 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-08-17T02:26:42.583 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000273204 s, 1.9 MB/s 2024-08-17T02:26:42.585 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:26:42.622 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_4 2024-08-17T02:26:42.697 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:26:42.697 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:26:42.697 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-08-17T02:26:42.697 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:26:42.697 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:26:42.697 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-08-17 02:26:30.924353802 +0000 2024-08-17T02:26:42.697 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-08-17 02:24:07.028541725 +0000 2024-08-17T02:26:42.697 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-08-17 02:24:07.028541725 +0000 2024-08-17T02:26:42.697 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-08-17 02:24:07.028541725 +0000 2024-08-17T02:26:42.698 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:26:42.791 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-08-17T02:26:42.791 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-08-17T02:26:42.791 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000298705 s, 1.7 MB/s 2024-08-17T02:26:42.793 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:26:42.829 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:42.830 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:26:42.830 INFO:tasks.ceph:Generating config... 2024-08-17T02:26:42.831 INFO:tasks.ceph:[client] client mount timeout = 600 2024-08-17T02:26:42.831 INFO:tasks.ceph:[client] debug client = 20 2024-08-17T02:26:42.831 INFO:tasks.ceph:[client] debug ms = 1 2024-08-17T02:26:42.831 INFO:tasks.ceph:[client] pid file = 2024-08-17T02:26:42.831 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-08-17T02:26:42.831 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-08-17T02:26:42.831 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-08-17T02:26:42.831 INFO:tasks.ceph:[mds] debug mds = 20 2024-08-17T02:26:42.832 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-08-17T02:26:42.832 INFO:tasks.ceph:[mds] debug ms = 1 2024-08-17T02:26:42.832 INFO:tasks.ceph:[mds] mds debug frag = True 2024-08-17T02:26:42.832 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-08-17T02:26:42.832 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-08-17T02:26:42.832 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-08-17T02:26:42.832 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-08-17T02:26:42.832 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-08-17T02:26:42.832 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-08-17T02:26:42.832 INFO:tasks.ceph:[mgr] debug client = 20 2024-08-17T02:26:42.832 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-08-17T02:26:42.832 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-17T02:26:42.832 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-17T02:26:42.832 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-17T02:26:42.833 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-17T02:26:42.833 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-17T02:26:42.833 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-08-17T02:26:42.833 INFO:tasks.ceph:[osd] bdev async discard = True 2024-08-17T02:26:42.833 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-08-17T02:26:42.833 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-08-17T02:26:42.833 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-17T02:26:42.833 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-17T02:26:42.833 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-08-17T02:26:42.833 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-08-17T02:26:42.833 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-17T02:26:42.833 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-17T02:26:42.833 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-08-17T02:26:42.833 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-17T02:26:42.834 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-17T02:26:42.834 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-17T02:26:42.834 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-17T02:26:42.834 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-17T02:26:42.834 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-08-17T02:26:42.834 INFO:tasks.ceph:Setting up mon.a... 2024-08-17T02:26:42.834 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-17T02:26:42.921 INFO:teuthology.orchestra.run.smithi106.stdout:creating /etc/ceph/ceph.keyring 2024-08-17T02:26:42.930 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-17T02:26:43.011 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:26:43.065 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.106'), ('mon.b', '172.21.15.171'), ('mon.c', '[v2:172.21.15.171:3301,v1:172.21.15.171:6790]')] 2024-08-17T02:26:43.066 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.106,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-08-17T02:26:43.067 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-17T02:26:43.067 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:26:43.102 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.106 --add b 172.21.15.171 --addv c '[v2:172.21.15.171:3301,v1:172.21.15.171:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:43.212 INFO:teuthology.orchestra.run.smithi106.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:43.212 INFO:teuthology.orchestra.run.smithi106.stdout:monmaptool: generated fsid 2c52f2d2-3c39-4be0-9e1a-50df01bd49c4 2024-08-17T02:26:43.212 INFO:teuthology.orchestra.run.smithi106.stdout:setting min_mon_release = octopus 2024-08-17T02:26:43.212 INFO:teuthology.orchestra.run.smithi106.stdout:epoch 0 2024-08-17T02:26:43.212 INFO:teuthology.orchestra.run.smithi106.stdout:fsid 2c52f2d2-3c39-4be0-9e1a-50df01bd49c4 2024-08-17T02:26:43.212 INFO:teuthology.orchestra.run.smithi106.stdout:last_changed 2024-08-17T02:26:43.212331+0000 2024-08-17T02:26:43.212 INFO:teuthology.orchestra.run.smithi106.stdout:created 2024-08-17T02:26:43.212331+0000 2024-08-17T02:26:43.212 INFO:teuthology.orchestra.run.smithi106.stdout:min_mon_release 15 (octopus) 2024-08-17T02:26:43.212 INFO:teuthology.orchestra.run.smithi106.stdout:election_strategy: 1 2024-08-17T02:26:43.212 INFO:teuthology.orchestra.run.smithi106.stdout:0: [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] mon.a 2024-08-17T02:26:43.212 INFO:teuthology.orchestra.run.smithi106.stdout:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-08-17T02:26:43.213 INFO:teuthology.orchestra.run.smithi106.stdout:2: [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] mon.c 2024-08-17T02:26:43.213 INFO:teuthology.orchestra.run.smithi106.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-17T02:26:43.214 DEBUG:teuthology.orchestra.run.smithi106:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:26:43.248 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2c52f2d2-3c39-4be0-9e1a-50df01bd49c4... 2024-08-17T02:26:43.249 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:26:43.292 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:26:43.385 INFO:teuthology.orchestra.run.smithi106.stdout:[global] 2024-08-17T02:26:43.385 INFO:teuthology.orchestra.run.smithi106.stdout: chdir = "" 2024-08-17T02:26:43.385 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:26:43.385 INFO:teuthology.orchestra.run.smithi106.stdout: auth supported = cephx 2024-08-17T02:26:43.385 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.386 INFO:teuthology.orchestra.run.smithi106.stdout: filestore xattr use omap = true 2024-08-17T02:26:43.386 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.386 INFO:teuthology.orchestra.run.smithi106.stdout: mon clock drift allowed = 1.000 2024-08-17T02:26:43.386 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.386 INFO:teuthology.orchestra.run.smithi106.stdout: osd crush chooseleaf type = 0 2024-08-17T02:26:43.386 INFO:teuthology.orchestra.run.smithi106.stdout: auth debug = true 2024-08-17T02:26:43.386 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.386 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on old message = true 2024-08-17T02:26:43.386 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on bug = true 2024-08-17T02:26:43.386 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.386 INFO:teuthology.orchestra.run.smithi106.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:26:43.386 INFO:teuthology.orchestra.run.smithi106.stdout: mon pg warn max object skew = 0 2024-08-17T02:26:43.387 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.387 INFO:teuthology.orchestra.run.smithi106.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:26:43.387 INFO:teuthology.orchestra.run.smithi106.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:26:43.387 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.387 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default size = 2 2024-08-17T02:26:43.387 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.387 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow primary affinity = true 2024-08-17T02:26:43.387 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow pg remap = true 2024-08-17T02:26:43.387 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:26:43.387 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:26:43.387 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on no sortbitwise = false 2024-08-17T02:26:43.387 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:26:43.387 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on too few osds = false 2024-08-17T02:26:43.387 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:26:43.387 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:26:43.388 INFO:teuthology.orchestra.run.smithi106.stdout: mon_allow_pool_size_one = true 2024-08-17T02:26:43.388 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.388 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:26:43.388 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.388 INFO:teuthology.orchestra.run.smithi106.stdout: osd default data pool replay window = 5 2024-08-17T02:26:43.388 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.388 INFO:teuthology.orchestra.run.smithi106.stdout: mon allow pool delete = true 2024-08-17T02:26:43.388 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.388 INFO:teuthology.orchestra.run.smithi106.stdout: mon cluster log file level = debug 2024-08-17T02:26:43.388 INFO:teuthology.orchestra.run.smithi106.stdout: debug asserts on shutdown = true 2024-08-17T02:26:43.388 INFO:teuthology.orchestra.run.smithi106.stdout: mon health detail to clog = false 2024-08-17T02:26:43.388 INFO:teuthology.orchestra.run.smithi106.stdout: mon host = "172.21.15.106,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]" 2024-08-17T02:26:43.388 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on skipped message = False 2024-08-17T02:26:43.389 INFO:teuthology.orchestra.run.smithi106.stdout: fsid = 2c52f2d2-3c39-4be0-9e1a-50df01bd49c4 2024-08-17T02:26:43.389 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.389 INFO:teuthology.orchestra.run.smithi106.stdout:[osd] 2024-08-17T02:26:43.389 INFO:teuthology.orchestra.run.smithi106.stdout: osd journal size = 100 2024-08-17T02:26:43.389 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.389 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub load threshold = 5.0 2024-08-17T02:26:43.389 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub max interval = 600 2024-08-17T02:26:43.389 INFO:teuthology.orchestra.run.smithi106.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:26:43.389 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.389 INFO:teuthology.orchestra.run.smithi106.stdout: osd recover clone overlap = true 2024-08-17T02:26:43.389 INFO:teuthology.orchestra.run.smithi106.stdout: osd recovery max chunk = 1048576 2024-08-17T02:26:43.389 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.389 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug shutdown = true 2024-08-17T02:26:43.389 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug op order = true 2024-08-17T02:26:43.390 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify stray on activate = true 2024-08-17T02:26:43.390 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.390 INFO:teuthology.orchestra.run.smithi106.stdout: osd open classes on start = true 2024-08-17T02:26:43.390 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug pg log writeout = true 2024-08-17T02:26:43.390 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.390 INFO:teuthology.orchestra.run.smithi106.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:26:43.390 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.390 INFO:teuthology.orchestra.run.smithi106.stdout: osd map max advance = 10 2024-08-17T02:26:43.390 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.390 INFO:teuthology.orchestra.run.smithi106.stdout: journal zero on create = true 2024-08-17T02:26:43.390 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.390 INFO:teuthology.orchestra.run.smithi106.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:26:43.390 INFO:teuthology.orchestra.run.smithi106.stdout: filestore apply finisher threads = 3 2024-08-17T02:26:43.391 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.391 INFO:teuthology.orchestra.run.smithi106.stdout: bdev debug aio = true 2024-08-17T02:26:43.391 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug misdirected ops = true 2024-08-17T02:26:43.391 INFO:teuthology.orchestra.run.smithi106.stdout: bdev async discard = True 2024-08-17T02:26:43.391 INFO:teuthology.orchestra.run.smithi106.stdout: bdev enable discard = True 2024-08-17T02:26:43.391 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore allocator = bitmap 2024-08-17T02:26:43.391 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore block size = 96636764160 2024-08-17T02:26:43.391 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore fsck on mount = True 2024-08-17T02:26:43.391 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluefs = 1/20 2024-08-17T02:26:43.391 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluestore = 1/20 2024-08-17T02:26:43.391 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-08-17T02:26:43.391 INFO:teuthology.orchestra.run.smithi106.stdout: debug osd = 20 2024-08-17T02:26:43.391 INFO:teuthology.orchestra.run.smithi106.stdout: debug rocksdb = 4/10 2024-08-17T02:26:43.391 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:26:43.392 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd full ratio = 0.9 2024-08-17T02:26:43.392 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:26:43.392 INFO:teuthology.orchestra.run.smithi106.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:26:43.392 INFO:teuthology.orchestra.run.smithi106.stdout: osd objectstore = bluestore 2024-08-17T02:26:43.392 INFO:teuthology.orchestra.run.smithi106.stdout: osd op complaint time = 180 2024-08-17T02:26:43.392 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.392 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr] 2024-08-17T02:26:43.392 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-08-17T02:26:43.392 INFO:teuthology.orchestra.run.smithi106.stdout: debug mgr = 20 2024-08-17T02:26:43.392 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2024-08-17T02:26:43.392 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2024-08-17T02:26:43.392 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:26:43.392 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:26:43.392 INFO:teuthology.orchestra.run.smithi106.stdout: mgr/telemetry/nag = false 2024-08-17T02:26:43.393 INFO:teuthology.orchestra.run.smithi106.stdout: debug client = 20 2024-08-17T02:26:43.393 INFO:teuthology.orchestra.run.smithi106.stdout: debug finisher = 20 2024-08-17T02:26:43.393 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.393 INFO:teuthology.orchestra.run.smithi106.stdout:[mon] 2024-08-17T02:26:43.393 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-08-17T02:26:43.393 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2024-08-17T02:26:43.393 INFO:teuthology.orchestra.run.smithi106.stdout: debug paxos = 20 2024-08-17T02:26:43.393 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2024-08-17T02:26:43.393 INFO:teuthology.orchestra.run.smithi106.stdout: mon data avail warn = 5 2024-08-17T02:26:43.393 INFO:teuthology.orchestra.run.smithi106.stdout: mon mgr mkfs grace = 240 2024-08-17T02:26:43.393 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:26:43.393 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd reporter subtree level = osd 2024-08-17T02:26:43.393 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd prime pg temp = true 2024-08-17T02:26:43.393 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:26:43.394 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.394 INFO:teuthology.orchestra.run.smithi106.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:26:43.394 INFO:teuthology.orchestra.run.smithi106.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:26:43.394 INFO:teuthology.orchestra.run.smithi106.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:26:43.394 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.394 INFO:teuthology.orchestra.run.smithi106.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:26:43.394 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:26:43.394 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:26:43.394 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.394 INFO:teuthology.orchestra.run.smithi106.stdout: # 1m isn't quite enough 2024-08-17T02:26:43.394 INFO:teuthology.orchestra.run.smithi106.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:26:43.394 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.394 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:26:43.395 INFO:teuthology.orchestra.run.smithi106.stdout: mon op complaint time = 120 2024-08-17T02:26:43.395 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:26:43.395 INFO:teuthology.orchestra.run.smithi106.stdout:[client] 2024-08-17T02:26:43.395 INFO:teuthology.orchestra.run.smithi106.stdout: rgw cache enabled = true 2024-08-17T02:26:43.395 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable ops log = true 2024-08-17T02:26:43.395 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable usage log = true 2024-08-17T02:26:43.395 INFO:teuthology.orchestra.run.smithi106.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:26:43.395 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:26:43.395 INFO:teuthology.orchestra.run.smithi106.stdout: client mount timeout = 600 2024-08-17T02:26:43.395 INFO:teuthology.orchestra.run.smithi106.stdout: debug client = 20 2024-08-17T02:26:43.395 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-08-17T02:26:43.395 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = "" 2024-08-17T02:26:43.395 INFO:teuthology.orchestra.run.smithi106.stdout: rados mon op timeout = 900 2024-08-17T02:26:43.395 INFO:teuthology.orchestra.run.smithi106.stdout: rados osd op timeout = 900 2024-08-17T02:26:43.396 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.a] 2024-08-17T02:26:43.396 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.b] 2024-08-17T02:26:43.396 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.c] 2024-08-17T02:26:43.396 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.a] 2024-08-17T02:26:43.396 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.c] 2024-08-17T02:26:43.396 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.b] 2024-08-17T02:26:43.396 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.d] 2024-08-17T02:26:43.396 INFO:teuthology.orchestra.run.smithi106.stdout:[mds] 2024-08-17T02:26:43.396 INFO:teuthology.orchestra.run.smithi106.stdout: debug mds = 20 2024-08-17T02:26:43.396 INFO:teuthology.orchestra.run.smithi106.stdout: debug mds balancer = 20 2024-08-17T02:26:43.396 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-08-17T02:26:43.396 INFO:teuthology.orchestra.run.smithi106.stdout: mds debug frag = True 2024-08-17T02:26:43.396 INFO:teuthology.orchestra.run.smithi106.stdout: mds debug scatterstat = True 2024-08-17T02:26:43.396 INFO:teuthology.orchestra.run.smithi106.stdout: mds op complaint time = 180 2024-08-17T02:26:43.396 INFO:teuthology.orchestra.run.smithi106.stdout: mds verify scatter = True 2024-08-17T02:26:43.396 INFO:teuthology.orchestra.run.smithi106.stdout: osd op complaint time = 180 2024-08-17T02:26:43.397 INFO:teuthology.orchestra.run.smithi106.stdout: rados mon op timeout = 900 2024-08-17T02:26:43.397 INFO:teuthology.orchestra.run.smithi106.stdout: rados osd op timeout = 900 2024-08-17T02:26:43.397 INFO:teuthology.orchestra.run.smithi171.stdout:[global] 2024-08-17T02:26:43.397 INFO:teuthology.orchestra.run.smithi171.stdout: chdir = "" 2024-08-17T02:26:43.397 INFO:teuthology.orchestra.run.smithi171.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:26:43.397 INFO:teuthology.orchestra.run.smithi171.stdout: auth supported = cephx 2024-08-17T02:26:43.397 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.397 INFO:teuthology.orchestra.run.smithi171.stdout: filestore xattr use omap = true 2024-08-17T02:26:43.398 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.398 INFO:teuthology.orchestra.run.smithi171.stdout: mon clock drift allowed = 1.000 2024-08-17T02:26:43.398 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.398 INFO:teuthology.orchestra.run.smithi171.stdout: osd crush chooseleaf type = 0 2024-08-17T02:26:43.398 INFO:teuthology.orchestra.run.smithi171.stdout: auth debug = true 2024-08-17T02:26:43.398 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.398 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on old message = true 2024-08-17T02:26:43.398 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on bug = true 2024-08-17T02:26:43.398 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.398 INFO:teuthology.orchestra.run.smithi171.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:26:43.398 INFO:teuthology.orchestra.run.smithi171.stdout: mon pg warn max object skew = 0 2024-08-17T02:26:43.398 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.398 INFO:teuthology.orchestra.run.smithi171.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:26:43.398 INFO:teuthology.orchestra.run.smithi171.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:26:43.399 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.399 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default size = 2 2024-08-17T02:26:43.399 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.399 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow primary affinity = true 2024-08-17T02:26:43.399 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow pg remap = true 2024-08-17T02:26:43.399 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:26:43.399 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:26:43.399 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on no sortbitwise = false 2024-08-17T02:26:43.399 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:26:43.399 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on too few osds = false 2024-08-17T02:26:43.399 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:26:43.399 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:26:43.399 INFO:teuthology.orchestra.run.smithi171.stdout: mon_allow_pool_size_one = true 2024-08-17T02:26:43.400 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.400 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:26:43.400 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.400 INFO:teuthology.orchestra.run.smithi171.stdout: osd default data pool replay window = 5 2024-08-17T02:26:43.400 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.400 INFO:teuthology.orchestra.run.smithi171.stdout: mon allow pool delete = true 2024-08-17T02:26:43.400 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.400 INFO:teuthology.orchestra.run.smithi171.stdout: mon cluster log file level = debug 2024-08-17T02:26:43.400 INFO:teuthology.orchestra.run.smithi171.stdout: debug asserts on shutdown = true 2024-08-17T02:26:43.400 INFO:teuthology.orchestra.run.smithi171.stdout: mon health detail to clog = false 2024-08-17T02:26:43.400 INFO:teuthology.orchestra.run.smithi171.stdout: mon host = "172.21.15.106,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]" 2024-08-17T02:26:43.400 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on skipped message = False 2024-08-17T02:26:43.400 INFO:teuthology.orchestra.run.smithi171.stdout: fsid = 2c52f2d2-3c39-4be0-9e1a-50df01bd49c4 2024-08-17T02:26:43.400 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.401 INFO:teuthology.orchestra.run.smithi171.stdout:[osd] 2024-08-17T02:26:43.401 INFO:teuthology.orchestra.run.smithi171.stdout: osd journal size = 100 2024-08-17T02:26:43.401 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.401 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub load threshold = 5.0 2024-08-17T02:26:43.401 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub max interval = 600 2024-08-17T02:26:43.401 INFO:teuthology.orchestra.run.smithi171.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:26:43.401 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.401 INFO:teuthology.orchestra.run.smithi171.stdout: osd recover clone overlap = true 2024-08-17T02:26:43.401 INFO:teuthology.orchestra.run.smithi171.stdout: osd recovery max chunk = 1048576 2024-08-17T02:26:43.401 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.401 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug shutdown = true 2024-08-17T02:26:43.401 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug op order = true 2024-08-17T02:26:43.401 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug verify stray on activate = true 2024-08-17T02:26:43.401 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.402 INFO:teuthology.orchestra.run.smithi171.stdout: osd open classes on start = true 2024-08-17T02:26:43.402 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug pg log writeout = true 2024-08-17T02:26:43.402 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.402 INFO:teuthology.orchestra.run.smithi171.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:26:43.402 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.402 INFO:teuthology.orchestra.run.smithi171.stdout: osd map max advance = 10 2024-08-17T02:26:43.402 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.402 INFO:teuthology.orchestra.run.smithi171.stdout: journal zero on create = true 2024-08-17T02:26:43.402 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.402 INFO:teuthology.orchestra.run.smithi171.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:26:43.403 INFO:teuthology.orchestra.run.smithi171.stdout: filestore apply finisher threads = 3 2024-08-17T02:26:43.403 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.403 INFO:teuthology.orchestra.run.smithi171.stdout: bdev debug aio = true 2024-08-17T02:26:43.403 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug misdirected ops = true 2024-08-17T02:26:43.403 INFO:teuthology.orchestra.run.smithi171.stdout: bdev async discard = True 2024-08-17T02:26:43.403 INFO:teuthology.orchestra.run.smithi171.stdout: bdev enable discard = True 2024-08-17T02:26:43.403 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore allocator = bitmap 2024-08-17T02:26:43.403 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore block size = 96636764160 2024-08-17T02:26:43.403 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore fsck on mount = True 2024-08-17T02:26:43.403 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluefs = 1/20 2024-08-17T02:26:43.403 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluestore = 1/20 2024-08-17T02:26:43.403 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-08-17T02:26:43.403 INFO:teuthology.orchestra.run.smithi171.stdout: debug osd = 20 2024-08-17T02:26:43.404 INFO:teuthology.orchestra.run.smithi171.stdout: debug rocksdb = 4/10 2024-08-17T02:26:43.404 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:26:43.404 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd full ratio = 0.9 2024-08-17T02:26:43.404 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:26:43.404 INFO:teuthology.orchestra.run.smithi171.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:26:43.404 INFO:teuthology.orchestra.run.smithi171.stdout: osd objectstore = bluestore 2024-08-17T02:26:43.404 INFO:teuthology.orchestra.run.smithi171.stdout: osd op complaint time = 180 2024-08-17T02:26:43.404 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.404 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr] 2024-08-17T02:26:43.404 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-08-17T02:26:43.404 INFO:teuthology.orchestra.run.smithi171.stdout: debug mgr = 20 2024-08-17T02:26:43.404 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-08-17T02:26:43.404 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-08-17T02:26:43.404 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:26:43.405 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:26:43.405 INFO:teuthology.orchestra.run.smithi171.stdout: mgr/telemetry/nag = false 2024-08-17T02:26:43.405 INFO:teuthology.orchestra.run.smithi171.stdout: debug client = 20 2024-08-17T02:26:43.405 INFO:teuthology.orchestra.run.smithi171.stdout: debug finisher = 20 2024-08-17T02:26:43.405 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.405 INFO:teuthology.orchestra.run.smithi171.stdout:[mon] 2024-08-17T02:26:43.405 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-08-17T02:26:43.405 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-08-17T02:26:43.405 INFO:teuthology.orchestra.run.smithi171.stdout: debug paxos = 20 2024-08-17T02:26:43.405 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-08-17T02:26:43.405 INFO:teuthology.orchestra.run.smithi171.stdout: mon data avail warn = 5 2024-08-17T02:26:43.405 INFO:teuthology.orchestra.run.smithi171.stdout: mon mgr mkfs grace = 240 2024-08-17T02:26:43.405 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:26:43.405 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd reporter subtree level = osd 2024-08-17T02:26:43.406 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd prime pg temp = true 2024-08-17T02:26:43.406 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:26:43.406 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.406 INFO:teuthology.orchestra.run.smithi171.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:26:43.406 INFO:teuthology.orchestra.run.smithi171.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:26:43.406 INFO:teuthology.orchestra.run.smithi171.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:26:43.406 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.406 INFO:teuthology.orchestra.run.smithi171.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:26:43.406 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:26:43.406 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:26:43.406 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.406 INFO:teuthology.orchestra.run.smithi171.stdout: # 1m isn't quite enough 2024-08-17T02:26:43.406 INFO:teuthology.orchestra.run.smithi171.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:26:43.406 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.407 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:26:43.407 INFO:teuthology.orchestra.run.smithi171.stdout: mon op complaint time = 120 2024-08-17T02:26:43.407 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-08-17T02:26:43.407 INFO:teuthology.orchestra.run.smithi171.stdout:[client] 2024-08-17T02:26:43.407 INFO:teuthology.orchestra.run.smithi171.stdout: rgw cache enabled = true 2024-08-17T02:26:43.407 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable ops log = true 2024-08-17T02:26:43.407 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable usage log = true 2024-08-17T02:26:43.407 INFO:teuthology.orchestra.run.smithi171.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:26:43.407 INFO:teuthology.orchestra.run.smithi171.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:26:43.407 INFO:teuthology.orchestra.run.smithi171.stdout: client mount timeout = 600 2024-08-17T02:26:43.407 INFO:teuthology.orchestra.run.smithi171.stdout: debug client = 20 2024-08-17T02:26:43.407 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-08-17T02:26:43.407 INFO:teuthology.orchestra.run.smithi171.stdout: pid file = "" 2024-08-17T02:26:43.407 INFO:teuthology.orchestra.run.smithi171.stdout: rados mon op timeout = 900 2024-08-17T02:26:43.408 INFO:teuthology.orchestra.run.smithi171.stdout: rados osd op timeout = 900 2024-08-17T02:26:43.408 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.a] 2024-08-17T02:26:43.408 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.b] 2024-08-17T02:26:43.408 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.c] 2024-08-17T02:26:43.408 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.a] 2024-08-17T02:26:43.408 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.c] 2024-08-17T02:26:43.408 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.b] 2024-08-17T02:26:43.408 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.d] 2024-08-17T02:26:43.408 INFO:teuthology.orchestra.run.smithi171.stdout:[mds] 2024-08-17T02:26:43.408 INFO:teuthology.orchestra.run.smithi171.stdout: debug mds = 20 2024-08-17T02:26:43.408 INFO:teuthology.orchestra.run.smithi171.stdout: debug mds balancer = 20 2024-08-17T02:26:43.408 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-08-17T02:26:43.408 INFO:teuthology.orchestra.run.smithi171.stdout: mds debug frag = True 2024-08-17T02:26:43.408 INFO:teuthology.orchestra.run.smithi171.stdout: mds debug scatterstat = True 2024-08-17T02:26:43.409 INFO:teuthology.orchestra.run.smithi171.stdout: mds op complaint time = 180 2024-08-17T02:26:43.409 INFO:teuthology.orchestra.run.smithi171.stdout: mds verify scatter = True 2024-08-17T02:26:43.409 INFO:teuthology.orchestra.run.smithi171.stdout: osd op complaint time = 180 2024-08-17T02:26:43.409 INFO:teuthology.orchestra.run.smithi171.stdout: rados mon op timeout = 900 2024-08-17T02:26:43.409 INFO:teuthology.orchestra.run.smithi171.stdout: rados osd op timeout = 900 2024-08-17T02:26:43.415 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-17T02:26:43.416 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-17T02:26:43.505 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-17T02:26:43.505 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-17T02:26:43.506 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-17T02:26:43.540 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-17T02:26:43.540 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-17T02:26:43.615 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi106.front.sepia.ceph.com 2024-08-17T02:26:43.615 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-17T02:26:43.615 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:26:43.615 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:26:43.733 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-17T02:26:43.733 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:43.808 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi171.front.sepia.ceph.com 2024-08-17T02:26:43.808 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-17T02:26:43.808 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:26:43.808 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:26:43.887 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-17T02:26:43.887 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:43.963 INFO:tasks.ceph:Setting up mon nodes... 2024-08-17T02:26:43.963 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-17T02:26:43.963 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:26:44.061 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:26:44.066 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:26:44.182 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:26:44.188 INFO:tasks.ceph:Setting up mds nodes... 2024-08-17T02:26:44.188 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:26:44.285 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:26:44.289 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-08-17T02:26:44.345 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:26:44.442 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:26:44.447 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-08-17T02:26:44.502 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:26:44.600 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:26:44.605 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-08-17T02:26:44.660 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:26:44.758 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:26:44.762 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-08-17T02:26:44.818 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-17T02:26:44.819 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-17T02:26:44.898 INFO:teuthology.orchestra.run.smithi106.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-17T02:26:44.922 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-08-17T02:26:44.996 INFO:teuthology.orchestra.run.smithi106.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-08-17T02:26:45.022 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-17T02:26:45.099 INFO:teuthology.orchestra.run.smithi171.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-08-17T02:26:45.126 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-08-17T02:26:45.201 INFO:teuthology.orchestra.run.smithi171.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-08-17T02:26:45.228 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-17T02:26:45.228 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:26:45.228 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-17T02:26:45.283 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:45.283 INFO:tasks.ceph:role: osd.0 2024-08-17T02:26:45.283 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com 2024-08-17T02:26:45.284 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:26:45.346 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:26:45.346 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:26:45.346 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:26:45.346 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:26:45.346 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:26:45.346 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:26:45.346 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:26:45.346 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:26:45.346 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:26:45.347 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:26:45.757 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-08-17T02:26:45.761 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-08-17T02:26:45.761 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-17T02:26:45.890 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-17T02:26:45.955 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-17T02:26:46.010 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:46.010 INFO:tasks.ceph:role: osd.1 2024-08-17T02:26:46.010 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com 2024-08-17T02:26:46.010 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:26:46.073 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:26:46.074 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:26:46.074 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:26:46.074 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:26:46.074 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:26:46.074 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:26:46.074 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:26:46.074 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:26:46.074 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:26:46.074 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:26:46.431 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-08-17T02:26:46.436 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-08-17T02:26:46.436 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-17T02:26:46.524 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-17T02:26:46.589 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-17T02:26:46.647 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:46.647 INFO:tasks.ceph:role: osd.2 2024-08-17T02:26:46.647 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com 2024-08-17T02:26:46.648 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:26:46.711 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:26:46.711 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:26:46.712 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:26:46.712 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:26:46.712 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:26:46.712 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:26:46.712 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:26:46.712 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:26:46.712 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:26:46.712 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:26:47.101 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-08-17T02:26:47.105 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-08-17T02:26:47.105 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-17T02:26:47.213 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-17T02:26:47.277 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-17T02:26:47.332 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:26:47.332 INFO:tasks.ceph:role: osd.3 2024-08-17T02:26:47.333 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi106.front.sepia.ceph.com 2024-08-17T02:26:47.333 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:26:47.395 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:26:47.395 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:26:47.395 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:26:47.395 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:26:47.395 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:26:47.395 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:26:47.395 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:26:47.396 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:26:47.396 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:26:47.396 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:26:47.816 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-08-17T02:26:47.820 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-08-17T02:26:47.820 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-17T02:26:47.953 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-17T02:26:48.017 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:48.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:48.121+0000 7f49713242c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-17T02:26:48.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:48.126+0000 7f49713242c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-17T02:26:48.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:48.126+0000 7f49713242c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:26:48.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:48.126+0000 7f49713242c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:26:48.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:48.126+0000 7f49713242c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:26:48.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:48.135+0000 7f49713242c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-17T02:26:48.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:48.679+0000 7f49713242c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:49.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:49.451+0000 7f49713242c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:50.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:50.222+0000 7f49713242c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:51.049 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-17T02:26:51.106 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:51.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:51.188+0000 7feefc04f2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-17T02:26:51.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:51.188+0000 7feefc04f2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-17T02:26:51.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:51.188+0000 7feefc04f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:26:51.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:51.188+0000 7feefc04f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:26:51.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:51.188+0000 7feefc04f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:26:51.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:51.190+0000 7feefc04f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-17T02:26:51.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:51.725+0000 7feefc04f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:52.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:52.496+0000 7feefc04f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:53.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:53.271+0000 7feefc04f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:54.097 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-17T02:26:54.153 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:54.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:54.236+0000 7fbb5eb662c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-17T02:26:54.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:54.237+0000 7fbb5eb662c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-17T02:26:54.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:54.237+0000 7fbb5eb662c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:26:54.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:54.237+0000 7fbb5eb662c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:26:54.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:54.237+0000 7fbb5eb662c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:26:54.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:54.239+0000 7fbb5eb662c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-17T02:26:54.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:54.784+0000 7fbb5eb662c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:55.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:55.555+0000 7fbb5eb662c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:56.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:56.334+0000 7fbb5eb662c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:57.155 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-17T02:26:57.211 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:26:57.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:57.293+0000 7f04bb85a2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-17T02:26:57.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:57.294+0000 7f04bb85a2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-17T02:26:57.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:57.294+0000 7f04bb85a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:26:57.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:57.294+0000 7f04bb85a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:26:57.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:57.294+0000 7f04bb85a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:26:57.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:57.296+0000 7f04bb85a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-17T02:26:57.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:57.845+0000 7f04bb85a2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:58.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:58.616+0000 7f04bb85a2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:26:59.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:26:59.392+0000 7f04bb85a2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:00.228 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-17T02:27:00.285 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-17T02:27:00.347 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:27:00.347 INFO:tasks.ceph:role: osd.4 2024-08-17T02:27:00.347 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com 2024-08-17T02:27:00.347 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:27:00.412 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:27:00.412 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:27:00.412 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:27:00.412 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:27:00.412 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:27:00.412 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:27:00.412 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:27:00.412 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:27:00.412 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:27:00.412 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:27:00.813 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-08-17T02:27:00.817 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-08-17T02:27:00.817 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-17T02:27:00.948 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-17T02:27:01.013 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-17T02:27:01.069 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:27:01.070 INFO:tasks.ceph:role: osd.5 2024-08-17T02:27:01.070 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com 2024-08-17T02:27:01.070 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:27:01.133 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:27:01.133 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:27:01.133 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:27:01.133 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:27:01.134 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:27:01.134 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:27:01.134 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:27:01.134 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:27:01.134 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:27:01.134 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:27:01.488 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-08-17T02:27:01.492 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-08-17T02:27:01.493 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-17T02:27:01.579 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-17T02:27:01.645 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-17T02:27:01.700 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:27:01.700 INFO:tasks.ceph:role: osd.6 2024-08-17T02:27:01.700 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com 2024-08-17T02:27:01.701 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:27:01.763 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:27:01.763 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:27:01.763 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:27:01.763 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:27:01.763 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:27:01.763 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:27:01.763 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:27:01.763 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:27:01.763 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:27:01.764 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:27:02.149 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-08-17T02:27:02.153 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-08-17T02:27:02.153 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-17T02:27:02.247 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-17T02:27:02.310 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-17T02:27:02.366 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:27:02.366 INFO:tasks.ceph:role: osd.7 2024-08-17T02:27:02.367 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi171.front.sepia.ceph.com 2024-08-17T02:27:02.367 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:27:02.430 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:27:02.430 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:27:02.430 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:27:02.430 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:27:02.430 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:27:02.430 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:27:02.430 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:27:02.431 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:27:02.431 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:27:02.431 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:27:02.854 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-08-17T02:27:02.858 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-08-17T02:27:02.858 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-17T02:27:02.988 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-17T02:27:03.051 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:27:03.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:03.150+0000 7f6ce151d2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-17T02:27:03.155 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:03.154+0000 7f6ce151d2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-17T02:27:03.155 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:03.154+0000 7f6ce151d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:27:03.155 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:03.154+0000 7f6ce151d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:27:03.155 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:03.154+0000 7f6ce151d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:27:03.161 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:03.161+0000 7f6ce151d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-17T02:27:03.715 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:03.714+0000 7f6ce151d2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:04.502 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:04.501+0000 7f6ce151d2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:05.274 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:05.274+0000 7f6ce151d2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:06.109 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-17T02:27:06.169 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:27:06.254 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:06.254+0000 7f763572b2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-17T02:27:06.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:06.254+0000 7f763572b2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-17T02:27:06.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:06.254+0000 7f763572b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:27:06.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:06.254+0000 7f763572b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:27:06.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:06.254+0000 7f763572b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:27:06.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:06.256+0000 7f763572b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-17T02:27:06.793 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:06.793+0000 7f763572b2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:07.562 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:07.562+0000 7f763572b2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:08.333 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:08.333+0000 7f763572b2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:09.156 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-17T02:27:09.214 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:27:09.299 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:09.298+0000 7f96014322c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-17T02:27:09.299 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:09.298+0000 7f96014322c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-17T02:27:09.299 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:09.298+0000 7f96014322c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:27:09.299 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:09.298+0000 7f96014322c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:27:09.299 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:09.298+0000 7f96014322c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:27:09.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:09.300+0000 7f96014322c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-17T02:27:09.846 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:09.845+0000 7f96014322c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:10.621 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:10.620+0000 7f96014322c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:10.957 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:10.962 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:11.389 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:11.389+0000 7f96014322c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:12.231 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-17T02:27:12.287 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:27:12.371 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:12.371+0000 7f34db5232c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-17T02:27:12.372 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:12.371+0000 7f34db5232c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-17T02:27:12.372 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:12.371+0000 7f34db5232c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:27:12.372 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:12.372+0000 7f34db5232c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:27:12.372 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:12.372+0000 7f34db5232c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:27:12.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:12.373+0000 7f34db5232c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-17T02:27:12.919 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:12.918+0000 7f34db5232c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:13.683 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:13.683+0000 7f34db5232c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:14.451 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:14.451+0000 7f34db5232c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:27:15.289 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-17T02:27:15.346 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-17T02:27:15.346 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-17T02:27:15.346 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-17T02:27:15.410 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-17T02:27:15.410 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-08-17T02:27:15.510 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-17T02:27:15.510 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-08-17T02:27:15.607 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-17T02:27:15.608 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-17T02:27:15.703 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-17T02:27:15.703 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-17T02:27:15.798 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-17T02:27:15.798 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-17T02:27:15.893 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-17T02:27:15.893 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-17T02:27:15.988 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-17T02:27:15.988 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-17T02:27:16.045 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-17T02:27:16.045 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-08-17T02:27:16.140 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-17T02:27:16.140 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-08-17T02:27:16.235 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-17T02:27:16.236 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-17T02:27:16.330 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-17T02:27:16.330 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-17T02:27:16.426 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-17T02:27:16.426 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-17T02:27:16.523 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-17T02:27:16.523 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-17T02:27:16.618 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-17T02:27:16.619 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-17T02:27:16.655 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-17T02:27:16.655 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-08-17T02:27:16.730 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-17T02:27:16.731 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-08-17T02:27:16.765 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-17T02:27:16.766 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-08-17T02:27:16.840 INFO:tasks.ceph:Adding keys to all mons... 2024-08-17T02:27:16.841 DEBUG:teuthology.orchestra.run.smithi106:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:27:16.844 DEBUG:teuthology.orchestra.run.smithi171:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:27:16.893 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr.y] 2024-08-17T02:27:16.893 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBkCsBmNHSqAxAA1jOfB2dHKJrNPHKIkkSYHw== 2024-08-17T02:27:16.893 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.a] 2024-08-17T02:27:16.894 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBkCsBmbGwOERAATJC64Ew1XkVO3YnIq+uWJQ== 2024-08-17T02:27:16.894 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.c] 2024-08-17T02:27:16.894 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBkCsBmOuJrGhAA+B1a9Hl6H5MF0iuHuQG9FA== 2024-08-17T02:27:16.894 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.0] 2024-08-17T02:27:16.894 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBoCsBmZxNTBxAAh7l7LkeEACf8iaQ1nEi8CQ== 2024-08-17T02:27:16.894 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.1] 2024-08-17T02:27:16.894 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBrCsBmTytWCxAALORMyUE3eCFlcBD4V/+zeg== 2024-08-17T02:27:16.894 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.2] 2024-08-17T02:27:16.894 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBuCsBmCNMnDhAA3mlQWk4lH8RXjvP+J4u7gQ== 2024-08-17T02:27:16.894 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.3] 2024-08-17T02:27:16.894 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBxCsBm7guOERAAzIHD3BIvrW2VXOURxAHypQ== 2024-08-17T02:27:16.894 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr.x] 2024-08-17T02:27:16.894 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBkCsBmrRbjChAA42nAQuNtOni4NbyVJ/h+rw== 2024-08-17T02:27:16.894 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.b] 2024-08-17T02:27:16.895 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBkCsBmNtrUIxAAhNrSSu2trKRewkSibyBIIA== 2024-08-17T02:27:16.895 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.d] 2024-08-17T02:27:16.895 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBkCsBm05Y9LRAAeLg/8K7qn6rDG3kr3BHo8w== 2024-08-17T02:27:16.895 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.4] 2024-08-17T02:27:16.895 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQB3CsBmFVcTCRAAezzbEswbRGrv5j4lXL0NTg== 2024-08-17T02:27:16.895 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.5] 2024-08-17T02:27:16.895 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQB6CsBmgH8wDxAAMWOnEu/RJNDjrmqQjKQe8w== 2024-08-17T02:27:16.895 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.6] 2024-08-17T02:27:16.895 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQB9CsBmnV7UERAAdAlDbklEmHdefAehWXFRTQ== 2024-08-17T02:27:16.895 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.7] 2024-08-17T02:27:16.895 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQCACsBm7gcwFhAADEzJFJ4G284Sn5Bx39vW/A== 2024-08-17T02:27:16.895 INFO:teuthology.orchestra.run.smithi106.stdout:[client.0] 2024-08-17T02:27:16.895 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBkCsBm9FBiNRAA5sJG0Im0gZDRIzlKHmiojg== 2024-08-17T02:27:16.895 INFO:teuthology.orchestra.run.smithi106.stdout:[client.2] 2024-08-17T02:27:16.895 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBkCsBm08lsOxAAMmzLVevzPqMr3ylEKFn5bA== 2024-08-17T02:27:16.895 INFO:teuthology.orchestra.run.smithi106.stdout:[client.1] 2024-08-17T02:27:16.896 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBlCsBmU6/8BRAA+W/hF8d4S1Yq8EMi24v0UQ== 2024-08-17T02:27:16.896 INFO:teuthology.orchestra.run.smithi106.stdout:[client.3] 2024-08-17T02:27:16.896 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBlCsBmHdEMDBAA61eU4jm7eu+hu0CMOtPK+A== 2024-08-17T02:27:16.934 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr.y] 2024-08-17T02:27:16.934 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBkCsBmNHSqAxAA1jOfB2dHKJrNPHKIkkSYHw== 2024-08-17T02:27:16.934 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.a] 2024-08-17T02:27:16.934 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBkCsBmbGwOERAATJC64Ew1XkVO3YnIq+uWJQ== 2024-08-17T02:27:16.934 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.c] 2024-08-17T02:27:16.934 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBkCsBmOuJrGhAA+B1a9Hl6H5MF0iuHuQG9FA== 2024-08-17T02:27:16.934 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.0] 2024-08-17T02:27:16.934 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBoCsBmZxNTBxAAh7l7LkeEACf8iaQ1nEi8CQ== 2024-08-17T02:27:16.934 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.1] 2024-08-17T02:27:16.935 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBrCsBmTytWCxAALORMyUE3eCFlcBD4V/+zeg== 2024-08-17T02:27:16.935 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.2] 2024-08-17T02:27:16.935 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBuCsBmCNMnDhAA3mlQWk4lH8RXjvP+J4u7gQ== 2024-08-17T02:27:16.935 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.3] 2024-08-17T02:27:16.935 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBxCsBm7guOERAAzIHD3BIvrW2VXOURxAHypQ== 2024-08-17T02:27:16.935 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr.x] 2024-08-17T02:27:16.935 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBkCsBmrRbjChAA42nAQuNtOni4NbyVJ/h+rw== 2024-08-17T02:27:16.935 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.b] 2024-08-17T02:27:16.935 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBkCsBmNtrUIxAAhNrSSu2trKRewkSibyBIIA== 2024-08-17T02:27:16.935 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.d] 2024-08-17T02:27:16.935 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBkCsBm05Y9LRAAeLg/8K7qn6rDG3kr3BHo8w== 2024-08-17T02:27:16.935 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.4] 2024-08-17T02:27:16.935 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQB3CsBmFVcTCRAAezzbEswbRGrv5j4lXL0NTg== 2024-08-17T02:27:16.935 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.5] 2024-08-17T02:27:16.935 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQB6CsBmgH8wDxAAMWOnEu/RJNDjrmqQjKQe8w== 2024-08-17T02:27:16.935 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.6] 2024-08-17T02:27:16.936 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQB9CsBmnV7UERAAdAlDbklEmHdefAehWXFRTQ== 2024-08-17T02:27:16.936 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.7] 2024-08-17T02:27:16.936 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCACsBm7gcwFhAADEzJFJ4G284Sn5Bx39vW/A== 2024-08-17T02:27:16.936 INFO:teuthology.orchestra.run.smithi171.stdout:[client.0] 2024-08-17T02:27:16.936 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBkCsBm9FBiNRAA5sJG0Im0gZDRIzlKHmiojg== 2024-08-17T02:27:16.936 INFO:teuthology.orchestra.run.smithi171.stdout:[client.2] 2024-08-17T02:27:16.936 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBkCsBm08lsOxAAMmzLVevzPqMr3ylEKFn5bA== 2024-08-17T02:27:16.936 INFO:teuthology.orchestra.run.smithi171.stdout:[client.1] 2024-08-17T02:27:16.936 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBlCsBmU6/8BRAA+W/hF8d4S1Yq8EMi24v0UQ== 2024-08-17T02:27:16.936 INFO:teuthology.orchestra.run.smithi171.stdout:[client.3] 2024-08-17T02:27:16.936 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQBlCsBmHdEMDBAA61eU4jm7eu+hu0CMOtPK+A== 2024-08-17T02:27:16.937 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:27:16.942 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:27:17.063 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:27:17.067 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:27:17.157 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:27:17.161 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:27:17.251 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:17.255 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:17.343 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:17.347 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:17.434 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:17.438 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:17.526 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:17.530 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:17.618 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:27:17.622 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:27:17.709 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:27:17.713 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:27:17.803 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:27:17.806 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:27:17.896 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:17.900 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:17.987 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:17.991 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:18.077 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:18.082 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:18.169 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:18.173 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:27:18.260 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:27:18.264 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:27:18.354 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:27:18.358 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:27:18.449 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:27:18.453 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:27:18.542 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:27:18.546 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:27:18.636 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-17T02:27:18.636 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-17T02:27:18.694 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:27:18.793 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-17T02:27:18.849 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-17T02:27:18.906 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:27:19.005 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-17T02:27:19.062 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-17T02:27:19.117 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:27:19.217 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-17T02:27:19.272 DEBUG:teuthology.orchestra.run.smithi106:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:27:19.276 DEBUG:teuthology.orchestra.run.smithi171:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:27:19.311 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-17T02:27:19.311 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-17T02:27:19.311 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-17T02:27:19.352 INFO:tasks.ceph.mon.a:Started 2024-08-17T02:27:19.352 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-17T02:27:19.352 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-17T02:27:19.356 INFO:tasks.ceph.mon.b:Started 2024-08-17T02:27:19.356 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-17T02:27:19.356 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-17T02:27:19.359 INFO:tasks.ceph.mon.c:Started 2024-08-17T02:27:19.359 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-17T02:27:19.360 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-17T02:27:19.360 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-17T02:27:19.363 INFO:tasks.ceph.mgr.y:Started 2024-08-17T02:27:19.364 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-17T02:27:19.364 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-17T02:27:19.367 INFO:tasks.ceph.mgr.x:Started 2024-08-17T02:27:19.367 INFO:tasks.ceph:Setting crush tunables to default 2024-08-17T02:27:19.368 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd crush tunables default 2024-08-17T02:27:19.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.519+0000 7f355ce00640 1 Processor -- start 2024-08-17T02:27:19.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.519+0000 7f355ce00640 1 -- start start 2024-08-17T02:27:19.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.520+0000 7f355ce00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f35580a54d0 0x7f3558155d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.520+0000 7f355ce00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580af580 0x7f35580afa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:19.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.520+0000 7f355ce00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3558158400 con 0x7f3558155980 2024-08-17T02:27:19.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.520+0000 7f355ce00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35580aff40 con 0x7f35580a54d0 2024-08-17T02:27:19.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.520+0000 7f355ce00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35581577f0 con 0x7f35580af580 2024-08-17T02:27:19.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.521+0000 7f3555e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f3558155980 0x7f3558156f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:37830/0 (socket says 172.21.15.106:37830) 2024-08-17T02:27:19.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.521+0000 7f3555e00640 1 -- 172.21.15.106:0/3814688090 learned_addr learned my addr 172.21.15.106:0/3814688090 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:19.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.521+0000 7f3556800640 1 --2- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580af580 0x7f35580afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.521+0000 7f3556800640 1 -- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580af580 msgr2=0x7f35580afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:27:19.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.521+0000 7f3556800640 1 -- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580af580 msgr2=0x7f35580afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:19.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.521+0000 7f3556800640 1 --2- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580af580 0x7f35580afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:19.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.521+0000 7f3556800640 1 --2- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580af580 0x7f35580afa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:27:19.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.521+0000 7f3555400640 1 --2- 172.21.15.106:0/3814688090 >> v2:172.21.15.171:3300/0 conn(0x7f35580a54d0 0x7f3558155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.521+0000 7f3555400640 1 -- 172.21.15.106:0/3814688090 >> v2:172.21.15.171:3300/0 conn(0x7f35580a54d0 msgr2=0x7f3558155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:27:19.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.521+0000 7f3555400640 1 -- 172.21.15.106:0/3814688090 >> v2:172.21.15.171:3300/0 conn(0x7f35580a54d0 msgr2=0x7f3558155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:19.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.521+0000 7f3555400640 1 --2- 172.21.15.106:0/3814688090 >> v2:172.21.15.171:3300/0 conn(0x7f35580a54d0 0x7f3558155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:19.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.521+0000 7f3555400640 1 --2- 172.21.15.106:0/3814688090 >> v2:172.21.15.171:3300/0 conn(0x7f35580a54d0 0x7f3558155d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:27:19.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.722+0000 7f3556800640 1 --2- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580af580 0x7f35580afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.722+0000 7f3555400640 1 --2- 172.21.15.106:0/3814688090 >> v2:172.21.15.171:3300/0 conn(0x7f35580a54d0 0x7f3558155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:19.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.722+0000 7f3556800640 1 -- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580af580 msgr2=0x7f35580afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:27:19.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.722+0000 7f3556800640 1 -- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580af580 msgr2=0x7f35580afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:19.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.722+0000 7f3556800640 1 --2- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580af580 0x7f35580afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:19.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.722+0000 7f3555400640 1 -- 172.21.15.106:0/3814688090 >> v2:172.21.15.171:3300/0 conn(0x7f35580a54d0 msgr2=0x7f3558155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:27:19.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.722+0000 7f3555400640 1 -- 172.21.15.106:0/3814688090 >> v2:172.21.15.171:3300/0 conn(0x7f35580a54d0 msgr2=0x7f3558155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:19.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.722+0000 7f3555400640 1 --2- 172.21.15.106:0/3814688090 >> v2:172.21.15.171:3300/0 conn(0x7f35580a54d0 0x7f3558155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:19.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.722+0000 7f3556800640 1 --2- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580af580 0x7f35580afa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:27:19.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:19.722+0000 7f3555400640 1 --2- 172.21.15.106:0/3814688090 >> v2:172.21.15.171:3300/0 conn(0x7f35580a54d0 0x7f3558155d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:27:20.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:20.123+0000 7f3555400640 1 --2- 172.21.15.106:0/3814688090 >> v2:172.21.15.171:3300/0 conn(0x7f35580a54d0 0x7f3558155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:20.123+0000 7f3556800640 1 --2- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580af580 0x7f35580afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:20.123+0000 7f3555400640 1 -- 172.21.15.106:0/3814688090 >> v2:172.21.15.171:3300/0 conn(0x7f35580a54d0 msgr2=0x7f3558155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:27:20.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:20.123+0000 7f3555400640 1 -- 172.21.15.106:0/3814688090 >> v2:172.21.15.171:3300/0 conn(0x7f35580a54d0 msgr2=0x7f3558155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:20.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:20.123+0000 7f3555400640 1 --2- 172.21.15.106:0/3814688090 >> v2:172.21.15.171:3300/0 conn(0x7f35580a54d0 0x7f3558155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:20.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:20.123+0000 7f3556800640 1 -- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580af580 msgr2=0x7f35580afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:27:20.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:20.123+0000 7f3556800640 1 -- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580af580 msgr2=0x7f35580afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:20.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:20.123+0000 7f3556800640 1 --2- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580af580 0x7f35580afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:20.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:20.123+0000 7f3555400640 1 --2- 172.21.15.106:0/3814688090 >> v2:172.21.15.171:3300/0 conn(0x7f35580a54d0 0x7f3558155d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:27:20.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:20.123+0000 7f3556800640 1 --2- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580af580 0x7f35580afa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:27:20.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:20.925+0000 7f3555400640 1 --2- 172.21.15.106:0/3814688090 >> v2:172.21.15.171:3300/0 conn(0x7f35580a54d0 0x7f3558155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:20.925+0000 7f3556800640 1 --2- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580af580 0x7f35580afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:20.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:20.925+0000 7f3555400640 1 -- 172.21.15.106:0/3814688090 >> v2:172.21.15.171:3300/0 conn(0x7f35580a54d0 msgr2=0x7f3558155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:27:20.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:20.925+0000 7f3555400640 1 -- 172.21.15.106:0/3814688090 >> v2:172.21.15.171:3300/0 conn(0x7f35580a54d0 msgr2=0x7f3558155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:20.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:20.925+0000 7f3556800640 1 -- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580af580 msgr2=0x7f35580afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:27:20.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:20.925+0000 7f3556800640 1 -- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580af580 msgr2=0x7f35580afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:20.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:20.925+0000 7f3555400640 1 --2- 172.21.15.106:0/3814688090 >> v2:172.21.15.171:3300/0 conn(0x7f35580a54d0 0x7f3558155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:20.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:20.925+0000 7f3556800640 1 --2- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580af580 0x7f35580afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:20.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:20.925+0000 7f3555400640 1 --2- 172.21.15.106:0/3814688090 >> v2:172.21.15.171:3300/0 conn(0x7f35580a54d0 0x7f3558155d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:27:20.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:20.925+0000 7f3556800640 1 --2- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580af580 0x7f35580afa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:27:22.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:22.520+0000 7f354f400640 1 -- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580af580 msgr2=0x7f35580afa00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:27:22.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:22.520+0000 7f354f400640 1 --2- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35580af580 0x7f35580afa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:22.520+0000 7f354f400640 1 -- 172.21.15.106:0/3814688090 >> v2:172.21.15.171:3300/0 conn(0x7f35580a54d0 msgr2=0x7f3558155d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:27:22.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:22.520+0000 7f354f400640 1 --2- 172.21.15.106:0/3814688090 >> v2:172.21.15.171:3300/0 conn(0x7f35580a54d0 0x7f3558155d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:22.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:22.520+0000 7f354f400640 1 -- 172.21.15.106:0/3814688090 >> v1:172.21.15.106:6789/0 conn(0x7f3558155980 legacy=0x7f3558156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:22.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:22.520+0000 7f354f400640 1 --2- 172.21.15.106:0/3814688090 >> v2:172.21.15.106:3300/0 conn(0x7f35380036a0 0x7f3538005ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:22.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:22.520+0000 7f354f400640 1 -- 172.21.15.106:0/3814688090 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3558157ad0 con 0x7f3538006120 2024-08-17T02:27:22.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:22.520+0000 7f354f400640 1 -- 172.21.15.106:0/3814688090 --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35580aff40 con 0x7f35380036a0 2024-08-17T02:27:22.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:22.520+0000 7f3555e00640 1 --2- 172.21.15.106:0/3814688090 >> v2:172.21.15.106:3300/0 conn(0x7f35380036a0 0x7f3538005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:22.521+0000 7f3555e00640 1 -- 172.21.15.106:0/3814688090 >> v2:172.21.15.106:3300/0 conn(0x7f35380036a0 msgr2=0x7f3538005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:27:22.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:22.521+0000 7f3555e00640 1 -- 172.21.15.106:0/3814688090 >> v2:172.21.15.106:3300/0 conn(0x7f35380036a0 msgr2=0x7f3538005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:22.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:22.521+0000 7f3555e00640 1 --2- 172.21.15.106:0/3814688090 >> v2:172.21.15.106:3300/0 conn(0x7f35380036a0 0x7f3538005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:22.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:22.521+0000 7f3555e00640 1 --2- 172.21.15.106:0/3814688090 >> v2:172.21.15.106:3300/0 conn(0x7f35380036a0 0x7f3538005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:27:22.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:22.722+0000 7f3555e00640 1 --2- 172.21.15.106:0/3814688090 >> v2:172.21.15.106:3300/0 conn(0x7f35380036a0 0x7f3538005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:22.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:22.722+0000 7f3555e00640 1 -- 172.21.15.106:0/3814688090 >> v2:172.21.15.106:3300/0 conn(0x7f35380036a0 msgr2=0x7f3538005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:27:22.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:22.722+0000 7f3555e00640 1 -- 172.21.15.106:0/3814688090 >> v2:172.21.15.106:3300/0 conn(0x7f35380036a0 msgr2=0x7f3538005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:22.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:22.722+0000 7f3555e00640 1 --2- 172.21.15.106:0/3814688090 >> v2:172.21.15.106:3300/0 conn(0x7f35380036a0 0x7f3538005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:22.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:22.722+0000 7f3555e00640 1 --2- 172.21.15.106:0/3814688090 >> v2:172.21.15.106:3300/0 conn(0x7f35380036a0 0x7f3538005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:27:23.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:23.123+0000 7f3555e00640 1 --2- 172.21.15.106:0/3814688090 >> v2:172.21.15.106:3300/0 conn(0x7f35380036a0 0x7f3538005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:23.123+0000 7f3555e00640 1 -- 172.21.15.106:0/3814688090 >> v2:172.21.15.106:3300/0 conn(0x7f35380036a0 msgr2=0x7f3538005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:27:23.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:23.123+0000 7f3555e00640 1 -- 172.21.15.106:0/3814688090 >> v2:172.21.15.106:3300/0 conn(0x7f35380036a0 msgr2=0x7f3538005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:23.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:23.123+0000 7f3555e00640 1 --2- 172.21.15.106:0/3814688090 >> v2:172.21.15.106:3300/0 conn(0x7f35380036a0 0x7f3538005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:23.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:23.123+0000 7f3555e00640 1 --2- 172.21.15.106:0/3814688090 >> v2:172.21.15.106:3300/0 conn(0x7f35380036a0 0x7f3538005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-17T02:27:23.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:23.923+0000 7f3555e00640 1 --2- 172.21.15.106:0/3814688090 >> v2:172.21.15.106:3300/0 conn(0x7f35380036a0 0x7f3538005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:23.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:23.923+0000 7f3555e00640 1 -- 172.21.15.106:0/3814688090 >> v2:172.21.15.106:3300/0 conn(0x7f35380036a0 msgr2=0x7f3538005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:27:23.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:23.923+0000 7f3555e00640 1 -- 172.21.15.106:0/3814688090 >> v2:172.21.15.106:3300/0 conn(0x7f35380036a0 msgr2=0x7f3538005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:27:23.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:23.923+0000 7f3555e00640 1 --2- 172.21.15.106:0/3814688090 >> v2:172.21.15.106:3300/0 conn(0x7f35380036a0 0x7f3538005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:27:23.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:23.923+0000 7f3555e00640 1 --2- 172.21.15.106:0/3814688090 >> v2:172.21.15.106:3300/0 conn(0x7f35380036a0 0x7f3538005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-17T02:27:24.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.738+0000 7f3554a00640 1 -- 172.21.15.106:0/3814688090 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2716270437 0 0) 0x7f3558157ad0 con 0x7f3538006120 2024-08-17T02:27:24.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.738+0000 7f3554a00640 1 -- 172.21.15.106:0/3814688090 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f353c0034e0 con 0x7f3538006120 2024-08-17T02:27:24.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.741+0000 7f3554a00640 1 -- 172.21.15.106:0/3814688090 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3419334844 0 0) 0x7f353c0034e0 con 0x7f3538006120 2024-08-17T02:27:24.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.741+0000 7f3554a00640 1 -- 172.21.15.106:0/3814688090 >> v2:172.21.15.106:3300/0 conn(0x7f35380036a0 msgr2=0x7f3538005ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:27:24.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.741+0000 7f3554a00640 1 --2- 172.21.15.106:0/3814688090 >> v2:172.21.15.106:3300/0 conn(0x7f35380036a0 0x7f3538005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.741+0000 7f3554a00640 1 -- 172.21.15.106:0/3814688090 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353800aeb0 con 0x7f3538006120 2024-08-17T02:27:24.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.741+0000 7f3554a00640 1 -- 172.21.15.106:0/3814688090 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7f354400d300 con 0x7f3538006120 2024-08-17T02:27:24.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.741+0000 7f3554a00640 1 -- 172.21.15.106:0/3814688090 >> v1:172.21.15.171:6789/0 conn(0x7f3538006120 legacy=0x7f35380085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.741+0000 7f3556800640 1 -- 172.21.15.106:0/3814688090 reap_dead start 2024-08-17T02:27:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.741+0000 7f3554a00640 1 --2- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f353c003a20 0x7f353c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.741+0000 7f3554a00640 1 --2- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f353c004780 0x7f353c004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.741+0000 7f3554a00640 1 --2- 172.21.15.106:0/3814688090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f353c005330 0x7f353c00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.741+0000 7f3554a00640 1 -- 172.21.15.106:0/3814688090 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35580aff40 con 0x7f353c005330 2024-08-17T02:27:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.741+0000 7f3554a00640 1 -- 172.21.15.106:0/3814688090 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353c00e470 con 0x7f353c003a20 2024-08-17T02:27:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.741+0000 7f3554a00640 1 -- 172.21.15.106:0/3814688090 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353c00e630 con 0x7f353c004780 2024-08-17T02:27:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.741+0000 7f3556800640 1 --2- 172.21.15.106:0/3814688090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f353c005330 0x7f353c00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.742+0000 7f3555e00640 1 --2- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f353c003a20 0x7f353c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.742+0000 7f3555400640 1 --2- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f353c004780 0x7f353c004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.742+0000 7f3556800640 1 -- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f353c004780 msgr2=0x7f353c004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:24.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.742+0000 7f3556800640 1 --2- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f353c004780 0x7f353c004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.742+0000 7f3556800640 1 -- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f353c003a20 msgr2=0x7f353c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:24.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.742+0000 7f3556800640 1 --2- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f353c003a20 0x7f353c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.742+0000 7f3556800640 1 -- 172.21.15.106:0/3814688090 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353c0034e0 con 0x7f353c005330 2024-08-17T02:27:24.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.743+0000 7f3556800640 1 --2- 172.21.15.106:0/3814688090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f353c005330 0x7f353c00dbe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f355806aa20 tx=0x7f355000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c25c5dd3732732 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:24.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.744+0000 7f3554a00640 1 -- 172.21.15.106:0/3814688090 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3550032420 con 0x7f353c005330 2024-08-17T02:27:24.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.744+0000 7f3554a00640 1 -- 172.21.15.106:0/3814688090 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355002c040 con 0x7f353c005330 2024-08-17T02:27:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.744+0000 7f3554a00640 1 -- 172.21.15.106:0/3814688090 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35500327f0 con 0x7f353c005330 2024-08-17T02:27:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.745+0000 7f355ce00640 1 -- 172.21.15.106:0/3814688090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f353c005330 msgr2=0x7f353c00dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.745+0000 7f355ce00640 1 --2- 172.21.15.106:0/3814688090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f353c005330 0x7f353c00dbe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f355806aa20 tx=0x7f355000b040 comp rx=0 tx=0).stop 2024-08-17T02:27:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.745+0000 7f355ce00640 1 -- 172.21.15.106:0/3814688090 shutdown_connections 2024-08-17T02:27:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.745+0000 7f355ce00640 1 --2- 172.21.15.106:0/3814688090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f353c005330 0x7f353c00dbe0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.745+0000 7f355ce00640 1 --2- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f353c004780 0x7f353c004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.745+0000 7f355ce00640 1 --2- 172.21.15.106:0/3814688090 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f353c003a20 0x7f353c003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.745+0000 7f355ce00640 1 -- 172.21.15.106:0/3814688090 >> 172.21.15.106:0/3814688090 conn(0x7f3558067750 msgr2=0x7f35580cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.745+0000 7f355ce00640 1 -- 172.21.15.106:0/3814688090 shutdown_connections 2024-08-17T02:27:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.745+0000 7f355ce00640 1 -- 172.21.15.106:0/3814688090 wait complete. 2024-08-17T02:27:24.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.747+0000 7f355ce00640 1 Processor -- start 2024-08-17T02:27:24.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.747+0000 7f355ce00640 1 -- start start 2024-08-17T02:27:24.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.748+0000 7f355ce00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f353c003a20 0x7f3558168ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.748+0000 7f355ce00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f353c004780 0x7f3558158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.748+0000 7f355ce00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f353c005330 0x7f355814cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:24.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.748+0000 7f355ce00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3558158cd0 con 0x7f353c005330 2024-08-17T02:27:24.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.748+0000 7f355ce00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355814d0b0 con 0x7f353c004780 2024-08-17T02:27:24.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.748+0000 7f355ce00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3558158ec0 con 0x7f353c003a20 2024-08-17T02:27:24.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.748+0000 7f3556800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f353c005330 0x7f355814cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.748+0000 7f3555e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f353c003a20 0x7f3558168ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.748+0000 7f3556800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f353c005330 0x7f355814cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48916/0 (socket says 172.21.15.106:48916) 2024-08-17T02:27:24.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.748+0000 7f3556800640 1 -- 172.21.15.106:0/61780226 learned_addr learned my addr 172.21.15.106:0/61780226 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:24.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.748+0000 7f3555400640 1 --2- 172.21.15.106:0/61780226 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f353c004780 0x7f3558158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:24.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.749+0000 7f3556800640 1 -- 172.21.15.106:0/61780226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f353c003a20 msgr2=0x7f3558168ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.749+0000 7f3556800640 1 --2- 172.21.15.106:0/61780226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f353c003a20 0x7f3558168ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.749+0000 7f3556800640 1 -- 172.21.15.106:0/61780226 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f353c004780 msgr2=0x7f3558158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.749+0000 7f3556800640 1 --2- 172.21.15.106:0/61780226 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f353c004780 0x7f3558158790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.749+0000 7f3556800640 1 -- 172.21.15.106:0/61780226 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35581591a0 con 0x7f353c005330 2024-08-17T02:27:24.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.749+0000 7f3556800640 1 --2- 172.21.15.106:0/61780226 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f353c005330 0x7f355814cb70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f355002af40 tx=0x7f3550039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:24.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.749+0000 7f354d600640 1 -- 172.21.15.106:0/61780226 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3550047480 con 0x7f353c005330 2024-08-17T02:27:24.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.749+0000 7f354d600640 1 -- 172.21.15.106:0/61780226 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3550040070 con 0x7f353c005330 2024-08-17T02:27:24.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.749+0000 7f354d600640 1 -- 172.21.15.106:0/61780226 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3550047830 con 0x7f353c005330 2024-08-17T02:27:24.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.749+0000 7f355ce00640 1 -- 172.21.15.106:0/61780226 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3558159480 con 0x7f353c005330 2024-08-17T02:27:24.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.750+0000 7f355ce00640 1 -- 172.21.15.106:0/61780226 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3558153f00 con 0x7f353c005330 2024-08-17T02:27:24.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.750+0000 7f354d600640 1 -- 172.21.15.106:0/61780226 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f3550003040 con 0x7f353c005330 2024-08-17T02:27:24.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.750+0000 7f354d600640 1 -- 172.21.15.106:0/61780226 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3550042070 con 0x7f353c005330 2024-08-17T02:27:24.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.751+0000 7f355ce00640 1 -- 172.21.15.106:0/61780226 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3558151c50 con 0x7f353c005330 2024-08-17T02:27:24.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.754+0000 7f354d600640 1 -- 172.21.15.106:0/61780226 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f3558151c50 con 0x7f353c005330 2024-08-17T02:27:24.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.821+0000 7f355ce00640 1 -- 172.21.15.106:0/61780226 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f35580a5cc0 con 0x7f353c005330 2024-08-17T02:27:24.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.829+0000 7f354d600640 1 -- 172.21.15.106:0/61780226 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f3550057020 con 0x7f353c005330 2024-08-17T02:27:24.830 INFO:teuthology.orchestra.run.smithi106.stderr:adjusted tunables profile to default 2024-08-17T02:27:24.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.830+0000 7f355ce00640 1 -- 172.21.15.106:0/61780226 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f353c005330 msgr2=0x7f355814cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:24.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.830+0000 7f355ce00640 1 --2- 172.21.15.106:0/61780226 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f353c005330 0x7f355814cb70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f355002af40 tx=0x7f3550039000 comp rx=0 tx=0).stop 2024-08-17T02:27:24.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.830+0000 7f355ce00640 1 -- 172.21.15.106:0/61780226 shutdown_connections 2024-08-17T02:27:24.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.830+0000 7f355ce00640 1 --2- 172.21.15.106:0/61780226 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f353c005330 0x7f355814cb70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.830+0000 7f355ce00640 1 --2- 172.21.15.106:0/61780226 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f353c004780 0x7f3558158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.830+0000 7f355ce00640 1 --2- 172.21.15.106:0/61780226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f353c003a20 0x7f3558168ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:24.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.830+0000 7f355ce00640 1 -- 172.21.15.106:0/61780226 >> 172.21.15.106:0/61780226 conn(0x7f3558067750 msgr2=0x7f3558068800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:24.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.830+0000 7f355ce00640 1 -- 172.21.15.106:0/61780226 shutdown_connections 2024-08-17T02:27:24.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:24.830+0000 7f355ce00640 1 -- 172.21.15.106:0/61780226 wait complete. 2024-08-17T02:27:24.847 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-17T02:27:24.848 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-17T02:27:24.848 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-17T02:27:24.904 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-17T02:27:24.905 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-17T02:27:25.000 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-17T02:27:25.000 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-17T02:27:25.095 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-17T02:27:25.095 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-17T02:27:25.190 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-17T02:27:25.190 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-17T02:27:25.254 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-17T02:27:25.254 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-17T02:27:25.351 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-17T02:27:25.351 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-17T02:27:25.447 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-08-17T02:27:25.448 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-17T02:27:25.546 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 214cec52-4ddb-4539-961a-93c769170f1c 0 2024-08-17T02:27:25.605 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-08-17T02:27:25.603+0000 7f2aff766ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:27:25.638 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-08-17T02:27:25.635+0000 7f34f446fec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:27:25.731 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.731+0000 7fecf3e00640 1 Processor -- start 2024-08-17T02:27:25.731 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.731+0000 7fecf3e00640 1 -- start start 2024-08-17T02:27:25.733 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.732+0000 7fecf3e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fecec0ca2f0 0x7fecec0ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.733 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.732+0000 7fecf3e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fecec0c7370 0x7fecec0c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.733 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.732+0000 7fecf3e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecec06f240 con 0x7fecec158ea0 2024-08-17T02:27:25.733 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.732+0000 7fecf3e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecec0c6f20 con 0x7fecec0ca2f0 2024-08-17T02:27:25.733 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.732+0000 7fecf3e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecec0cacb0 con 0x7fecec0c7370 2024-08-17T02:27:25.733 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.732+0000 7fecf1e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fecec0c7370 0x7fecec0c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.733 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.732+0000 7fecf1400640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fecec158ea0 0x7fecec0d0460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:45292/0 (socket says 172.21.15.171:45292) 2024-08-17T02:27:25.733 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.733+0000 7fecf1400640 1 -- 172.21.15.171:0/2775600718 learned_addr learned my addr 172.21.15.171:0/2775600718 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-08-17T02:27:25.733 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.733+0000 7fecf0a00640 1 --2- 172.21.15.171:0/2775600718 >> v2:172.21.15.106:3300/0 conn(0x7fecec0ca2f0 0x7fecec0ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.733+0000 7fecf0a00640 1 -- 172.21.15.171:0/2775600718 >> v2:172.21.15.171:3300/0 conn(0x7fecec0c7370 msgr2=0x7fecec0c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:25.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.733+0000 7fecf0a00640 1 --2- 172.21.15.171:0/2775600718 >> v2:172.21.15.171:3300/0 conn(0x7fecec0c7370 0x7fecec0c77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.733+0000 7fecf0a00640 1 -- 172.21.15.171:0/2775600718 >> v1:172.21.15.171:6789/0 conn(0x7fecec158ea0 legacy=0x7fecec0d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.733+0000 7fecebe00640 1 -- 172.21.15.171:0/2775600718 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 487509623 0 0) 0x7fecec06f240 con 0x7fecec158ea0 2024-08-17T02:27:25.734 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.733+0000 7fecf0a00640 1 -- 172.21.15.171:0/2775600718 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec0cf410 con 0x7fecec0ca2f0 2024-08-17T02:27:25.735 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.734+0000 7fecf0a00640 1 --2- 172.21.15.171:0/2775600718 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecec0ca2f0 0x7fecec0ca770 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fecec069bb0 tx=0x7fecd80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984b70cd208a2baa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:25.739 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.738+0000 7fecebe00640 1 -- 172.21.15.171:0/2775600718 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd802ad20 con 0x7fecec0ca2f0 2024-08-17T02:27:25.739 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.739+0000 7fecebe00640 1 -- 172.21.15.171:0/2775600718 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd802ae80 con 0x7fecec0ca2f0 2024-08-17T02:27:25.739 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.739+0000 7fecebe00640 1 -- 172.21.15.171:0/2775600718 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8032670 con 0x7fecec0ca2f0 2024-08-17T02:27:25.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.739+0000 7fecf3e00640 1 -- 172.21.15.171:0/2775600718 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecec0ca2f0 msgr2=0x7fecec0ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.739+0000 7fecf3e00640 1 --2- 172.21.15.171:0/2775600718 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecec0ca2f0 0x7fecec0ca770 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fecec069bb0 tx=0x7fecd80090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.739+0000 7fecf3e00640 1 -- 172.21.15.171:0/2775600718 shutdown_connections 2024-08-17T02:27:25.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.739+0000 7fecf3e00640 1 --2- 172.21.15.171:0/2775600718 >> v2:172.21.15.171:3300/0 conn(0x7fecec0c7370 0x7fecec0c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.739+0000 7fecf3e00640 1 --2- 172.21.15.171:0/2775600718 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecec0ca2f0 0x7fecec0ca770 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.739+0000 7fecf3e00640 1 -- 172.21.15.171:0/2775600718 >> 172.21.15.171:0/2775600718 conn(0x7fecec06eb90 msgr2=0x7fecec0cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:25.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.739+0000 7fecf3e00640 1 -- 172.21.15.171:0/2775600718 shutdown_connections 2024-08-17T02:27:25.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.740+0000 7fecf3e00640 1 -- 172.21.15.171:0/2775600718 wait complete. 2024-08-17T02:27:25.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.741+0000 7fecf3e00640 1 Processor -- start 2024-08-17T02:27:25.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.741+0000 7fecf3e00640 1 -- start start 2024-08-17T02:27:25.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.742+0000 7fecf3e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fecec0c7370 0x7fecec168730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.742+0000 7fecf3e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecec0ca2f0 0x7fecec09c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.742+0000 7fecf3e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecec158ea0 0x7fecec09cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.742+0000 7fecf3e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecec0c6440 con 0x7fecec0ca2f0 2024-08-17T02:27:25.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.742+0000 7fecf3e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecec14ac90 con 0x7fecec158ea0 2024-08-17T02:27:25.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.742+0000 7fecf3e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecec0c6160 con 0x7fecec0c7370 2024-08-17T02:27:25.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.742+0000 7fecf1400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fecec0c7370 0x7fecec168730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.742+0000 7fecf1e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecec158ea0 0x7fecec09cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.742+0000 7fecf1400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fecec0c7370 0x7fecec168730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:33898/0 (socket says 172.21.15.171:33898) 2024-08-17T02:27:25.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.742+0000 7fecf1400640 1 -- 172.21.15.171:0/3215850363 learned_addr learned my addr 172.21.15.171:0/3215850363 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-08-17T02:27:25.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.742+0000 7fecf0a00640 1 --2- 172.21.15.171:0/3215850363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecec0ca2f0 0x7fecec09c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.743+0000 7fecf1400640 1 -- 172.21.15.171:0/3215850363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecec158ea0 msgr2=0x7fecec09cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.743+0000 7fecf1400640 1 --2- 172.21.15.171:0/3215850363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecec158ea0 0x7fecec09cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.743+0000 7fecf1400640 1 -- 172.21.15.171:0/3215850363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecec0ca2f0 msgr2=0x7fecec09c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.743+0000 7fecf1400640 1 --2- 172.21.15.171:0/3215850363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecec0ca2f0 0x7fecec09c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.743+0000 7fecf1400640 1 -- 172.21.15.171:0/3215850363 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd8009390 con 0x7fecec0c7370 2024-08-17T02:27:25.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.743+0000 7fecf1e00640 1 --2- 172.21.15.171:0/3215850363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecec158ea0 0x7fecec09cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:25.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.743+0000 7fecf0a00640 1 --2- 172.21.15.171:0/3215850363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecec0ca2f0 0x7fecec09c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:25.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.743+0000 7fecf1400640 1 --2- 172.21.15.171:0/3215850363 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fecec0c7370 0x7fecec168730 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fece000c5e0 tx=0x7fece0007d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:25.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.743+0000 7fece8c00640 1 -- 172.21.15.171:0/3215850363 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece0005aa0 con 0x7fecec0c7370 2024-08-17T02:27:25.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.743+0000 7fece8c00640 1 -- 172.21.15.171:0/3215850363 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece0005c00 con 0x7fecec0c7370 2024-08-17T02:27:25.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.743+0000 7fece8c00640 1 -- 172.21.15.171:0/3215850363 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece00070f0 con 0x7fecec0c7370 2024-08-17T02:27:25.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.743+0000 7fecf3e00640 1 -- 172.21.15.171:0/3215850363 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecec09a950 con 0x7fecec0c7370 2024-08-17T02:27:25.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.743+0000 7fecf3e00640 1 -- 172.21.15.171:0/3215850363 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecec09af10 con 0x7fecec0c7370 2024-08-17T02:27:25.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.744+0000 7fece8c00640 1 -- 172.21.15.171:0/3215850363 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fece0007520 con 0x7fecec0c7370 2024-08-17T02:27:25.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.744+0000 7fece8c00640 1 -- 172.21.15.171:0/3215850363 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fece001be20 con 0x7fecec0c7370 2024-08-17T02:27:25.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.744+0000 7fecf3e00640 1 -- 172.21.15.171:0/3215850363 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecec09a7b0 con 0x7fecec0c7370 2024-08-17T02:27:25.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.747+0000 7fece8c00640 1 -- 172.21.15.171:0/3215850363 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fecec09a7b0 con 0x7fecec0c7370 2024-08-17T02:27:25.759 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-08-17T02:27:25.757+0000 7f2aff766ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:27:25.790 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-08-17T02:27:25.790+0000 7f34f446fec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:27:25.818 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-08-17T02:27:25.817+0000 7f2aff766ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:27:25.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.821+0000 7fecf3e00640 1 -- 172.21.15.171:0/3215850363 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "214cec52-4ddb-4539-961a-93c769170f1c", "id": 0} v 0) v1 -- 0x7fecec09b100 con 0x7fecec0c7370 2024-08-17T02:27:25.829 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.829+0000 7fece8c00640 1 -- 172.21.15.171:0/3215850363 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "214cec52-4ddb-4539-961a-93c769170f1c", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fece001b4c0 con 0x7fecec0c7370 2024-08-17T02:27:25.830 INFO:teuthology.orchestra.run.smithi171.stdout:0 2024-08-17T02:27:25.831 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.830+0000 7fecf3e00640 1 -- 172.21.15.171:0/3215850363 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fecec0c7370 msgr2=0x7fecec168730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:25.831 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.830+0000 7fecf3e00640 1 --2- 172.21.15.171:0/3215850363 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fecec0c7370 0x7fecec168730 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fece000c5e0 tx=0x7fece0007d60 comp rx=0 tx=0).stop 2024-08-17T02:27:25.831 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.830+0000 7fecf3e00640 1 -- 172.21.15.171:0/3215850363 shutdown_connections 2024-08-17T02:27:25.831 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.830+0000 7fecf3e00640 1 --2- 172.21.15.171:0/3215850363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecec158ea0 0x7fecec09cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.831 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.830+0000 7fecf3e00640 1 --2- 172.21.15.171:0/3215850363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecec0ca2f0 0x7fecec09c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.831 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.830+0000 7fecf3e00640 1 --2- 172.21.15.171:0/3215850363 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fecec0c7370 0x7fecec168730 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.831 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.830+0000 7fecf3e00640 1 -- 172.21.15.171:0/3215850363 >> 172.21.15.171:0/3215850363 conn(0x7fecec06eb90 msgr2=0x7fecec0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:25.831 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.831+0000 7fecf3e00640 1 -- 172.21.15.171:0/3215850363 shutdown_connections 2024-08-17T02:27:25.832 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.831+0000 7fecf3e00640 1 -- 172.21.15.171:0/3215850363 wait complete. 2024-08-17T02:27:25.845 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 309520a4-205e-449a-98c6-2b1c58811ed8 1 2024-08-17T02:27:25.855 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-08-17T02:27:25.855+0000 7f34f446fec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:27:25.996 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.995+0000 7fb745600640 1 Processor -- start 2024-08-17T02:27:25.996 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.995+0000 7fb745600640 1 -- start start 2024-08-17T02:27:25.997 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.996+0000 7fb745600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb740159200 0x7fb7400aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.998 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.996+0000 7fb745600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb7400d0490 0x7fb7400ad9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.998 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.997+0000 7fb745600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb7400adf00 0x7fb7400af640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:25.998 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.997+0000 7fb745600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7400ae3a0 con 0x7fb7400d0490 2024-08-17T02:27:25.998 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.997+0000 7fb745600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7400b11d0 con 0x7fb7400adf00 2024-08-17T02:27:25.998 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.997+0000 7fb745600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7400b08a0 con 0x7fb740159200 2024-08-17T02:27:25.998 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.997+0000 7fb73ea00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb740159200 0x7fb7400aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.998 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.997+0000 7fb73f400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb7400adf00 0x7fb7400af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.998 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.997+0000 7fb73ea00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb740159200 0x7fb7400aeeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:33910/0 (socket says 172.21.15.171:33910) 2024-08-17T02:27:25.998 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.997+0000 7fb73ea00640 1 -- 172.21.15.171:0/4225243229 learned_addr learned my addr 172.21.15.171:0/4225243229 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-08-17T02:27:25.998 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.997+0000 7fb73f400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb7400adf00 0x7fb7400af640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:40652/0 (socket says 172.21.15.171:40652) 2024-08-17T02:27:25.999 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.997+0000 7fb73e000640 1 --2- 172.21.15.171:0/4225243229 >> v2:172.21.15.106:3300/0 conn(0x7fb7400d0490 0x7fb7400ad9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:25.999 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.997+0000 7fb73f400640 1 -- 172.21.15.171:0/4225243229 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb740159200 msgr2=0x7fb7400aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:25.999 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.997+0000 7fb73f400640 1 --2- 172.21.15.171:0/4225243229 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb740159200 0x7fb7400aeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.999 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.997+0000 7fb73f400640 1 -- 172.21.15.171:0/4225243229 >> v2:172.21.15.106:3300/0 conn(0x7fb7400d0490 msgr2=0x7fb7400ad9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:25.999 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.997+0000 7fb73f400640 1 --2- 172.21.15.171:0/4225243229 >> v2:172.21.15.106:3300/0 conn(0x7fb7400d0490 0x7fb7400ad9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:25.999 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.997+0000 7fb73f400640 1 -- 172.21.15.171:0/4225243229 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7400b0b80 con 0x7fb7400adf00 2024-08-17T02:27:26.000 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.998+0000 7fb73f400640 1 --2- 172.21.15.171:0/4225243229 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7400adf00 0x7fb7400af640 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb7400b5270 tx=0x7fb738009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bcbf896e92c8568 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.000 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.999+0000 7fb73d600640 1 -- 172.21.15.171:0/4225243229 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb738007550 con 0x7fb7400adf00 2024-08-17T02:27:26.000 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.999+0000 7fb73d600640 1 -- 172.21.15.171:0/4225243229 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73802d050 con 0x7fb7400adf00 2024-08-17T02:27:26.000 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.999+0000 7fb73d600640 1 -- 172.21.15.171:0/4225243229 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb738007920 con 0x7fb7400adf00 2024-08-17T02:27:26.000 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.999+0000 7fb745600640 1 -- 172.21.15.171:0/4225243229 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7400adf00 msgr2=0x7fb7400af640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.001 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.999+0000 7fb745600640 1 --2- 172.21.15.171:0/4225243229 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7400adf00 0x7fb7400af640 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb7400b5270 tx=0x7fb738009780 comp rx=0 tx=0).stop 2024-08-17T02:27:26.001 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.999+0000 7fb745600640 1 -- 172.21.15.171:0/4225243229 shutdown_connections 2024-08-17T02:27:26.001 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.999+0000 7fb745600640 1 --2- 172.21.15.171:0/4225243229 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7400adf00 0x7fb7400af640 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.001 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.999+0000 7fb745600640 1 --2- 172.21.15.171:0/4225243229 >> v2:172.21.15.106:3300/0 conn(0x7fb7400d0490 0x7fb7400ad9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.001 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.999+0000 7fb745600640 1 --2- 172.21.15.171:0/4225243229 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb740159200 0x7fb7400aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.001 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.999+0000 7fb745600640 1 -- 172.21.15.171:0/4225243229 >> 172.21.15.171:0/4225243229 conn(0x7fb74006eb90 msgr2=0x7fb7400cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:26.001 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.999+0000 7fb745600640 1 -- 172.21.15.171:0/4225243229 shutdown_connections 2024-08-17T02:27:26.001 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:25.999+0000 7fb745600640 1 -- 172.21.15.171:0/4225243229 wait complete. 2024-08-17T02:27:26.001 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.001+0000 7fb745600640 1 Processor -- start 2024-08-17T02:27:26.002 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.001+0000 7fb745600640 1 -- start start 2024-08-17T02:27:26.004 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.002+0000 7fb745600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7400adf00 0x7fb740099b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.004 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.002+0000 7fb745600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7400d0490 0x7fb74009b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.004 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.002+0000 7fb745600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb740159200 0x7fb740151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.004 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.002+0000 7fb745600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74009b910 con 0x7fb740159200 2024-08-17T02:27:26.004 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.002+0000 7fb745600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb740151560 con 0x7fb7400adf00 2024-08-17T02:27:26.004 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.002+0000 7fb745600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74014e7b0 con 0x7fb7400d0490 2024-08-17T02:27:26.004 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.002+0000 7fb73ea00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7400adf00 0x7fb740099b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.004 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.002+0000 7fb73ea00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7400adf00 0x7fb740099b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:40662/0 (socket says 172.21.15.171:40662) 2024-08-17T02:27:26.004 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.002+0000 7fb73ea00640 1 -- 172.21.15.171:0/143554407 learned_addr learned my addr 172.21.15.171:0/143554407 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-08-17T02:27:26.004 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.002+0000 7fb73e000640 1 --2- 172.21.15.171:0/143554407 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7400d0490 0x7fb74009b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.004 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.002+0000 7fb73f400640 1 --2- 172.21.15.171:0/143554407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb740159200 0x7fb740151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.004 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.002+0000 7fb73e000640 1 -- 172.21.15.171:0/143554407 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7400adf00 msgr2=0x7fb740099b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.005 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.002+0000 7fb73e000640 1 --2- 172.21.15.171:0/143554407 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7400adf00 0x7fb740099b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.005 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.002+0000 7fb73e000640 1 -- 172.21.15.171:0/143554407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb740159200 msgr2=0x7fb740151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.005 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.002+0000 7fb73e000640 1 --2- 172.21.15.171:0/143554407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb740159200 0x7fb740151020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.005 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.003+0000 7fb73e000640 1 -- 172.21.15.171:0/143554407 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb738009a20 con 0x7fb7400d0490 2024-08-17T02:27:26.005 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.003+0000 7fb73ea00640 1 --2- 172.21.15.171:0/143554407 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7400adf00 0x7fb740099b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:26.005 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.003+0000 7fb73f400640 1 --2- 172.21.15.171:0/143554407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb740159200 0x7fb740151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:26.005 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.003+0000 7fb73e000640 1 --2- 172.21.15.171:0/143554407 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7400d0490 0x7fb74009b3d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00e960 tx=0x7fb72c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.005 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.003+0000 7fb736000640 1 -- 172.21.15.171:0/143554407 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c00c940 con 0x7fb7400d0490 2024-08-17T02:27:26.005 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.003+0000 7fb736000640 1 -- 172.21.15.171:0/143554407 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72c00caa0 con 0x7fb7400d0490 2024-08-17T02:27:26.005 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.003+0000 7fb745600640 1 -- 172.21.15.171:0/143554407 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb74014ea90 con 0x7fb7400d0490 2024-08-17T02:27:26.005 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.003+0000 7fb736000640 1 -- 172.21.15.171:0/143554407 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c00ce20 con 0x7fb7400d0490 2024-08-17T02:27:26.005 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.003+0000 7fb745600640 1 -- 172.21.15.171:0/143554407 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb74014f050 con 0x7fb7400d0490 2024-08-17T02:27:26.005 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.003+0000 7fb736000640 1 -- 172.21.15.171:0/143554407 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fb72c005970 con 0x7fb7400d0490 2024-08-17T02:27:26.005 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.003+0000 7fb736000640 1 -- 172.21.15.171:0/143554407 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fb72c013d90 con 0x7fb7400d0490 2024-08-17T02:27:26.006 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.004+0000 7fb745600640 1 -- 172.21.15.171:0/143554407 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb740071050 con 0x7fb7400d0490 2024-08-17T02:27:26.007 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.006+0000 7fb736000640 1 -- 172.21.15.171:0/143554407 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fb72c021060 con 0x7fb7400d0490 2024-08-17T02:27:26.081 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.081+0000 7fb745600640 1 -- 172.21.15.171:0/143554407 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "309520a4-205e-449a-98c6-2b1c58811ed8", "id": 1} v 0) v1 -- 0x7fb740068450 con 0x7fb7400d0490 2024-08-17T02:27:26.090 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.089+0000 7fb736000640 1 -- 172.21.15.171:0/143554407 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "309520a4-205e-449a-98c6-2b1c58811ed8", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb72c017070 con 0x7fb7400d0490 2024-08-17T02:27:26.090 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-08-17T02:27:26.091 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.090+0000 7fb745600640 1 -- 172.21.15.171:0/143554407 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7400d0490 msgr2=0x7fb74009b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.091 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.090+0000 7fb745600640 1 --2- 172.21.15.171:0/143554407 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7400d0490 0x7fb74009b3d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00e960 tx=0x7fb72c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.091 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.090+0000 7fb745600640 1 -- 172.21.15.171:0/143554407 shutdown_connections 2024-08-17T02:27:26.091 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.090+0000 7fb745600640 1 --2- 172.21.15.171:0/143554407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb740159200 0x7fb740151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.091 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.090+0000 7fb745600640 1 --2- 172.21.15.171:0/143554407 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb7400d0490 0x7fb74009b3d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.091 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.090+0000 7fb745600640 1 --2- 172.21.15.171:0/143554407 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7400adf00 0x7fb740099b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.091 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.090+0000 7fb745600640 1 -- 172.21.15.171:0/143554407 >> 172.21.15.171:0/143554407 conn(0x7fb74006eb90 msgr2=0x7fb740068970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:26.091 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.091+0000 7fb745600640 1 -- 172.21.15.171:0/143554407 shutdown_connections 2024-08-17T02:27:26.091 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.091+0000 7fb745600640 1 -- 172.21.15.171:0/143554407 wait complete. 2024-08-17T02:27:26.105 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 4fa92a94-7083-4644-a8e0-fbcb66361f21 2 2024-08-17T02:27:26.109 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-08-17T02:27:26.107+0000 7f2aff766ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:27:26.159 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-08-17T02:27:26.158+0000 7f2aff766ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:27:26.168 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-08-17T02:27:26.168+0000 7f34f446fec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:27:26.224 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-08-17T02:27:26.223+0000 7f34f446fec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:27:26.293 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.293+0000 7f6bab400640 1 Processor -- start 2024-08-17T02:27:26.294 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.293+0000 7f6bab400640 1 -- start start 2024-08-17T02:27:26.295 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.294+0000 7f6bab400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6ba40b2c40 0x7f6ba40b5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.295 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.294+0000 7f6bab400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ba4159010 0x7f6ba41629d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.295 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.294+0000 7f6bab400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba40ad8c0 con 0x7f6ba4158c40 2024-08-17T02:27:26.295 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.294+0000 7f6bab400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ba40ade80 con 0x7f6ba40b2c40 2024-08-17T02:27:26.295 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.294+0000 7f6bab400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba40af320 con 0x7f6ba4159010 2024-08-17T02:27:26.295 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.295+0000 7f6ba3e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6ba40b2c40 0x7f6ba40b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.295 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.295+0000 7f6ba9400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ba4159010 0x7f6ba41629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.295 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.295+0000 7f6ba8a00640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f6ba4158c40 0x7f6ba40b0860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:45298/0 (socket says 172.21.15.171:45298) 2024-08-17T02:27:26.295 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.295+0000 7f6ba8a00640 1 -- 172.21.15.171:0/1654523819 learned_addr learned my addr 172.21.15.171:0/1654523819 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-08-17T02:27:26.296 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.295+0000 7f6ba3e00640 1 -- 172.21.15.171:0/1654523819 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ba4159010 msgr2=0x7f6ba41629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:26.296 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.295+0000 7f6ba3e00640 1 --2- 172.21.15.171:0/1654523819 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ba4159010 0x7f6ba41629d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.296 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.295+0000 7f6ba3e00640 1 -- 172.21.15.171:0/1654523819 >> v1:172.21.15.171:6789/0 conn(0x7f6ba4158c40 legacy=0x7f6ba40b0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.296 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.295+0000 7f6ba3e00640 1 -- 172.21.15.171:0/1654523819 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba40b0180 con 0x7f6ba40b2c40 2024-08-17T02:27:26.296 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.295+0000 7f6ba9400640 1 --2- 172.21.15.171:0/1654523819 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ba4159010 0x7f6ba41629d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:26.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.296+0000 7f6ba3e00640 1 --2- 172.21.15.171:0/1654523819 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ba40b2c40 0x7f6ba40b5920 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009850 tx=0x7f6b900090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ca5ca3f7e6c4a13 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.296+0000 7f6ba3400640 1 -- 172.21.15.171:0/1654523819 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9002ad00 con 0x7f6ba40b2c40 2024-08-17T02:27:26.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.296+0000 7f6ba3400640 1 -- 172.21.15.171:0/1654523819 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9002ae60 con 0x7f6ba40b2c40 2024-08-17T02:27:26.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.296+0000 7f6ba3400640 1 -- 172.21.15.171:0/1654523819 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b90032670 con 0x7f6ba40b2c40 2024-08-17T02:27:26.298 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.297+0000 7f6bab400640 1 -- 172.21.15.171:0/1654523819 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ba40b2c40 msgr2=0x7f6ba40b5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.298 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.297+0000 7f6bab400640 1 --2- 172.21.15.171:0/1654523819 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ba40b2c40 0x7f6ba40b5920 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009850 tx=0x7f6b900090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.298 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.297+0000 7f6bab400640 1 -- 172.21.15.171:0/1654523819 shutdown_connections 2024-08-17T02:27:26.298 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.297+0000 7f6bab400640 1 --2- 172.21.15.171:0/1654523819 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ba4159010 0x7f6ba41629d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.298 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.297+0000 7f6bab400640 1 --2- 172.21.15.171:0/1654523819 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ba40b2c40 0x7f6ba40b5920 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.298 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.297+0000 7f6bab400640 1 -- 172.21.15.171:0/1654523819 >> 172.21.15.171:0/1654523819 conn(0x7f6ba40cfd80 msgr2=0x7f6ba40d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:26.298 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.297+0000 7f6bab400640 1 -- 172.21.15.171:0/1654523819 shutdown_connections 2024-08-17T02:27:26.298 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.297+0000 7f6bab400640 1 -- 172.21.15.171:0/1654523819 wait complete. 2024-08-17T02:27:26.299 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.299+0000 7f6bab400640 1 Processor -- start 2024-08-17T02:27:26.299 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.299+0000 7f6bab400640 1 -- start start 2024-08-17T02:27:26.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.300+0000 7f6bab400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ba40b2c40 0x7f6ba414acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.300+0000 7f6bab400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ba4158c40 0x7f6ba414d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.300+0000 7f6bab400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ba4159010 0x7f6ba416c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.300+0000 7f6bab400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba414bf60 con 0x7f6ba4158c40 2024-08-17T02:27:26.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.300+0000 7f6bab400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba414b350 con 0x7f6ba40b2c40 2024-08-17T02:27:26.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.300+0000 7f6bab400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba414b630 con 0x7f6ba4159010 2024-08-17T02:27:26.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.300+0000 7f6ba8a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ba40b2c40 0x7f6ba414acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.300+0000 7f6ba8a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ba40b2c40 0x7f6ba414acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:40678/0 (socket says 172.21.15.171:40678) 2024-08-17T02:27:26.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.300+0000 7f6ba8a00640 1 -- 172.21.15.171:0/3868090302 learned_addr learned my addr 172.21.15.171:0/3868090302 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-08-17T02:27:26.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.300+0000 7f6ba9400640 1 --2- 172.21.15.171:0/3868090302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ba4159010 0x7f6ba416c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.300+0000 7f6ba3e00640 1 --2- 172.21.15.171:0/3868090302 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ba4158c40 0x7f6ba414d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.300+0000 7f6ba8a00640 1 -- 172.21.15.171:0/3868090302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ba4159010 msgr2=0x7f6ba416c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.300+0000 7f6ba8a00640 1 --2- 172.21.15.171:0/3868090302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ba4159010 0x7f6ba416c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.300+0000 7f6ba8a00640 1 -- 172.21.15.171:0/3868090302 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ba4158c40 msgr2=0x7f6ba414d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.300+0000 7f6ba8a00640 1 --2- 172.21.15.171:0/3868090302 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ba4158c40 0x7f6ba414d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.300+0000 7f6ba8a00640 1 -- 172.21.15.171:0/3868090302 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9c009a20 con 0x7f6ba40b2c40 2024-08-17T02:27:26.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.301+0000 7f6ba8a00640 1 --2- 172.21.15.171:0/3868090302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ba40b2c40 0x7f6ba414acc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800c590 tx=0x7f6b98007ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.303 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.301+0000 7f6b97e00640 1 -- 172.21.15.171:0/3868090302 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b98005aa0 con 0x7f6ba40b2c40 2024-08-17T02:27:26.303 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.301+0000 7f6b97e00640 1 -- 172.21.15.171:0/3868090302 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b98005c20 con 0x7f6ba40b2c40 2024-08-17T02:27:26.303 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.301+0000 7f6b97e00640 1 -- 172.21.15.171:0/3868090302 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b980070d0 con 0x7f6ba40b2c40 2024-08-17T02:27:26.303 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.301+0000 7f6bab400640 1 -- 172.21.15.171:0/3868090302 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b90009390 con 0x7f6ba40b2c40 2024-08-17T02:27:26.303 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.301+0000 7f6bab400640 1 -- 172.21.15.171:0/3868090302 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba414bbf0 con 0x7f6ba40b2c40 2024-08-17T02:27:26.303 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.301+0000 7f6b97e00640 1 -- 172.21.15.171:0/3868090302 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f6b98007520 con 0x7f6ba40b2c40 2024-08-17T02:27:26.303 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.301+0000 7f6b97e00640 1 -- 172.21.15.171:0/3868090302 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f6b98005670 con 0x7f6ba40b2c40 2024-08-17T02:27:26.303 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.302+0000 7f6bab400640 1 -- 172.21.15.171:0/3868090302 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba4071050 con 0x7f6ba40b2c40 2024-08-17T02:27:26.305 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.305+0000 7f6b97e00640 1 -- 172.21.15.171:0/3868090302 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f6b98005030 con 0x7f6ba40b2c40 2024-08-17T02:27:26.378 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.378+0000 7f6bab400640 1 -- 172.21.15.171:0/3868090302 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4fa92a94-7083-4644-a8e0-fbcb66361f21", "id": 2} v 0) v1 -- 0x7f6ba40b4da0 con 0x7f6ba40b2c40 2024-08-17T02:27:26.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.386+0000 7f6b97e00640 1 -- 172.21.15.171:0/3868090302 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4fa92a94-7083-4644-a8e0-fbcb66361f21", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6b98005290 con 0x7f6ba40b2c40 2024-08-17T02:27:26.387 INFO:teuthology.orchestra.run.smithi171.stdout:2 2024-08-17T02:27:26.388 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.387+0000 7f6bab400640 1 -- 172.21.15.171:0/3868090302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ba40b2c40 msgr2=0x7f6ba414acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.388 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.387+0000 7f6bab400640 1 --2- 172.21.15.171:0/3868090302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ba40b2c40 0x7f6ba414acc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800c590 tx=0x7f6b98007ee0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.388 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.387+0000 7f6bab400640 1 -- 172.21.15.171:0/3868090302 shutdown_connections 2024-08-17T02:27:26.388 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.387+0000 7f6bab400640 1 --2- 172.21.15.171:0/3868090302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6ba4159010 0x7f6ba416c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.388 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.387+0000 7f6bab400640 1 --2- 172.21.15.171:0/3868090302 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ba4158c40 0x7f6ba414d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.388 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.387+0000 7f6bab400640 1 --2- 172.21.15.171:0/3868090302 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6ba40b2c40 0x7f6ba414acc0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.388 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.387+0000 7f6bab400640 1 -- 172.21.15.171:0/3868090302 >> 172.21.15.171:0/3868090302 conn(0x7f6ba40cfd80 msgr2=0x7f6ba4153c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:26.388 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.387+0000 7f6bab400640 1 -- 172.21.15.171:0/3868090302 shutdown_connections 2024-08-17T02:27:26.388 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.388+0000 7f6bab400640 1 -- 172.21.15.171:0/3868090302 wait complete. 2024-08-17T02:27:26.401 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 34cdc20c-f3aa-4b7e-9b2c-55920832ca9c 3 2024-08-17T02:27:26.587 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.586+0000 7fe249800640 1 Processor -- start 2024-08-17T02:27:26.587 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.586+0000 7fe249800640 1 -- start start 2024-08-17T02:27:26.588 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.587+0000 7fe249800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe244159f60 0x7fe2440cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.587+0000 7fe249800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe2440ceb40 0x7fe2440ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.587+0000 7fe249800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2440cadc0 con 0x7fe244159b90 2024-08-17T02:27:26.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.587+0000 7fe249800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2440cb880 con 0x7fe2440ceb40 2024-08-17T02:27:26.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.587+0000 7fe249800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2440cd6e0 con 0x7fe244159f60 2024-08-17T02:27:26.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.588+0000 7fe243e00640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fe244159b90 0x7fe2440ca360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:45304/0 (socket says 172.21.15.171:45304) 2024-08-17T02:27:26.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.588+0000 7fe243e00640 1 -- 172.21.15.171:0/3949134861 learned_addr learned my addr 172.21.15.171:0/3949134861 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-08-17T02:27:26.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.588+0000 7fe243400640 1 --2- 172.21.15.171:0/3949134861 >> v2:172.21.15.171:3300/0 conn(0x7fe244159f60 0x7fe2440cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.588+0000 7fe248e00640 1 --2- 172.21.15.171:0/3949134861 >> v2:172.21.15.106:3300/0 conn(0x7fe2440ceb40 0x7fe2440ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.588+0000 7fe242a00640 1 -- 172.21.15.171:0/3949134861 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1390844379 0 0) 0x7fe2440cadc0 con 0x7fe244159b90 2024-08-17T02:27:26.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.588+0000 7fe243400640 1 -- 172.21.15.171:0/3949134861 >> v2:172.21.15.106:3300/0 conn(0x7fe2440ceb40 msgr2=0x7fe2440ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:26.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.588+0000 7fe243400640 1 --2- 172.21.15.171:0/3949134861 >> v2:172.21.15.106:3300/0 conn(0x7fe2440ceb40 0x7fe2440ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.588+0000 7fe243400640 1 -- 172.21.15.171:0/3949134861 >> v1:172.21.15.171:6789/0 conn(0x7fe244159b90 legacy=0x7fe2440ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.588+0000 7fe243400640 1 -- 172.21.15.171:0/3949134861 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2440cb060 con 0x7fe244159f60 2024-08-17T02:27:26.590 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.590+0000 7fe243400640 1 --2- 172.21.15.171:0/3949134861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe244159f60 0x7fe2440cc590 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe24409d9c0 tx=0x7fe2300090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a6e37ab6a5b339d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.590 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.590+0000 7fe242a00640 1 -- 172.21.15.171:0/3949134861 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23002adb0 con 0x7fe244159f60 2024-08-17T02:27:26.591 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.590+0000 7fe242a00640 1 -- 172.21.15.171:0/3949134861 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe230032440 con 0x7fe244159f60 2024-08-17T02:27:26.591 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.590+0000 7fe242a00640 1 -- 172.21.15.171:0/3949134861 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2300327e0 con 0x7fe244159f60 2024-08-17T02:27:26.591 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.591+0000 7fe249800640 1 -- 172.21.15.171:0/3949134861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe244159f60 msgr2=0x7fe2440cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.592 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.591+0000 7fe249800640 1 --2- 172.21.15.171:0/3949134861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe244159f60 0x7fe2440cc590 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe24409d9c0 tx=0x7fe2300090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.592 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.591+0000 7fe249800640 1 -- 172.21.15.171:0/3949134861 shutdown_connections 2024-08-17T02:27:26.592 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.591+0000 7fe249800640 1 --2- 172.21.15.171:0/3949134861 >> v2:172.21.15.106:3300/0 conn(0x7fe2440ceb40 0x7fe2440ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.592 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.591+0000 7fe249800640 1 --2- 172.21.15.171:0/3949134861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe244159f60 0x7fe2440cc590 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.592 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.591+0000 7fe249800640 1 -- 172.21.15.171:0/3949134861 >> 172.21.15.171:0/3949134861 conn(0x7fe244098e00 msgr2=0x7fe24406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:26.592 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.591+0000 7fe249800640 1 -- 172.21.15.171:0/3949134861 shutdown_connections 2024-08-17T02:27:26.592 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.591+0000 7fe249800640 1 -- 172.21.15.171:0/3949134861 wait complete. 2024-08-17T02:27:26.592 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.592+0000 7fe249800640 1 Processor -- start 2024-08-17T02:27:26.593 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.592+0000 7fe249800640 1 -- start start 2024-08-17T02:27:26.594 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.593+0000 7fe249800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2440ceb40 0x7fe2440b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.595 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.593+0000 7fe249800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe244159b90 0x7fe2441684a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.595 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.593+0000 7fe249800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe244159f60 0x7fe2441544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.595 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.593+0000 7fe249800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2440c89d0 con 0x7fe244159b90 2024-08-17T02:27:26.595 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.593+0000 7fe249800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2440c7dc0 con 0x7fe244159f60 2024-08-17T02:27:26.595 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.593+0000 7fe249800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2440c80a0 con 0x7fe2440ceb40 2024-08-17T02:27:26.595 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.594+0000 7fe243e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2440ceb40 0x7fe2440b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.595 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.594+0000 7fe248e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe244159f60 0x7fe2441544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.595 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.594+0000 7fe243e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2440ceb40 0x7fe2440b44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:33968/0 (socket says 172.21.15.171:33968) 2024-08-17T02:27:26.595 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.594+0000 7fe243e00640 1 -- 172.21.15.171:0/1719969038 learned_addr learned my addr 172.21.15.171:0/1719969038 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-08-17T02:27:26.595 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.594+0000 7fe243400640 1 --2- 172.21.15.171:0/1719969038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe244159b90 0x7fe2441684a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.595 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.594+0000 7fe248e00640 1 -- 172.21.15.171:0/1719969038 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2440ceb40 msgr2=0x7fe2440b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.595 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.594+0000 7fe248e00640 1 --2- 172.21.15.171:0/1719969038 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2440ceb40 0x7fe2440b44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.595 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.594+0000 7fe248e00640 1 -- 172.21.15.171:0/1719969038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe244159b90 msgr2=0x7fe2441684a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.596 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.594+0000 7fe248e00640 1 --2- 172.21.15.171:0/1719969038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe244159b90 0x7fe2441684a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.596 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.594+0000 7fe248e00640 1 -- 172.21.15.171:0/1719969038 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe230009390 con 0x7fe244159f60 2024-08-17T02:27:26.596 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.594+0000 7fe248e00640 1 --2- 172.21.15.171:0/1719969038 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe244159f60 0x7fe2441544a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe23c009e50 tx=0x7fe23c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.597 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.595+0000 7fe23b400640 1 -- 172.21.15.171:0/1719969038 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c00cd40 con 0x7fe244159f60 2024-08-17T02:27:26.597 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.595+0000 7fe23b400640 1 -- 172.21.15.171:0/1719969038 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23c00f040 con 0x7fe244159f60 2024-08-17T02:27:26.597 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.595+0000 7fe23b400640 1 -- 172.21.15.171:0/1719969038 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c00cea0 con 0x7fe244159f60 2024-08-17T02:27:26.597 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.595+0000 7fe249800640 1 -- 172.21.15.171:0/1719969038 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2440c8380 con 0x7fe244159f60 2024-08-17T02:27:26.597 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.595+0000 7fe249800640 1 -- 172.21.15.171:0/1719969038 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2440c35f0 con 0x7fe244159f60 2024-08-17T02:27:26.597 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.595+0000 7fe23b400640 1 -- 172.21.15.171:0/1719969038 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fe23c014b70 con 0x7fe244159f60 2024-08-17T02:27:26.597 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.595+0000 7fe23b400640 1 -- 172.21.15.171:0/1719969038 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fe23c01de40 con 0x7fe244159f60 2024-08-17T02:27:26.597 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.596+0000 7fe249800640 1 -- 172.21.15.171:0/1719969038 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe244071050 con 0x7fe244159f60 2024-08-17T02:27:26.598 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.598+0000 7fe23b400640 1 -- 172.21.15.171:0/1719969038 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fe23c03b7a0 con 0x7fe244159f60 2024-08-17T02:27:26.672 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.672+0000 7fe249800640 1 -- 172.21.15.171:0/1719969038 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "34cdc20c-f3aa-4b7e-9b2c-55920832ca9c", "id": 3} v 0) v1 -- 0x7fe2440cc230 con 0x7fe244159f60 2024-08-17T02:27:26.680 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.680+0000 7fe23b400640 1 -- 172.21.15.171:0/1719969038 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "34cdc20c-f3aa-4b7e-9b2c-55920832ca9c", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe23c02a070 con 0x7fe244159f60 2024-08-17T02:27:26.681 INFO:teuthology.orchestra.run.smithi171.stdout:3 2024-08-17T02:27:26.682 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.681+0000 7fe249800640 1 -- 172.21.15.171:0/1719969038 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe244159f60 msgr2=0x7fe2441544a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.682 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.681+0000 7fe249800640 1 --2- 172.21.15.171:0/1719969038 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe244159f60 0x7fe2441544a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe23c009e50 tx=0x7fe23c00b040 comp rx=0 tx=0).stop 2024-08-17T02:27:26.682 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.681+0000 7fe249800640 1 -- 172.21.15.171:0/1719969038 shutdown_connections 2024-08-17T02:27:26.682 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.681+0000 7fe249800640 1 --2- 172.21.15.171:0/1719969038 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe244159f60 0x7fe2441544a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.682 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.681+0000 7fe249800640 1 --2- 172.21.15.171:0/1719969038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe244159b90 0x7fe2441684a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.682 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.681+0000 7fe249800640 1 --2- 172.21.15.171:0/1719969038 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2440ceb40 0x7fe2440b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.682 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.681+0000 7fe249800640 1 -- 172.21.15.171:0/1719969038 >> 172.21.15.171:0/1719969038 conn(0x7fe244098e00 msgr2=0x7fe2440cc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:26.682 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.681+0000 7fe249800640 1 -- 172.21.15.171:0/1719969038 shutdown_connections 2024-08-17T02:27:26.683 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.681+0000 7fe249800640 1 -- 172.21.15.171:0/1719969038 wait complete. 2024-08-17T02:27:26.696 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 2395e0bc-014d-4388-a765-0943301a9892 4 2024-08-17T02:27:26.856 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.855+0000 7f755b600640 1 Processor -- start 2024-08-17T02:27:26.856 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.855+0000 7f755b600640 1 -- start start 2024-08-17T02:27:26.857 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.857+0000 7f755b600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7554158de0 0x7f75540cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.857 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.857+0000 7f755b600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f75541591b0 0x7f75540cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.857+0000 7f755b600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75540cd950 con 0x7f7554068600 2024-08-17T02:27:26.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.857+0000 7f755b600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75540ac3d0 con 0x7f75541591b0 2024-08-17T02:27:26.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.857+0000 7f755b600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75540ccf80 con 0x7f7554158de0 2024-08-17T02:27:26.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.857+0000 7f7558c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7554158de0 0x7f75540cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.857+0000 7f7558c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7554158de0 0x7f75540cd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:40706/0 (socket says 172.21.15.171:40706) 2024-08-17T02:27:26.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.857+0000 7f7558c00640 1 -- 172.21.15.171:0/2863654112 learned_addr learned my addr 172.21.15.171:0/2863654112 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-08-17T02:27:26.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.857+0000 7f7559600640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f7554068600 0x7f7554068a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:45310/0 (socket says 172.21.15.171:45310) 2024-08-17T02:27:26.858 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.857+0000 7f7553e00640 1 --2- 172.21.15.171:0/2863654112 >> v2:172.21.15.106:3300/0 conn(0x7f75541591b0 0x7f75540cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.859 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.857+0000 7f7558c00640 1 -- 172.21.15.171:0/2863654112 >> v2:172.21.15.106:3300/0 conn(0x7f75541591b0 msgr2=0x7f75540cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:26.861 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.857+0000 7f7558c00640 1 --2- 172.21.15.171:0/2863654112 >> v2:172.21.15.106:3300/0 conn(0x7f75541591b0 0x7f75540cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.861 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.857+0000 7f7558c00640 1 -- 172.21.15.171:0/2863654112 >> v1:172.21.15.171:6789/0 conn(0x7f7554068600 legacy=0x7f7554068a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.861 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.857+0000 7f7558c00640 1 -- 172.21.15.171:0/2863654112 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75540cc370 con 0x7f7554158de0 2024-08-17T02:27:26.861 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.857+0000 7f7553400640 1 -- 172.21.15.171:0/2863654112 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677365327 0 0) 0x7f754c001490 con 0x7f7554068600 2024-08-17T02:27:26.864 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.859+0000 7f7558c00640 1 --2- 172.21.15.171:0/2863654112 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7554158de0 0x7f75540cd410 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f755406d2e0 tx=0x7f75480091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b32ff7e6d7bba2c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.864 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.859+0000 7f7553400640 1 -- 172.21.15.171:0/2863654112 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754802ae80 con 0x7f7554158de0 2024-08-17T02:27:26.864 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.859+0000 7f7553400640 1 -- 172.21.15.171:0/2863654112 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7548032440 con 0x7f7554158de0 2024-08-17T02:27:26.864 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.859+0000 7f7553400640 1 -- 172.21.15.171:0/2863654112 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75480327c0 con 0x7f7554158de0 2024-08-17T02:27:26.864 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.860+0000 7f755b600640 1 -- 172.21.15.171:0/2863654112 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7554158de0 msgr2=0x7f75540cd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.864 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.860+0000 7f755b600640 1 --2- 172.21.15.171:0/2863654112 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7554158de0 0x7f75540cd410 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f755406d2e0 tx=0x7f75480091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.864 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.860+0000 7f755b600640 1 -- 172.21.15.171:0/2863654112 shutdown_connections 2024-08-17T02:27:26.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.860+0000 7f755b600640 1 --2- 172.21.15.171:0/2863654112 >> v2:172.21.15.106:3300/0 conn(0x7f75541591b0 0x7f75540cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.860+0000 7f755b600640 1 --2- 172.21.15.171:0/2863654112 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7554158de0 0x7f75540cd410 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.860+0000 7f755b600640 1 -- 172.21.15.171:0/2863654112 >> 172.21.15.171:0/2863654112 conn(0x7f7554096a70 msgr2=0x7f7554096e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:26.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.860+0000 7f755b600640 1 -- 172.21.15.171:0/2863654112 shutdown_connections 2024-08-17T02:27:26.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.860+0000 7f755b600640 1 -- 172.21.15.171:0/2863654112 wait complete. 2024-08-17T02:27:26.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.862+0000 7f755b600640 1 Processor -- start 2024-08-17T02:27:26.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.862+0000 7f755b600640 1 -- start start 2024-08-17T02:27:26.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.863+0000 7f755b600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7554068600 0x7f75540afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.863+0000 7f755b600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7554158de0 0x7f755416c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.863+0000 7f755b600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f75541591b0 0x7f755416ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:26.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.863+0000 7f755b600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7554158880 con 0x7f7554068600 2024-08-17T02:27:26.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.863+0000 7f755b600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755416d020 con 0x7f7554158de0 2024-08-17T02:27:26.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.863+0000 7f755b600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755415d640 con 0x7f75541591b0 2024-08-17T02:27:26.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.863+0000 7f7559600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f75541591b0 0x7f755416ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.863+0000 7f7553e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7554158de0 0x7f755416c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.863+0000 7f7553e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7554158de0 0x7f755416c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:40714/0 (socket says 172.21.15.171:40714) 2024-08-17T02:27:26.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.863+0000 7f7553e00640 1 -- 172.21.15.171:0/2951538597 learned_addr learned my addr 172.21.15.171:0/2951538597 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-08-17T02:27:26.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.863+0000 7f7558c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7554068600 0x7f75540afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:26.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.863+0000 7f7559600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f75541591b0 0x7f755416ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:33982/0 (socket says 172.21.15.171:33982) 2024-08-17T02:27:26.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.864+0000 7f7553e00640 1 -- 172.21.15.171:0/2951538597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f75541591b0 msgr2=0x7f755416ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.864+0000 7f7553e00640 1 --2- 172.21.15.171:0/2951538597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f75541591b0 0x7f755416ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.864+0000 7f7553e00640 1 -- 172.21.15.171:0/2951538597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7554068600 msgr2=0x7f75540afe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.864+0000 7f7553e00640 1 --2- 172.21.15.171:0/2951538597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7554068600 0x7f75540afe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.864+0000 7f7553e00640 1 -- 172.21.15.171:0/2951538597 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7548009450 con 0x7f7554158de0 2024-08-17T02:27:26.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.864+0000 7f7558c00640 1 --2- 172.21.15.171:0/2951538597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7554068600 0x7f75540afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:26.866 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.864+0000 7f7553e00640 1 --2- 172.21.15.171:0/2951538597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7554158de0 0x7f755416c4d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f754000ea20 tx=0x7f75400090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:26.868 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.864+0000 7f7547e00640 1 -- 172.21.15.171:0/2951538597 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754000ca10 con 0x7f7554158de0 2024-08-17T02:27:26.868 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.864+0000 7f7547e00640 1 -- 172.21.15.171:0/2951538597 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754000cb70 con 0x7f7554158de0 2024-08-17T02:27:26.868 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.864+0000 7f755b600640 1 -- 172.21.15.171:0/2951538597 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755415d920 con 0x7f7554158de0 2024-08-17T02:27:26.868 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.864+0000 7f7547e00640 1 -- 172.21.15.171:0/2951538597 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7540013470 con 0x7f7554158de0 2024-08-17T02:27:26.868 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.864+0000 7f755b600640 1 -- 172.21.15.171:0/2951538597 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75540b0340 con 0x7f7554158de0 2024-08-17T02:27:26.868 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.865+0000 7f7547e00640 1 -- 172.21.15.171:0/2951538597 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f7540005970 con 0x7f7554158de0 2024-08-17T02:27:26.868 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.865+0000 7f7547e00640 1 -- 172.21.15.171:0/2951538597 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f7540005c20 con 0x7f7554158de0 2024-08-17T02:27:26.868 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.865+0000 7f755b600640 1 -- 172.21.15.171:0/2951538597 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f755415dda0 con 0x7f7554158de0 2024-08-17T02:27:26.868 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.868+0000 7f7547e00640 1 -- 172.21.15.171:0/2951538597 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f7540021060 con 0x7f7554158de0 2024-08-17T02:27:26.943 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.943+0000 7f755b600640 1 -- 172.21.15.171:0/2951538597 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2395e0bc-014d-4388-a765-0943301a9892", "id": 4} v 0) v1 -- 0x7f7554071050 con 0x7f7554158de0 2024-08-17T02:27:26.951 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.951+0000 7f7547e00640 1 -- 172.21.15.171:0/2951538597 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2395e0bc-014d-4388-a765-0943301a9892", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7540029020 con 0x7f7554158de0 2024-08-17T02:27:26.951 INFO:teuthology.orchestra.run.smithi171.stdout:4 2024-08-17T02:27:26.952 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.952+0000 7f755b600640 1 -- 172.21.15.171:0/2951538597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7554158de0 msgr2=0x7f755416c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:26.952 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.952+0000 7f755b600640 1 --2- 172.21.15.171:0/2951538597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7554158de0 0x7f755416c4d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f754000ea20 tx=0x7f75400090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.953 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.952+0000 7f755b600640 1 -- 172.21.15.171:0/2951538597 shutdown_connections 2024-08-17T02:27:26.953 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.952+0000 7f755b600640 1 --2- 172.21.15.171:0/2951538597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f75541591b0 0x7f755416ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.953 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.952+0000 7f755b600640 1 --2- 172.21.15.171:0/2951538597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7554158de0 0x7f755416c4d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.953 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.952+0000 7f755b600640 1 --2- 172.21.15.171:0/2951538597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7554068600 0x7f75540afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:26.953 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.952+0000 7f755b600640 1 -- 172.21.15.171:0/2951538597 >> 172.21.15.171:0/2951538597 conn(0x7f7554096a70 msgr2=0x7f75540b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:26.953 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.952+0000 7f755b600640 1 -- 172.21.15.171:0/2951538597 shutdown_connections 2024-08-17T02:27:26.953 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:26.952+0000 7f755b600640 1 -- 172.21.15.171:0/2951538597 wait complete. 2024-08-17T02:27:26.966 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new f3ca27a0-7b37-4628-9af5-171467554bc3 5 2024-08-17T02:27:27.000 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-08-17T02:27:26.998+0000 7f2aff766ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:27:27.095 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-08-17T02:27:27.093+0000 7f2aff766ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:27:27.109 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-08-17T02:27:27.109+0000 7f34f446fec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:27:27.112 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.111+0000 7f5be8a00640 1 Processor -- start 2024-08-17T02:27:27.112 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.112+0000 7f5be8a00640 1 -- start start 2024-08-17T02:27:27.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.113+0000 7f5be8a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5be4158ea0 0x7f5be40d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.113+0000 7f5be8a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5be40d09a0 0x7f5be40ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.113+0000 7f5be8a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be406f240 con 0x7f5be40ca830 2024-08-17T02:27:27.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.113+0000 7f5be8a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be40c6f20 con 0x7f5be4158ea0 2024-08-17T02:27:27.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.113+0000 7f5be8a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be40cacb0 con 0x7f5be40d09a0 2024-08-17T02:27:27.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.113+0000 7f5be1400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5be40d09a0 0x7f5be40ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.113+0000 7f5be1e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5be4158ea0 0x7f5be40d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.113+0000 7f5be1400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5be40d09a0 0x7f5be40ca2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:33988/0 (socket says 172.21.15.171:33988) 2024-08-17T02:27:27.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.113+0000 7f5be1400640 1 -- 172.21.15.171:0/564445388 learned_addr learned my addr 172.21.15.171:0/564445388 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-08-17T02:27:27.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.113+0000 7f5be1400640 1 -- 172.21.15.171:0/564445388 >> v2:172.21.15.171:3300/0 conn(0x7f5be4158ea0 msgr2=0x7f5be40d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:27.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.113+0000 7f5be1400640 1 --2- 172.21.15.171:0/564445388 >> v2:172.21.15.171:3300/0 conn(0x7f5be4158ea0 0x7f5be40d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.114 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.113+0000 7f5be1400640 1 -- 172.21.15.171:0/564445388 >> v1:172.21.15.106:6789/0 conn(0x7f5be40ca830 legacy=0x7f5be40cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.113+0000 7f5be1400640 1 -- 172.21.15.171:0/564445388 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be40cf410 con 0x7f5be40d09a0 2024-08-17T02:27:27.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.114+0000 7f5be1400640 1 --2- 172.21.15.171:0/564445388 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5be40d09a0 0x7f5be40ca2f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0009910 tx=0x7f5bd00091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f82faac7a22f8687 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.115+0000 7f5be0a00640 1 -- 172.21.15.171:0/564445388 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd002add0 con 0x7f5be40d09a0 2024-08-17T02:27:27.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.115+0000 7f5be0a00640 1 -- 172.21.15.171:0/564445388 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd0032440 con 0x7f5be40d09a0 2024-08-17T02:27:27.115 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.115+0000 7f5be0a00640 1 -- 172.21.15.171:0/564445388 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0032820 con 0x7f5be40d09a0 2024-08-17T02:27:27.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.115+0000 7f5be8a00640 1 -- 172.21.15.171:0/564445388 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5be40d09a0 msgr2=0x7f5be40ca2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.115+0000 7f5be8a00640 1 --2- 172.21.15.171:0/564445388 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5be40d09a0 0x7f5be40ca2f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0009910 tx=0x7f5bd00091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.115+0000 7f5be8a00640 1 -- 172.21.15.171:0/564445388 shutdown_connections 2024-08-17T02:27:27.116 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.115+0000 7f5be8a00640 1 --2- 172.21.15.171:0/564445388 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5be40d09a0 0x7f5be40ca2f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.117 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.115+0000 7f5be8a00640 1 --2- 172.21.15.171:0/564445388 >> v2:172.21.15.171:3300/0 conn(0x7f5be4158ea0 0x7f5be40d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.117 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.115+0000 7f5be8a00640 1 -- 172.21.15.171:0/564445388 >> 172.21.15.171:0/564445388 conn(0x7f5be406eb90 msgr2=0x7f5be40cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:27.117 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.116+0000 7f5be8a00640 1 -- 172.21.15.171:0/564445388 shutdown_connections 2024-08-17T02:27:27.117 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.116+0000 7f5be8a00640 1 -- 172.21.15.171:0/564445388 wait complete. 2024-08-17T02:27:27.117 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.117+0000 7f5be8a00640 1 Processor -- start 2024-08-17T02:27:27.117 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.117+0000 7f5be8a00640 1 -- start start 2024-08-17T02:27:27.120 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.118+0000 7f5be8a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5be40ca830 0x7f5be4157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.120 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.118+0000 7f5be8a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5be40d09a0 0x7f5be415df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.120 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.118+0000 7f5be8a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5be4158ea0 0x7f5be415e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.120 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.118+0000 7f5be8a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be40c3be0 con 0x7f5be4158ea0 2024-08-17T02:27:27.120 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.118+0000 7f5be8a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be415ed50 con 0x7f5be40ca830 2024-08-17T02:27:27.120 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.118+0000 7f5be8a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be415f030 con 0x7f5be40d09a0 2024-08-17T02:27:27.120 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.118+0000 7f5be1400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5be40d09a0 0x7f5be415df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.120 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.118+0000 7f5be1e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5be40ca830 0x7f5be4157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.120 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.118+0000 7f5be1400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5be40d09a0 0x7f5be415df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:33996/0 (socket says 172.21.15.171:33996) 2024-08-17T02:27:27.121 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.118+0000 7f5be1400640 1 -- 172.21.15.171:0/1610676949 learned_addr learned my addr 172.21.15.171:0/1610676949 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-08-17T02:27:27.121 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.118+0000 7f5be1e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5be40ca830 0x7f5be4157280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:40740/0 (socket says 172.21.15.171:40740) 2024-08-17T02:27:27.121 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.118+0000 7f5be2800640 1 --2- 172.21.15.171:0/1610676949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5be4158ea0 0x7f5be415e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.121 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.118+0000 7f5be1400640 1 -- 172.21.15.171:0/1610676949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5be40ca830 msgr2=0x7f5be4157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.121 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.119+0000 7f5be1400640 1 --2- 172.21.15.171:0/1610676949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5be40ca830 0x7f5be4157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.121 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.119+0000 7f5be1400640 1 -- 172.21.15.171:0/1610676949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5be4158ea0 msgr2=0x7f5be415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.121 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.119+0000 7f5be1400640 1 --2- 172.21.15.171:0/1610676949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5be4158ea0 0x7f5be415e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.121 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.119+0000 7f5be1400640 1 -- 172.21.15.171:0/1610676949 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd0009450 con 0x7f5be40d09a0 2024-08-17T02:27:27.121 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.119+0000 7f5be1e00640 1 --2- 172.21.15.171:0/1610676949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5be40ca830 0x7f5be4157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:27.121 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.119+0000 7f5be1400640 1 --2- 172.21.15.171:0/1610676949 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5be40d09a0 0x7f5be415df00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0035040 tx=0x7f5bd0032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.121 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.119+0000 7f5bd9600640 1 -- 172.21.15.171:0/1610676949 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0031c80 con 0x7f5be40d09a0 2024-08-17T02:27:27.121 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.119+0000 7f5bd9600640 1 -- 172.21.15.171:0/1610676949 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd0031e40 con 0x7f5be40d09a0 2024-08-17T02:27:27.121 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.119+0000 7f5be8a00640 1 -- 172.21.15.171:0/1610676949 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be415f310 con 0x7f5be40d09a0 2024-08-17T02:27:27.121 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.119+0000 7f5bd9600640 1 -- 172.21.15.171:0/1610676949 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd003d670 con 0x7f5be40d09a0 2024-08-17T02:27:27.121 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.119+0000 7f5be8a00640 1 -- 172.21.15.171:0/1610676949 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be41577c0 con 0x7f5be40d09a0 2024-08-17T02:27:27.122 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.119+0000 7f5bd9600640 1 -- 172.21.15.171:0/1610676949 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f5bd0039040 con 0x7f5be40d09a0 2024-08-17T02:27:27.122 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.120+0000 7f5bd9600640 1 -- 172.21.15.171:0/1610676949 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f5bd003dde0 con 0x7f5be40d09a0 2024-08-17T02:27:27.122 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.121+0000 7f5be8a00640 1 -- 172.21.15.171:0/1610676949 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be40c3e00 con 0x7f5be40d09a0 2024-08-17T02:27:27.123 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.123+0000 7f5bd9600640 1 -- 172.21.15.171:0/1610676949 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f5be40c3e00 con 0x7f5be40d09a0 2024-08-17T02:27:27.144 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-08-17T02:27:27.142+0000 7f2aff766ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:27:27.214 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.214+0000 7f5be8a00640 1 -- 172.21.15.171:0/1610676949 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f3ca27a0-7b37-4628-9af5-171467554bc3", "id": 5} v 0) v1 -- 0x7f5be415f170 con 0x7f5be40d09a0 2024-08-17T02:27:27.222 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.222+0000 7f5bd9600640 1 -- 172.21.15.171:0/1610676949 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f3ca27a0-7b37-4628-9af5-171467554bc3", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5be415f170 con 0x7f5be40d09a0 2024-08-17T02:27:27.222 INFO:teuthology.orchestra.run.smithi171.stdout:5 2024-08-17T02:27:27.223 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.223+0000 7f5be8a00640 1 -- 172.21.15.171:0/1610676949 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5be40d09a0 msgr2=0x7f5be415df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.223 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.223+0000 7f5be8a00640 1 --2- 172.21.15.171:0/1610676949 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5be40d09a0 0x7f5be415df00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0035040 tx=0x7f5bd0032000 comp rx=0 tx=0).stop 2024-08-17T02:27:27.223 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.223+0000 7f5be8a00640 1 -- 172.21.15.171:0/1610676949 shutdown_connections 2024-08-17T02:27:27.223 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.223+0000 7f5be8a00640 1 --2- 172.21.15.171:0/1610676949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5be4158ea0 0x7f5be415e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.223 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.223+0000 7f5be8a00640 1 --2- 172.21.15.171:0/1610676949 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5be40d09a0 0x7f5be415df00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.223 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.223+0000 7f5be8a00640 1 --2- 172.21.15.171:0/1610676949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5be40ca830 0x7f5be4157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.223 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.223+0000 7f5be8a00640 1 -- 172.21.15.171:0/1610676949 >> 172.21.15.171:0/1610676949 conn(0x7f5be406eb90 msgr2=0x7f5be4157e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:27.224 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.223+0000 7f5be8a00640 1 -- 172.21.15.171:0/1610676949 shutdown_connections 2024-08-17T02:27:27.224 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.223+0000 7f5be8a00640 1 -- 172.21.15.171:0/1610676949 wait complete. 2024-08-17T02:27:27.228 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-08-17T02:27:27.228+0000 7f34f446fec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:27:27.237 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 8c0f2592-fabc-42b7-9b56-cdbc7045a468 6 2024-08-17T02:27:27.281 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-08-17T02:27:27.280+0000 7f34f446fec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:27:27.308 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-08-17T02:27:27.306+0000 7f2aff766ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:27:27.367 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-08-17T02:27:27.366+0000 7f2aff766ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:27:27.381 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.381+0000 7f7f14c00640 1 Processor -- start 2024-08-17T02:27:27.382 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.381+0000 7f7f14c00640 1 -- start start 2024-08-17T02:27:27.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.382+0000 7f7f14c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7f100b2c40 0x7f7f100b5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.382+0000 7f7f14c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f100ad8c0 con 0x7f7f10158c40 2024-08-17T02:27:27.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.383+0000 7f7f14c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f100ade80 con 0x7f7f10159010 2024-08-17T02:27:27.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.383+0000 7f7f14c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f100af320 con 0x7f7f100b2c40 2024-08-17T02:27:27.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.383+0000 7f7f07e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7f100b2c40 0x7f7f100b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.383+0000 7f7f0e800640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f7f10159010 0x7f7f101629d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:45324/0 (socket says 172.21.15.171:45324) 2024-08-17T02:27:27.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.383+0000 7f7f0e800640 1 -- 172.21.15.171:0/257218008 learned_addr learned my addr 172.21.15.171:0/257218008 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-08-17T02:27:27.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.383+0000 7f7f07e00640 1 -- 172.21.15.171:0/257218008 >> v1:172.21.15.171:6789/0 conn(0x7f7f10159010 legacy=0x7f7f101629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.383+0000 7f7f07e00640 1 -- 172.21.15.171:0/257218008 >> v1:172.21.15.106:6789/0 conn(0x7f7f10158c40 legacy=0x7f7f100b0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.383+0000 7f7f0d400640 1 -- 172.21.15.171:0/257218008 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2030183846 0 0) 0x7f7f100ad8c0 con 0x7f7f10158c40 2024-08-17T02:27:27.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.383+0000 7f7f07e00640 1 -- 172.21.15.171:0/257218008 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f100b0180 con 0x7f7f100b2c40 2024-08-17T02:27:27.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.384+0000 7f7f07e00640 1 --2- 172.21.15.171:0/257218008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f100b2c40 0x7f7f100b5920 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009880 tx=0x7f7ef80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59957a8662e9a0de server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.384+0000 7f7f0d400640 1 -- 172.21.15.171:0/257218008 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef802ad90 con 0x7f7f100b2c40 2024-08-17T02:27:27.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.384+0000 7f7f0d400640 1 -- 172.21.15.171:0/257218008 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef8032440 con 0x7f7f100b2c40 2024-08-17T02:27:27.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.384+0000 7f7f0d400640 1 -- 172.21.15.171:0/257218008 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef80327e0 con 0x7f7f100b2c40 2024-08-17T02:27:27.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.385+0000 7f7f14c00640 1 -- 172.21.15.171:0/257218008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f100b2c40 msgr2=0x7f7f100b5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.385+0000 7f7f14c00640 1 --2- 172.21.15.171:0/257218008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f100b2c40 0x7f7f100b5920 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009880 tx=0x7f7ef80090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.385+0000 7f7f14c00640 1 -- 172.21.15.171:0/257218008 shutdown_connections 2024-08-17T02:27:27.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.385+0000 7f7f14c00640 1 --2- 172.21.15.171:0/257218008 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f100b2c40 0x7f7f100b5920 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.385+0000 7f7f14c00640 1 -- 172.21.15.171:0/257218008 >> 172.21.15.171:0/257218008 conn(0x7f7f100cfd80 msgr2=0x7f7f100d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:27.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.385+0000 7f7f14c00640 1 -- 172.21.15.171:0/257218008 shutdown_connections 2024-08-17T02:27:27.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.385+0000 7f7f14c00640 1 -- 172.21.15.171:0/257218008 wait complete. 2024-08-17T02:27:27.387 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.387+0000 7f7f14c00640 1 Processor -- start 2024-08-17T02:27:27.387 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.387+0000 7f7f14c00640 1 -- start start 2024-08-17T02:27:27.389 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.388+0000 7f7f14c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f100b2c40 0x7f7f1015bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.390 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.388+0000 7f7f14c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f10158c40 0x7f7f10157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.390 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.388+0000 7f7f14c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f10159010 0x7f7f10157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.390 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.388+0000 7f7f14c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f10159b50 con 0x7f7f10159010 2024-08-17T02:27:27.390 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.388+0000 7f7f14c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f101584c0 con 0x7f7f10158c40 2024-08-17T02:27:27.390 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.388+0000 7f7f14c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f10159540 con 0x7f7f100b2c40 2024-08-17T02:27:27.390 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.388+0000 7f7f07e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f10158c40 0x7f7f10157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.390 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.388+0000 7f7f07e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f10158c40 0x7f7f10157450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:40752/0 (socket says 172.21.15.171:40752) 2024-08-17T02:27:27.390 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.388+0000 7f7f07e00640 1 -- 172.21.15.171:0/18804954 learned_addr learned my addr 172.21.15.171:0/18804954 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-08-17T02:27:27.390 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.388+0000 7f7f0de00640 1 --2- 172.21.15.171:0/18804954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f100b2c40 0x7f7f1015bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.390 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.388+0000 7f7f0e800640 1 --2- 172.21.15.171:0/18804954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f10159010 0x7f7f10157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.390 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.388+0000 7f7f07e00640 1 -- 172.21.15.171:0/18804954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f100b2c40 msgr2=0x7f7f1015bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.390 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.388+0000 7f7f07e00640 1 --2- 172.21.15.171:0/18804954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f100b2c40 0x7f7f1015bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.391 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.388+0000 7f7f07e00640 1 -- 172.21.15.171:0/18804954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f10159010 msgr2=0x7f7f10157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.391 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.388+0000 7f7f07e00640 1 --2- 172.21.15.171:0/18804954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f10159010 0x7f7f10157990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.391 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.388+0000 7f7f07e00640 1 -- 172.21.15.171:0/18804954 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef8009390 con 0x7f7f10158c40 2024-08-17T02:27:27.391 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.389+0000 7f7f07e00640 1 --2- 172.21.15.171:0/18804954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f10158c40 0x7f7f10157450 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009360 tx=0x7f7ef8032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.391 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.389+0000 7f7f05600640 1 -- 172.21.15.171:0/18804954 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef8031b30 con 0x7f7f10158c40 2024-08-17T02:27:27.391 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.389+0000 7f7f05600640 1 -- 172.21.15.171:0/18804954 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef8031c90 con 0x7f7f10158c40 2024-08-17T02:27:27.391 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.389+0000 7f7f14c00640 1 -- 172.21.15.171:0/18804954 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f101581e0 con 0x7f7f10158c40 2024-08-17T02:27:27.391 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.389+0000 7f7f05600640 1 -- 172.21.15.171:0/18804954 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef803d670 con 0x7f7f10158c40 2024-08-17T02:27:27.391 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.389+0000 7f7f14c00640 1 -- 172.21.15.171:0/18804954 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1015c1f0 con 0x7f7f10158c40 2024-08-17T02:27:27.391 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.389+0000 7f7f05600640 1 -- 172.21.15.171:0/18804954 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f7ef8039040 con 0x7f7f10158c40 2024-08-17T02:27:27.391 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.389+0000 7f7f05600640 1 -- 172.21.15.171:0/18804954 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f7ef803dba0 con 0x7f7f10158c40 2024-08-17T02:27:27.392 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.390+0000 7f7f14c00640 1 -- 172.21.15.171:0/18804954 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f10159cc0 con 0x7f7f10158c40 2024-08-17T02:27:27.393 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.393+0000 7f7f05600640 1 -- 172.21.15.171:0/18804954 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f7ef8042070 con 0x7f7f10158c40 2024-08-17T02:27:27.427 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-08-17T02:27:27.425+0000 7f2aff766ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:27:27.456 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-08-17T02:27:27.456+0000 7f34f446fec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:27:27.466 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.466+0000 7f7f14c00640 1 -- 172.21.15.171:0/18804954 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8c0f2592-fabc-42b7-9b56-cdbc7045a468", "id": 6} v 0) v1 -- 0x7f7f10071050 con 0x7f7f10158c40 2024-08-17T02:27:27.474 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.472+0000 7f7f05600640 1 -- 172.21.15.171:0/18804954 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8c0f2592-fabc-42b7-9b56-cdbc7045a468", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7ef8037070 con 0x7f7f10158c40 2024-08-17T02:27:27.474 INFO:teuthology.orchestra.run.smithi171.stdout:6 2024-08-17T02:27:27.475 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.473+0000 7f7f14c00640 1 -- 172.21.15.171:0/18804954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f10158c40 msgr2=0x7f7f10157450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.475 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.473+0000 7f7f14c00640 1 --2- 172.21.15.171:0/18804954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f10158c40 0x7f7f10157450 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009360 tx=0x7f7ef8032000 comp rx=0 tx=0).stop 2024-08-17T02:27:27.475 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.473+0000 7f7f14c00640 1 -- 172.21.15.171:0/18804954 shutdown_connections 2024-08-17T02:27:27.475 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.473+0000 7f7f14c00640 1 --2- 172.21.15.171:0/18804954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f10159010 0x7f7f10157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.475 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.473+0000 7f7f14c00640 1 --2- 172.21.15.171:0/18804954 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f10158c40 0x7f7f10157450 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.476 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.473+0000 7f7f14c00640 1 --2- 172.21.15.171:0/18804954 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7f100b2c40 0x7f7f1015bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.476 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.473+0000 7f7f14c00640 1 -- 172.21.15.171:0/18804954 >> 172.21.15.171:0/18804954 conn(0x7f7f100cfd80 msgr2=0x7f7f100d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:27.476 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.473+0000 7f7f14c00640 1 -- 172.21.15.171:0/18804954 shutdown_connections 2024-08-17T02:27:27.476 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.473+0000 7f7f14c00640 1 -- 172.21.15.171:0/18804954 wait complete. 2024-08-17T02:27:27.488 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new bef737c2-444a-4c64-b11a-98e2b090d4f3 7 2024-08-17T02:27:27.520 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-08-17T02:27:27.519+0000 7f34f446fec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:27:27.533 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-08-17T02:27:27.532+0000 7f2aff766ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:27:27.584 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-08-17T02:27:27.583+0000 7f34f446fec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:27:27.665 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.664+0000 7fa0d2000640 1 Processor -- start 2024-08-17T02:27:27.665 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.664+0000 7fa0d2000640 1 -- start start 2024-08-17T02:27:27.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.665+0000 7fa0d2000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa0cc159200 0x7fa0cc0aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.665+0000 7fa0d2000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa0cc0d0490 0x7fa0cc0ad9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.665+0000 7fa0d2000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0cc0adf00 0x7fa0cc0af640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.665+0000 7fa0d2000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0cc0ae370 con 0x7fa0cc159200 2024-08-17T02:27:27.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.665+0000 7fa0d2000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0cc0b11d0 con 0x7fa0cc0d0490 2024-08-17T02:27:27.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.665+0000 7fa0d2000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc0b08a0 con 0x7fa0cc0adf00 2024-08-17T02:27:27.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.666+0000 7fa0cbe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0cc0adf00 0x7fa0cc0af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.666+0000 7fa0caa00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa0cc0d0490 0x7fa0cc0ad9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.666+0000 7fa0cbe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0cc0adf00 0x7fa0cc0af640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:34022/0 (socket says 172.21.15.171:34022) 2024-08-17T02:27:27.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.666+0000 7fa0cbe00640 1 -- 172.21.15.171:0/791512794 learned_addr learned my addr 172.21.15.171:0/791512794 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-08-17T02:27:27.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.666+0000 7fa0cb400640 1 --2- 172.21.15.171:0/791512794 >> v2:172.21.15.106:3300/0 conn(0x7fa0cc159200 0x7fa0cc0aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.666+0000 7fa0cbe00640 1 -- 172.21.15.171:0/791512794 >> v2:172.21.15.171:3300/0 conn(0x7fa0cc0d0490 msgr2=0x7fa0cc0ad9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:27.667 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.666+0000 7fa0cbe00640 1 --2- 172.21.15.171:0/791512794 >> v2:172.21.15.171:3300/0 conn(0x7fa0cc0d0490 0x7fa0cc0ad9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.668 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.666+0000 7fa0cbe00640 1 -- 172.21.15.171:0/791512794 >> v2:172.21.15.106:3300/0 conn(0x7fa0cc159200 msgr2=0x7fa0cc0aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:27.668 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.666+0000 7fa0cbe00640 1 --2- 172.21.15.171:0/791512794 >> v2:172.21.15.106:3300/0 conn(0x7fa0cc159200 0x7fa0cc0aeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.668 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.666+0000 7fa0cbe00640 1 -- 172.21.15.171:0/791512794 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0cc0b0b80 con 0x7fa0cc0adf00 2024-08-17T02:27:27.668 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.666+0000 7fa0caa00640 1 --2- 172.21.15.171:0/791512794 >> v2:172.21.15.171:3300/0 conn(0x7fa0cc0d0490 0x7fa0cc0ad9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:27.668 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.666+0000 7fa0cb400640 1 --2- 172.21.15.171:0/791512794 >> v2:172.21.15.106:3300/0 conn(0x7fa0cc159200 0x7fa0cc0aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:27.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.667+0000 7fa0cbe00640 1 --2- 172.21.15.171:0/791512794 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0cc0adf00 0x7fa0cc0af640 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc089110 tx=0x7fa0c4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5f4042fd6b1423d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.668+0000 7fa0ca000640 1 -- 172.21.15.171:0/791512794 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4031400 con 0x7fa0cc0adf00 2024-08-17T02:27:27.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.668+0000 7fa0ca000640 1 -- 172.21.15.171:0/791512794 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c402d050 con 0x7fa0cc0adf00 2024-08-17T02:27:27.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.668+0000 7fa0ca000640 1 -- 172.21.15.171:0/791512794 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c40317d0 con 0x7fa0cc0adf00 2024-08-17T02:27:27.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.668+0000 7fa0d2000640 1 -- 172.21.15.171:0/791512794 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0cc0adf00 msgr2=0x7fa0cc0af640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.668+0000 7fa0d2000640 1 --2- 172.21.15.171:0/791512794 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0cc0adf00 0x7fa0cc0af640 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc089110 tx=0x7fa0c4009840 comp rx=0 tx=0).stop 2024-08-17T02:27:27.669 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.668+0000 7fa0d2000640 1 -- 172.21.15.171:0/791512794 shutdown_connections 2024-08-17T02:27:27.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.668+0000 7fa0d2000640 1 --2- 172.21.15.171:0/791512794 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0cc0adf00 0x7fa0cc0af640 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.668+0000 7fa0d2000640 1 --2- 172.21.15.171:0/791512794 >> v2:172.21.15.171:3300/0 conn(0x7fa0cc0d0490 0x7fa0cc0ad9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.668+0000 7fa0d2000640 1 --2- 172.21.15.171:0/791512794 >> v2:172.21.15.106:3300/0 conn(0x7fa0cc159200 0x7fa0cc0aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.668+0000 7fa0d2000640 1 -- 172.21.15.171:0/791512794 >> 172.21.15.171:0/791512794 conn(0x7fa0cc06eb90 msgr2=0x7fa0cc0cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:27.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.668+0000 7fa0d2000640 1 -- 172.21.15.171:0/791512794 shutdown_connections 2024-08-17T02:27:27.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.668+0000 7fa0d2000640 1 -- 172.21.15.171:0/791512794 wait complete. 2024-08-17T02:27:27.670 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.670+0000 7fa0d2000640 1 Processor -- start 2024-08-17T02:27:27.671 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.670+0000 7fa0d2000640 1 -- start start 2024-08-17T02:27:27.673 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.671+0000 7fa0d2000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0cc0adf00 0x7fa0cc14f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.673 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.671+0000 7fa0d2000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0cc0d0490 0x7fa0cc14fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.673 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.671+0000 7fa0d2000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa0cc159200 0x7fa0cc16c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:27.673 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.671+0000 7fa0d2000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc14dde0 con 0x7fa0cc159200 2024-08-17T02:27:27.673 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.671+0000 7fa0d2000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc09abf0 con 0x7fa0cc0adf00 2024-08-17T02:27:27.673 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.671+0000 7fa0d2000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc14d1d0 con 0x7fa0cc0d0490 2024-08-17T02:27:27.673 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.671+0000 7fa0caa00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0cc0d0490 0x7fa0cc14fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.673 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.671+0000 7fa0caa00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0cc0d0490 0x7fa0cc14fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:34030/0 (socket says 172.21.15.171:34030) 2024-08-17T02:27:27.673 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.671+0000 7fa0cb400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0cc0adf00 0x7fa0cc14f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.673 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.671+0000 7fa0caa00640 1 -- 172.21.15.171:0/377544249 learned_addr learned my addr 172.21.15.171:0/377544249 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-08-17T02:27:27.673 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.671+0000 7fa0cbe00640 1 --2- 172.21.15.171:0/377544249 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa0cc159200 0x7fa0cc16c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:27.673 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.671+0000 7fa0caa00640 1 -- 172.21.15.171:0/377544249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0cc0adf00 msgr2=0x7fa0cc14f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.674 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.671+0000 7fa0caa00640 1 --2- 172.21.15.171:0/377544249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0cc0adf00 0x7fa0cc14f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.674 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.671+0000 7fa0caa00640 1 -- 172.21.15.171:0/377544249 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa0cc159200 msgr2=0x7fa0cc16c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.674 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.671+0000 7fa0caa00640 1 --2- 172.21.15.171:0/377544249 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa0cc159200 0x7fa0cc16c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.674 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.671+0000 7fa0caa00640 1 -- 172.21.15.171:0/377544249 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b8009390 con 0x7fa0cc0d0490 2024-08-17T02:27:27.674 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.671+0000 7fa0cb400640 1 --2- 172.21.15.171:0/377544249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0cc0adf00 0x7fa0cc14f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:27.674 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.672+0000 7fa0caa00640 1 --2- 172.21.15.171:0/377544249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0cc0d0490 0x7fa0cc14fc00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800ecb0 tx=0x7fa0b80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:27.674 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.672+0000 7fa0c2a00640 1 -- 172.21.15.171:0/377544249 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b800cbc0 con 0x7fa0cc0d0490 2024-08-17T02:27:27.674 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.672+0000 7fa0c2a00640 1 -- 172.21.15.171:0/377544249 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b800cd20 con 0x7fa0cc0d0490 2024-08-17T02:27:27.677 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.672+0000 7fa0c2a00640 1 -- 172.21.15.171:0/377544249 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8013680 con 0x7fa0cc0d0490 2024-08-17T02:27:27.677 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.672+0000 7fa0d2000640 1 -- 172.21.15.171:0/377544249 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0bc009390 con 0x7fa0cc0d0490 2024-08-17T02:27:27.678 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.672+0000 7fa0d2000640 1 -- 172.21.15.171:0/377544249 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c4009ae0 con 0x7fa0cc0d0490 2024-08-17T02:27:27.678 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.672+0000 7fa0c2a00640 1 -- 172.21.15.171:0/377544249 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fa0b80139f0 con 0x7fa0cc0d0490 2024-08-17T02:27:27.678 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.672+0000 7fa0c2a00640 1 -- 172.21.15.171:0/377544249 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7fa0b8013ca0 con 0x7fa0cc0d0490 2024-08-17T02:27:27.678 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.674+0000 7fa0d2000640 1 -- 172.21.15.171:0/377544249 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0cc063020 con 0x7fa0cc0d0490 2024-08-17T02:27:27.678 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.676+0000 7fa0c2a00640 1 -- 172.21.15.171:0/377544249 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fa0cc063020 con 0x7fa0cc0d0490 2024-08-17T02:27:27.698 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-08-17T02:27:27.698+0000 7f34f446fec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:27:27.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.750+0000 7fa0d2000640 1 -- 172.21.15.171:0/377544249 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "bef737c2-444a-4c64-b11a-98e2b090d4f3", "id": 7} v 0) v1 -- 0x7fa0cc14df90 con 0x7fa0cc0d0490 2024-08-17T02:27:27.757 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.757+0000 7fa0c2a00640 1 -- 172.21.15.171:0/377544249 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bef737c2-444a-4c64-b11a-98e2b090d4f3", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa0cc14df90 con 0x7fa0cc0d0490 2024-08-17T02:27:27.757 INFO:teuthology.orchestra.run.smithi171.stdout:7 2024-08-17T02:27:27.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.758+0000 7fa0d2000640 1 -- 172.21.15.171:0/377544249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0cc0d0490 msgr2=0x7fa0cc14fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:27.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.758+0000 7fa0d2000640 1 --2- 172.21.15.171:0/377544249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0cc0d0490 0x7fa0cc14fc00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800ecb0 tx=0x7fa0b80090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.758+0000 7fa0d2000640 1 -- 172.21.15.171:0/377544249 shutdown_connections 2024-08-17T02:27:27.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.758+0000 7fa0d2000640 1 --2- 172.21.15.171:0/377544249 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa0cc159200 0x7fa0cc16c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.758 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.758+0000 7fa0d2000640 1 --2- 172.21.15.171:0/377544249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0cc0d0490 0x7fa0cc14fc00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.758+0000 7fa0d2000640 1 --2- 172.21.15.171:0/377544249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0cc0adf00 0x7fa0cc14f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:27.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.758+0000 7fa0d2000640 1 -- 172.21.15.171:0/377544249 >> 172.21.15.171:0/377544249 conn(0x7fa0cc06eb90 msgr2=0x7fa0cc156e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:27.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.758+0000 7fa0d2000640 1 -- 172.21.15.171:0/377544249 shutdown_connections 2024-08-17T02:27:27.759 INFO:teuthology.orchestra.run.smithi171.stderr:2024-08-17T02:27:27.758+0000 7fa0d2000640 1 -- 172.21.15.171:0/377544249 wait complete. 2024-08-17T02:27:27.772 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-17T02:27:27.772 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-17T02:27:27.777 INFO:tasks.ceph.osd.0:Started 2024-08-17T02:27:27.777 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-17T02:27:27.777 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-17T02:27:27.781 INFO:tasks.ceph.osd.1:Started 2024-08-17T02:27:27.781 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-17T02:27:27.781 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-17T02:27:27.784 INFO:tasks.ceph.osd.2:Started 2024-08-17T02:27:27.785 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-17T02:27:27.785 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-17T02:27:27.789 INFO:tasks.ceph.osd.3:Started 2024-08-17T02:27:27.789 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-17T02:27:27.790 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-17T02:27:27.793 INFO:tasks.ceph.osd.4:Started 2024-08-17T02:27:27.793 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-17T02:27:27.794 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-17T02:27:27.797 INFO:tasks.ceph.osd.5:Started 2024-08-17T02:27:27.797 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-17T02:27:27.797 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-17T02:27:27.802 INFO:tasks.ceph.osd.6:Started 2024-08-17T02:27:27.802 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-17T02:27:27.802 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-17T02:27:27.806 INFO:tasks.ceph.osd.7:Started 2024-08-17T02:27:27.807 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:28.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.000+0000 7f855f200640 1 Processor -- start 2024-08-17T02:27:28.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.000+0000 7f855f200640 1 -- start start 2024-08-17T02:27:28.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.001+0000 7f855f200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85600cd700 0x7f85600ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:28.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.001+0000 7f855f200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85600cf9d0 con 0x7f8560158c80 2024-08-17T02:27:28.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.001+0000 7f855f200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85600ceb60 con 0x7f85600cc9d0 2024-08-17T02:27:28.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.001+0000 7f855f200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85600cedc0 con 0x7f85600cd700 2024-08-17T02:27:28.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.001+0000 7f855de00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8560158c80 0x7f85600cc2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:33846/0 (socket says 172.21.15.106:33846) 2024-08-17T02:27:28.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.002+0000 7f855de00640 1 -- 172.21.15.106:0/732747883 learned_addr learned my addr 172.21.15.106:0/732747883 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:28.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.002+0000 7f8555400640 1 --2- 172.21.15.106:0/732747883 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85600cd700 0x7f85600ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:28.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.002+0000 7f855d400640 1 -- 172.21.15.106:0/732747883 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2433586662 0 0) 0x7f85600ceb60 con 0x7f85600cc9d0 2024-08-17T02:27:28.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.002+0000 7f855d400640 1 -- 172.21.15.106:0/732747883 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85440034e0 con 0x7f85600cc9d0 2024-08-17T02:27:28.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.002+0000 7f855d400640 1 -- 172.21.15.106:0/732747883 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3180653812 0 0) 0x7f85600cf9d0 con 0x7f8560158c80 2024-08-17T02:27:28.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.002+0000 7f8555400640 1 -- 172.21.15.106:0/732747883 >> v1:172.21.15.171:6789/0 conn(0x7f85600cc9d0 legacy=0x7f85600acfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:28.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.002+0000 7f8555400640 1 -- 172.21.15.106:0/732747883 >> v1:172.21.15.106:6789/0 conn(0x7f8560158c80 legacy=0x7f85600cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:28.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.002+0000 7f8555400640 1 -- 172.21.15.106:0/732747883 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85600cf0a0 con 0x7f85600cd700 2024-08-17T02:27:28.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.003+0000 7f8555400640 1 --2- 172.21.15.106:0/732747883 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85600cd700 0x7f85600ce620 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8548009880 tx=0x7f85480090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=678a280ba06f2846 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:28.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.003+0000 7f855d400640 1 -- 172.21.15.106:0/732747883 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854802ad80 con 0x7f85600cd700 2024-08-17T02:27:28.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.004+0000 7f855d400640 1 -- 172.21.15.106:0/732747883 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8548032440 con 0x7f85600cd700 2024-08-17T02:27:28.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.004+0000 7f855d400640 1 -- 172.21.15.106:0/732747883 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85480327e0 con 0x7f85600cd700 2024-08-17T02:27:28.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.004+0000 7f855f200640 1 -- 172.21.15.106:0/732747883 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85600cd700 msgr2=0x7f85600ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:28.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.004+0000 7f855f200640 1 --2- 172.21.15.106:0/732747883 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85600cd700 0x7f85600ce620 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8548009880 tx=0x7f85480090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.004+0000 7f855f200640 1 -- 172.21.15.106:0/732747883 shutdown_connections 2024-08-17T02:27:28.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.004+0000 7f855f200640 1 --2- 172.21.15.106:0/732747883 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85600cd700 0x7f85600ce620 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.004+0000 7f855f200640 1 -- 172.21.15.106:0/732747883 >> 172.21.15.106:0/732747883 conn(0x7f8560098e30 msgr2=0x7f856006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:28.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.004+0000 7f855f200640 1 -- 172.21.15.106:0/732747883 shutdown_connections 2024-08-17T02:27:28.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.004+0000 7f855f200640 1 -- 172.21.15.106:0/732747883 wait complete. 2024-08-17T02:27:28.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.006+0000 7f855f200640 1 Processor -- start 2024-08-17T02:27:28.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.006+0000 7f855f200640 1 -- start start 2024-08-17T02:27:28.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.007+0000 7f855f200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85600cc9d0 0x7f85600b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:28.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.007+0000 7f855f200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85600cd700 0x7f85600c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:28.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.007+0000 7f855f200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8560158c80 0x7f85600c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:28.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.007+0000 7f855f200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85600b3a70 con 0x7f85600cc9d0 2024-08-17T02:27:28.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.007+0000 7f855f200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85600b2e60 con 0x7f8560158c80 2024-08-17T02:27:28.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.007+0000 7f855f200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85600b3140 con 0x7f85600cd700 2024-08-17T02:27:28.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.007+0000 7f855de00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85600cc9d0 0x7f85600b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:28.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.007+0000 7f855de00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85600cc9d0 0x7f85600b43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:48966/0 (socket says 172.21.15.106:48966) 2024-08-17T02:27:28.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.007+0000 7f855e800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8560158c80 0x7f85600c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:28.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.007+0000 7f855de00640 1 -- 172.21.15.106:0/3529322808 learned_addr learned my addr 172.21.15.106:0/3529322808 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:28.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.007+0000 7f8555400640 1 --2- 172.21.15.106:0/3529322808 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85600cd700 0x7f85600c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:28.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.008+0000 7f855e800640 1 -- 172.21.15.106:0/3529322808 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85600cd700 msgr2=0x7f85600c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:28.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.008+0000 7f855e800640 1 --2- 172.21.15.106:0/3529322808 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85600cd700 0x7f85600c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.008+0000 7f855e800640 1 -- 172.21.15.106:0/3529322808 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85600cc9d0 msgr2=0x7f85600b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:28.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.008+0000 7f855e800640 1 --2- 172.21.15.106:0/3529322808 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85600cc9d0 0x7f85600b43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.008+0000 7f855e800640 1 -- 172.21.15.106:0/3529322808 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8548009390 con 0x7f8560158c80 2024-08-17T02:27:28.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.008+0000 7f855e800640 1 --2- 172.21.15.106:0/3529322808 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8560158c80 0x7f85600c9130 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f855800c770 tx=0x7f8558002620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:28.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.008+0000 7f8556000640 1 -- 172.21.15.106:0/3529322808 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8558012630 con 0x7f8560158c80 2024-08-17T02:27:28.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.008+0000 7f8556000640 1 -- 172.21.15.106:0/3529322808 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8558012790 con 0x7f8560158c80 2024-08-17T02:27:28.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.008+0000 7f855f200640 1 -- 172.21.15.106:0/3529322808 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85600b3420 con 0x7f8560158c80 2024-08-17T02:27:28.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.008+0000 7f8556000640 1 -- 172.21.15.106:0/3529322808 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8558012b70 con 0x7f8560158c80 2024-08-17T02:27:28.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.008+0000 7f855f200640 1 -- 172.21.15.106:0/3529322808 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85600b4920 con 0x7f8560158c80 2024-08-17T02:27:28.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.008+0000 7f8556000640 1 -- 172.21.15.106:0/3529322808 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f855801b400 con 0x7f8560158c80 2024-08-17T02:27:28.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.009+0000 7f8556000640 1 -- 172.21.15.106:0/3529322808 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f855801a3b0 con 0x7f8560158c80 2024-08-17T02:27:28.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.009+0000 7f855f200640 1 -- 172.21.15.106:0/3529322808 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85600b3be0 con 0x7f8560158c80 2024-08-17T02:27:28.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.012+0000 7f8556000640 1 -- 172.21.15.106:0/3529322808 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f855803a7a0 con 0x7f8560158c80 2024-08-17T02:27:28.071 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-08-17T02:27:28.070+0000 7f2aff766ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:27:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.103+0000 7f855f200640 1 -- 172.21.15.106:0/3529322808 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8560071050 con 0x7f8560158c80 2024-08-17T02:27:28.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.104+0000 7f8556000640 1 -- 172.21.15.106:0/3529322808 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f8558029070 con 0x7f8560158c80 2024-08-17T02:27:28.106 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:27:28.106 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":10,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:27:27.752271+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:28.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.105+0000 7f855f200640 1 -- 172.21.15.106:0/3529322808 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8560158c80 msgr2=0x7f85600c9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:28.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.105+0000 7f855f200640 1 --2- 172.21.15.106:0/3529322808 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8560158c80 0x7f85600c9130 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f855800c770 tx=0x7f8558002620 comp rx=0 tx=0).stop 2024-08-17T02:27:28.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.105+0000 7f855f200640 1 -- 172.21.15.106:0/3529322808 shutdown_connections 2024-08-17T02:27:28.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.105+0000 7f855f200640 1 --2- 172.21.15.106:0/3529322808 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8560158c80 0x7f85600c9130 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.105+0000 7f855f200640 1 --2- 172.21.15.106:0/3529322808 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f85600cd700 0x7f85600c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.105+0000 7f855f200640 1 --2- 172.21.15.106:0/3529322808 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85600cc9d0 0x7f85600b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:28.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.105+0000 7f855f200640 1 -- 172.21.15.106:0/3529322808 >> 172.21.15.106:0/3529322808 conn(0x7f8560098e30 msgr2=0x7f8560156e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:28.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.105+0000 7f855f200640 1 -- 172.21.15.106:0/3529322808 shutdown_connections 2024-08-17T02:27:28.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:28.105+0000 7f855f200640 1 -- 172.21.15.106:0/3529322808 wait complete. 2024-08-17T02:27:28.121 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-17T02:27:28.121 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-17T02:27:28.202 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-08-17T02:27:28.202+0000 7f34f446fec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:27:28.342 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-08-17T02:27:28.340+0000 7f2aff766ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:27:28.400 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-08-17T02:27:28.399+0000 7f2aff766ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:27:28.498 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-08-17T02:27:28.460+0000 7f69c6f312c0 -1 Falling back to public interface 2024-08-17T02:27:28.498 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-08-17T02:27:28.469+0000 7fcaafb272c0 -1 Falling back to public interface 2024-08-17T02:27:28.498 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-08-17T02:27:28.465+0000 7f8517c092c0 -1 Falling back to public interface 2024-08-17T02:27:28.498 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-08-17T02:27:28.469+0000 7f25878652c0 -1 Falling back to public interface 2024-08-17T02:27:28.499 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-08-17T02:27:28.469+0000 7f2585c00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-08-17T02:27:28.499 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-08-17T02:27:28.474+0000 7f34f446fec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:27:28.499 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-08-17T02:27:28.477+0000 7fce1de0e2c0 -1 Falling back to public interface 2024-08-17T02:27:28.499 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-08-17T02:27:28.493+0000 7f7a46b232c0 -1 Falling back to public interface 2024-08-17T02:27:28.500 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-08-17T02:27:28.471+0000 7fcaad800640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6810/0: (98) Address already in use 2024-08-17T02:27:28.500 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-08-17T02:27:28.483+0000 7fa1755232c0 -1 Falling back to public interface 2024-08-17T02:27:28.500 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-08-17T02:27:28.492+0000 7fa4092112c0 -1 Falling back to public interface 2024-08-17T02:27:28.513 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-08-17T02:27:28.512+0000 7f2aff766ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:27:28.542 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-08-17T02:27:28.541+0000 7f34f446fec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:27:28.651 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-08-17T02:27:28.651+0000 7f34f446fec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:27:28.804 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-08-17T02:27:28.803+0000 7f2aff766ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:27:28.857 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-08-17T02:27:28.856+0000 7f2aff766ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:27:28.948 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-08-17T02:27:28.948+0000 7f34f446fec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:27:29.001 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:29.002 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-08-17T02:27:29.001+0000 7f34f446fec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:27:29.033 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-08-17T02:27:29.032+0000 7f2aff766ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:27:29.092 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-08-17T02:27:29.091+0000 7f2aff766ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:27:29.132 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.131+0000 7fdb44c00640 1 Processor -- start 2024-08-17T02:27:29.132 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.131+0000 7fdb44c00640 1 -- start start 2024-08-17T02:27:29.134 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.132+0000 7fdb44c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fdb400cda00 0x7fdb400b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.134 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.132+0000 7fdb44c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdb400cc090 0x7fdb400cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.134 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.132+0000 7fdb44c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb400ca940 con 0x7fdb400d0590 2024-08-17T02:27:29.134 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.132+0000 7fdb44c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb400cabe0 con 0x7fdb400cc090 2024-08-17T02:27:29.134 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.132+0000 7fdb44c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb400caec0 con 0x7fdb400cda00 2024-08-17T02:27:29.134 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.132+0000 7fdb3ea00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fdb400d0590 0x7fdb400cb980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:33854/0 (socket says 172.21.15.106:33854) 2024-08-17T02:27:29.134 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.132+0000 7fdb3ea00640 1 -- 172.21.15.106:0/2219814043 learned_addr learned my addr 172.21.15.106:0/2219814043 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:29.135 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.132+0000 7fdb3fe00640 1 --2- 172.21.15.106:0/2219814043 >> v2:172.21.15.106:3300/0 conn(0x7fdb400cc090 0x7fdb400cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.135 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.133+0000 7fdb3f400640 1 --2- 172.21.15.106:0/2219814043 >> v2:172.21.15.171:3300/0 conn(0x7fdb400cda00 0x7fdb400b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.135 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.133+0000 7fdb3e000640 1 -- 172.21.15.106:0/2219814043 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616116052 0 0) 0x7fdb400ca940 con 0x7fdb400d0590 2024-08-17T02:27:29.136 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.133+0000 7fdb3e000640 1 -- 172.21.15.106:0/2219814043 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb240034e0 con 0x7fdb400d0590 2024-08-17T02:27:29.136 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.133+0000 7fdb3fe00640 1 -- 172.21.15.106:0/2219814043 >> v2:172.21.15.171:3300/0 conn(0x7fdb400cda00 msgr2=0x7fdb400b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:29.136 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.133+0000 7fdb3fe00640 1 --2- 172.21.15.106:0/2219814043 >> v2:172.21.15.171:3300/0 conn(0x7fdb400cda00 0x7fdb400b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.136 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.133+0000 7fdb3fe00640 1 -- 172.21.15.106:0/2219814043 >> v1:172.21.15.106:6789/0 conn(0x7fdb400d0590 legacy=0x7fdb400cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:29.136 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.133+0000 7fdb3fe00640 1 -- 172.21.15.106:0/2219814043 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb400cb1a0 con 0x7fdb400cc090 2024-08-17T02:27:29.136 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.134+0000 7fdb3fe00640 1 --2- 172.21.15.106:0/2219814043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb400cc090 0x7fdb400cddd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdb400887f0 tx=0x7fdb38009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85c2d91f5f9ac80 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:29.136 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.134+0000 7fdb3e000640 1 -- 172.21.15.106:0/2219814043 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb38007550 con 0x7fdb400cc090 2024-08-17T02:27:29.136 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.134+0000 7fdb3e000640 1 -- 172.21.15.106:0/2219814043 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3802d050 con 0x7fdb400cc090 2024-08-17T02:27:29.136 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.134+0000 7fdb3e000640 1 -- 172.21.15.106:0/2219814043 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb38007920 con 0x7fdb400cc090 2024-08-17T02:27:29.137 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.135+0000 7fdb44c00640 1 -- 172.21.15.106:0/2219814043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb400cc090 msgr2=0x7fdb400cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:29.137 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.135+0000 7fdb44c00640 1 --2- 172.21.15.106:0/2219814043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb400cc090 0x7fdb400cddd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdb400887f0 tx=0x7fdb38009780 comp rx=0 tx=0).stop 2024-08-17T02:27:29.137 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.135+0000 7fdb44c00640 1 -- 172.21.15.106:0/2219814043 shutdown_connections 2024-08-17T02:27:29.137 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.135+0000 7fdb44c00640 1 --2- 172.21.15.106:0/2219814043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb400cc090 0x7fdb400cddd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.137 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.135+0000 7fdb44c00640 1 --2- 172.21.15.106:0/2219814043 >> v2:172.21.15.171:3300/0 conn(0x7fdb400cda00 0x7fdb400b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.137 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.135+0000 7fdb44c00640 1 -- 172.21.15.106:0/2219814043 >> 172.21.15.106:0/2219814043 conn(0x7fdb4006ec90 msgr2=0x7fdb400cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:29.137 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.135+0000 7fdb44c00640 1 -- 172.21.15.106:0/2219814043 shutdown_connections 2024-08-17T02:27:29.138 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.135+0000 7fdb44c00640 1 -- 172.21.15.106:0/2219814043 wait complete. 2024-08-17T02:27:29.140 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.136+0000 7fdb44c00640 1 Processor -- start 2024-08-17T02:27:29.140 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.136+0000 7fdb44c00640 1 -- start start 2024-08-17T02:27:29.140 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.137+0000 7fdb44c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb400cc090 0x7fdb400c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.140 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.137+0000 7fdb44c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdb400cda00 0x7fdb401593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.140 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.137+0000 7fdb44c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb400d0590 0x7fdb400c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:29.140 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.137+0000 7fdb44c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb400c9620 con 0x7fdb400d0590 2024-08-17T02:27:29.141 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.137+0000 7fdb44c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4015c720 con 0x7fdb400cc090 2024-08-17T02:27:29.141 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.137+0000 7fdb44c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4015c290 con 0x7fdb400cda00 2024-08-17T02:27:29.141 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.138+0000 7fdb3fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb400d0590 0x7fdb400c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.141 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.138+0000 7fdb3f400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb400cc090 0x7fdb400c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.141 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.138+0000 7fdb3f400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb400cc090 0x7fdb400c6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:37762/0 (socket says 172.21.15.106:37762) 2024-08-17T02:27:29.141 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.138+0000 7fdb3f400640 1 -- 172.21.15.106:0/3426524557 learned_addr learned my addr 172.21.15.106:0/3426524557 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:29.141 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.138+0000 7fdb3ea00640 1 --2- 172.21.15.106:0/3426524557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdb400cda00 0x7fdb401593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:29.141 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.138+0000 7fdb3f400640 1 -- 172.21.15.106:0/3426524557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdb400cda00 msgr2=0x7fdb401593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:29.141 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.138+0000 7fdb3f400640 1 --2- 172.21.15.106:0/3426524557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdb400cda00 0x7fdb401593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.141 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.138+0000 7fdb3f400640 1 -- 172.21.15.106:0/3426524557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb400d0590 msgr2=0x7fdb400c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:29.141 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.138+0000 7fdb3f400640 1 --2- 172.21.15.106:0/3426524557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb400d0590 0x7fdb400c90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.141 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.138+0000 7fdb3f400640 1 -- 172.21.15.106:0/3426524557 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb38009a20 con 0x7fdb400cc090 2024-08-17T02:27:29.141 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.138+0000 7fdb3ea00640 1 --2- 172.21.15.106:0/3426524557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdb400cda00 0x7fdb401593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:29.141 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.138+0000 7fdb3f400640 1 --2- 172.21.15.106:0/3426524557 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb400cc090 0x7fdb400c6cb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdb3000ea50 tx=0x7fdb300090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:29.142 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.139+0000 7fdb36a00640 1 -- 172.21.15.106:0/3426524557 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3000ca10 con 0x7fdb400cc090 2024-08-17T02:27:29.142 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.139+0000 7fdb36a00640 1 -- 172.21.15.106:0/3426524557 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3000cb70 con 0x7fdb400cc090 2024-08-17T02:27:29.142 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.139+0000 7fdb36a00640 1 -- 172.21.15.106:0/3426524557 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb30013470 con 0x7fdb400cc090 2024-08-17T02:27:29.142 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.139+0000 7fdb44c00640 1 -- 172.21.15.106:0/3426524557 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb400c7290 con 0x7fdb400cc090 2024-08-17T02:27:29.142 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.139+0000 7fdb44c00640 1 -- 172.21.15.106:0/3426524557 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4015bf20 con 0x7fdb400cc090 2024-08-17T02:27:29.142 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.139+0000 7fdb36a00640 1 -- 172.21.15.106:0/3426524557 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fdb30013860 con 0x7fdb400cc090 2024-08-17T02:27:29.142 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.139+0000 7fdb36a00640 1 -- 172.21.15.106:0/3426524557 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fdb3001cb80 con 0x7fdb400cc090 2024-08-17T02:27:29.142 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.140+0000 7fdb44c00640 1 -- 172.21.15.106:0/3426524557 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb40071100 con 0x7fdb400cc090 2024-08-17T02:27:29.144 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.142+0000 7fdb36a00640 1 -- 172.21.15.106:0/3426524557 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fdb30021060 con 0x7fdb400cc090 2024-08-17T02:27:29.176 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-08-17T02:27:29.174+0000 7f2aff766ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:27:29.184 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-08-17T02:27:29.184+0000 7f34f446fec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:27:29.206 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.205+0000 7fdb44c00640 1 -- 172.21.15.106:0/3426524557 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb400ca260 con 0x7fdb400cc090 2024-08-17T02:27:29.207 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.206+0000 7fdb36a00640 1 -- 172.21.15.106:0/3426524557 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fdb30017070 con 0x7fdb400cc090 2024-08-17T02:27:29.207 INFO:teuthology.misc.health.smithi106.stdout: 2024-08-17T02:27:29.207 INFO:teuthology.misc.health.smithi106.stdout:{"epoch":10,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:27:27.752271+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:29.208 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.207+0000 7fdb44c00640 1 -- 172.21.15.106:0/3426524557 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb400cc090 msgr2=0x7fdb400c6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:29.208 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.207+0000 7fdb44c00640 1 --2- 172.21.15.106:0/3426524557 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb400cc090 0x7fdb400c6cb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdb3000ea50 tx=0x7fdb300090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.208 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.207+0000 7fdb44c00640 1 -- 172.21.15.106:0/3426524557 shutdown_connections 2024-08-17T02:27:29.208 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.207+0000 7fdb44c00640 1 --2- 172.21.15.106:0/3426524557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb400d0590 0x7fdb400c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.208 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.207+0000 7fdb44c00640 1 --2- 172.21.15.106:0/3426524557 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdb400cda00 0x7fdb401593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.208 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.207+0000 7fdb44c00640 1 --2- 172.21.15.106:0/3426524557 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb400cc090 0x7fdb400c6cb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:29.209 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.207+0000 7fdb44c00640 1 -- 172.21.15.106:0/3426524557 >> 172.21.15.106:0/3426524557 conn(0x7fdb4006ec90 msgr2=0x7fdb400cb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:29.209 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.207+0000 7fdb44c00640 1 -- 172.21.15.106:0/3426524557 shutdown_connections 2024-08-17T02:27:29.209 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:29.207+0000 7fdb44c00640 1 -- 172.21.15.106:0/3426524557 wait complete. 2024-08-17T02:27:29.219 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-17T02:27:29.229 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-08-17T02:27:29.227+0000 7f2aff766ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:27:29.241 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-08-17T02:27:29.241+0000 7f34f446fec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:27:29.322 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-08-17T02:27:29.322+0000 7f34f446fec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:27:29.376 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-08-17T02:27:29.376+0000 7f34f446fec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:27:29.751 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-08-17T02:27:29.749+0000 7f2aff766ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:27:29.860 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-08-17T02:27:29.858+0000 7f2aff766ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:27:29.914 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-08-17T02:27:29.914+0000 7f34f446fec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:27:30.023 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-08-17T02:27:30.022+0000 7f34f446fec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:27:30.877 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-08-17T02:27:30.876+0000 7f2ae3a00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-17T02:27:30.877 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-08-17T02:27:30.876+0000 7f2ae3a00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-17T02:27:32.041 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-08-17T02:27:32.039+0000 7fcaafb272c0 -1 osd.0 0 log_to_monitors true 2024-08-17T02:27:32.045 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-08-17T02:27:32.044+0000 7f25878652c0 -1 osd.3 0 log_to_monitors true 2024-08-17T02:27:32.063 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-08-17T02:27:32.062+0000 7fce1de0e2c0 -1 osd.4 0 log_to_monitors true 2024-08-17T02:27:32.063 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-08-17T02:27:32.061+0000 7fa4092112c0 -1 osd.1 0 log_to_monitors true 2024-08-17T02:27:32.063 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-08-17T02:27:32.062+0000 7f8517c092c0 -1 osd.7 0 log_to_monitors true 2024-08-17T02:27:32.068 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-08-17T02:27:32.067+0000 7fa1755232c0 -1 osd.2 0 log_to_monitors true 2024-08-17T02:27:32.289 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-08-17T02:27:32.289+0000 7f69c6f312c0 -1 osd.5 0 log_to_monitors true 2024-08-17T02:27:32.355 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-08-17T02:27:32.355+0000 7f7a46b232c0 -1 osd.6 0 log_to_monitors true 2024-08-17T02:27:36.027 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:36.139 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-08-17T02:27:36.139+0000 7f2583400640 -1 osd.3 0 waiting for initial osdmap 2024-08-17T02:27:36.141 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-08-17T02:27:36.141+0000 7fcaa9200640 -1 osd.0 0 waiting for initial osdmap 2024-08-17T02:27:36.146 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-08-17T02:27:36.145+0000 7fcaa0600640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:36.150 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-08-17T02:27:36.149+0000 7f2578a00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:36.167 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-08-17T02:27:36.167+0000 7fce17200640 -1 osd.4 0 waiting for initial osdmap 2024-08-17T02:27:36.174 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-08-17T02:27:36.174+0000 7fce0e600640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:36.194 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-08-17T02:27:36.194+0000 7f7a40200640 -1 osd.6 0 waiting for initial osdmap 2024-08-17T02:27:36.200 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-08-17T02:27:36.200+0000 7f7a37600640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:36.213 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-08-17T02:27:36.213+0000 7f69c0600640 -1 osd.5 0 waiting for initial osdmap 2024-08-17T02:27:36.214 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-08-17T02:27:36.214+0000 7fa16ec00640 -1 osd.2 0 waiting for initial osdmap 2024-08-17T02:27:36.219 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-08-17T02:27:36.218+0000 7fa402600640 -1 osd.1 0 waiting for initial osdmap 2024-08-17T02:27:36.220 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-08-17T02:27:36.219+0000 7fa166000640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:36.220 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-08-17T02:27:36.220+0000 7f69b7a00640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:36.226 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-08-17T02:27:36.226+0000 7fa3f9a00640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:36.228 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-08-17T02:27:36.228+0000 7f8511000640 -1 osd.7 0 waiting for initial osdmap 2024-08-17T02:27:36.234 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-08-17T02:27:36.233+0000 7f8508400640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:27:36.238 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.237+0000 7f977dc00640 1 Processor -- start 2024-08-17T02:27:36.238 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.238+0000 7f977dc00640 1 -- start start 2024-08-17T02:27:36.240 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.239+0000 7f977dc00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97780d0590 0x7f97780cb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.240 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.239+0000 7f977dc00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97780b30b0 con 0x7f97780cbec0 2024-08-17T02:27:36.240 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.239+0000 7f977dc00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97780ca940 con 0x7f97780cda00 2024-08-17T02:27:36.240 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.239+0000 7f977dc00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97780cabe0 con 0x7f97780d0590 2024-08-17T02:27:36.240 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.239+0000 7f977d200640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f97780cbec0 0x7f97780cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:33406/0 (socket says 172.21.15.106:33406) 2024-08-17T02:27:36.240 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.239+0000 7f977d200640 1 -- 172.21.15.106:0/4069284196 learned_addr learned my addr 172.21.15.106:0/4069284196 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:36.240 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.239+0000 7f9777400640 1 --2- 172.21.15.106:0/4069284196 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97780d0590 0x7f97780cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.240 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.239+0000 7f9776a00640 1 -- 172.21.15.106:0/4069284196 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827053747 0 0) 0x7f97780b30b0 con 0x7f97780cbec0 2024-08-17T02:27:36.241 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.239+0000 7f9776a00640 1 -- 172.21.15.106:0/4069284196 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f975c0034e0 con 0x7f97780cbec0 2024-08-17T02:27:36.241 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.239+0000 7f9776a00640 1 -- 172.21.15.106:0/4069284196 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1299624410 0 0) 0x7f97780ca940 con 0x7f97780cda00 2024-08-17T02:27:36.241 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.239+0000 7f9776a00640 1 -- 172.21.15.106:0/4069284196 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97780b30b0 con 0x7f97780cda00 2024-08-17T02:27:36.241 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.240+0000 7f9777400640 1 -- 172.21.15.106:0/4069284196 >> v1:172.21.15.171:6789/0 conn(0x7f97780cda00 legacy=0x7f97780b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.241 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.240+0000 7f9777400640 1 -- 172.21.15.106:0/4069284196 >> v1:172.21.15.106:6789/0 conn(0x7f97780cbec0 legacy=0x7f97780cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.241 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.240+0000 7f9776a00640 1 -- 172.21.15.106:0/4069284196 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 227826898 0 0) 0x7f975c0034e0 con 0x7f97780cbec0 2024-08-17T02:27:36.241 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.240+0000 7f9777400640 1 -- 172.21.15.106:0/4069284196 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97780caec0 con 0x7f97780d0590 2024-08-17T02:27:36.242 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.241+0000 7f9777400640 1 --2- 172.21.15.106:0/4069284196 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97780d0590 0x7f97780cb980 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9764009880 tx=0x7f97640090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c09969e0ad89d271 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.242 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.241+0000 7f9776a00640 1 -- 172.21.15.106:0/4069284196 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97700017f0 con 0x7f97780d0590 2024-08-17T02:27:36.242 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.241+0000 7f9776a00640 1 -- 172.21.15.106:0/4069284196 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976402aac0 con 0x7f97780d0590 2024-08-17T02:27:36.242 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.241+0000 7f9776a00640 1 -- 172.21.15.106:0/4069284196 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976402ae40 con 0x7f97780d0590 2024-08-17T02:27:36.242 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.242+0000 7f977dc00640 1 -- 172.21.15.106:0/4069284196 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97780d0590 msgr2=0x7f97780cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.242 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.242+0000 7f977dc00640 1 --2- 172.21.15.106:0/4069284196 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97780d0590 0x7f97780cb980 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9764009880 tx=0x7f97640090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.242 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.242+0000 7f977dc00640 1 -- 172.21.15.106:0/4069284196 shutdown_connections 2024-08-17T02:27:36.242 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.242+0000 7f977dc00640 1 --2- 172.21.15.106:0/4069284196 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97780d0590 0x7f97780cb980 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.243 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.242+0000 7f977dc00640 1 -- 172.21.15.106:0/4069284196 >> 172.21.15.106:0/4069284196 conn(0x7f977806ec90 msgr2=0x7f97780cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:36.243 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.242+0000 7f977dc00640 1 -- 172.21.15.106:0/4069284196 shutdown_connections 2024-08-17T02:27:36.243 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.242+0000 7f977dc00640 1 -- 172.21.15.106:0/4069284196 wait complete. 2024-08-17T02:27:36.243 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.243+0000 7f977dc00640 1 Processor -- start 2024-08-17T02:27:36.243 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.243+0000 7f977dc00640 1 -- start start 2024-08-17T02:27:36.245 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.244+0000 7f977dc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97780cbec0 0x7f97780c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.245 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.244+0000 7f977dc00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97780cda00 0x7f97780b4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.245 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.244+0000 7f977dc00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97780d0590 0x7f97781493d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.245 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.244+0000 7f977dc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97780c8710 con 0x7f97780cbec0 2024-08-17T02:27:36.245 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.244+0000 7f977dc00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977816d980 con 0x7f97780cda00 2024-08-17T02:27:36.245 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.244+0000 7f977dc00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977816cd70 con 0x7f97780d0590 2024-08-17T02:27:36.246 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.244+0000 7f9777e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97780cbec0 0x7f97780c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.246 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.244+0000 7f9777e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97780cbec0 0x7f97780c81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:41822/0 (socket says 172.21.15.106:41822) 2024-08-17T02:27:36.246 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.244+0000 7f9777e00640 1 -- 172.21.15.106:0/1621180025 learned_addr learned my addr 172.21.15.106:0/1621180025 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:36.246 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.244+0000 7f977d200640 1 --2- 172.21.15.106:0/1621180025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97780d0590 0x7f97781493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.246 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.244+0000 7f9777400640 1 --2- 172.21.15.106:0/1621180025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97780cda00 0x7f97780b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.246 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.245+0000 7f9777e00640 1 -- 172.21.15.106:0/1621180025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97780d0590 msgr2=0x7f97781493d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.246 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.245+0000 7f9777e00640 1 --2- 172.21.15.106:0/1621180025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97780d0590 0x7f97781493d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.246 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.245+0000 7f9777e00640 1 -- 172.21.15.106:0/1621180025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97780cda00 msgr2=0x7f97780b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.246 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.245+0000 7f9777e00640 1 --2- 172.21.15.106:0/1621180025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97780cda00 0x7f97780b4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.246 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.245+0000 7f9777e00640 1 -- 172.21.15.106:0/1621180025 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9764009390 con 0x7f97780cbec0 2024-08-17T02:27:36.246 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.245+0000 7f9777e00640 1 --2- 172.21.15.106:0/1621180025 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97780cbec0 0x7f97780c81d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f976800c4e0 tx=0x7f9768007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.247 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.245+0000 7f976f400640 1 -- 172.21.15.106:0/1621180025 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768016070 con 0x7f97780cbec0 2024-08-17T02:27:36.247 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.245+0000 7f976f400640 1 -- 172.21.15.106:0/1621180025 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9768011590 con 0x7f97780cbec0 2024-08-17T02:27:36.247 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.245+0000 7f976f400640 1 -- 172.21.15.106:0/1621180025 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768011990 con 0x7f97780cbec0 2024-08-17T02:27:36.248 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.245+0000 7f977dc00640 1 -- 172.21.15.106:0/1621180025 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977816d050 con 0x7f97780cbec0 2024-08-17T02:27:36.248 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.245+0000 7f977dc00640 1 -- 172.21.15.106:0/1621180025 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977816d610 con 0x7f97780cbec0 2024-08-17T02:27:36.248 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.246+0000 7f977dc00640 1 -- 172.21.15.106:0/1621180025 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9778071100 con 0x7f97780cbec0 2024-08-17T02:27:36.248 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.247+0000 7f976f400640 1 -- 172.21.15.106:0/1621180025 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f9768012420 con 0x7f97780cbec0 2024-08-17T02:27:36.248 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.248+0000 7f976f400640 1 --2- 172.21.15.106:0/1621180025 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f97580650c0 0x7f9758067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:36.249 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.248+0000 7f976f400640 1 -- 172.21.15.106:0/1621180025 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7f9768080fe0 con 0x7f97780cbec0 2024-08-17T02:27:36.249 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.248+0000 7f9777400640 1 --2- 172.21.15.106:0/1621180025 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f97580650c0 0x7f9758067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:36.249 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.248+0000 7f9777400640 1 --2- 172.21.15.106:0/1621180025 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f97580650c0 0x7f9758067570 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9764034000 tx=0x7f9764032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:36.253 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.252+0000 7f976f400640 1 -- 172.21.15.106:0/1621180025 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f976804ff20 con 0x7f97780cbec0 2024-08-17T02:27:36.426 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.425+0000 7f977dc00640 1 -- 172.21.15.106:0/1621180025 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f977815c780 con 0x7f97780cbec0 2024-08-17T02:27:36.426 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.426+0000 7f976f400640 1 -- 172.21.15.106:0/1621180025 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f9768053540 con 0x7f97780cbec0 2024-08-17T02:27:36.427 INFO:teuthology.misc.health.smithi106.stdout: 2024-08-17T02:27:36.427 INFO:teuthology.misc.health.smithi106.stdout:{"epoch":12,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:27:33.888038+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:36.429 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.428+0000 7f977dc00640 1 -- 172.21.15.106:0/1621180025 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f97580650c0 msgr2=0x7f9758067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.429 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.428+0000 7f977dc00640 1 --2- 172.21.15.106:0/1621180025 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f97580650c0 0x7f9758067570 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9764034000 tx=0x7f9764032000 comp rx=0 tx=0).stop 2024-08-17T02:27:36.429 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.428+0000 7f977dc00640 1 -- 172.21.15.106:0/1621180025 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97780cbec0 msgr2=0x7f97780c81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:36.430 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.428+0000 7f977dc00640 1 --2- 172.21.15.106:0/1621180025 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97780cbec0 0x7f97780c81d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f976800c4e0 tx=0x7f9768007d80 comp rx=0 tx=0).stop 2024-08-17T02:27:36.430 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.429+0000 7f977dc00640 1 -- 172.21.15.106:0/1621180025 shutdown_connections 2024-08-17T02:27:36.430 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.429+0000 7f977dc00640 1 --2- 172.21.15.106:0/1621180025 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f97780d0590 0x7f97781493d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.430 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.429+0000 7f977dc00640 1 --2- 172.21.15.106:0/1621180025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97780cda00 0x7f97780b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.430 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.429+0000 7f977dc00640 1 --2- 172.21.15.106:0/1621180025 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f97580650c0 0x7f9758067570 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.430 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.429+0000 7f977dc00640 1 --2- 172.21.15.106:0/1621180025 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97780cbec0 0x7f97780c81d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:36.430 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.429+0000 7f977dc00640 1 -- 172.21.15.106:0/1621180025 >> 172.21.15.106:0/1621180025 conn(0x7f977806ec90 msgr2=0x7f9778068f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:36.430 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.429+0000 7f977dc00640 1 -- 172.21.15.106:0/1621180025 shutdown_connections 2024-08-17T02:27:36.430 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:36.429+0000 7f977dc00640 1 -- 172.21.15.106:0/1621180025 wait complete. 2024-08-17T02:27:36.441 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-17T02:27:41.121 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:41.125 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:43.248 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:43.382 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.382+0000 7f9d7d000640 1 Processor -- start 2024-08-17T02:27:43.383 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.382+0000 7f9d7d000640 1 -- start start 2024-08-17T02:27:43.384 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.383+0000 7f9d7d000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9d78140520 0x7f9d780adad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.384 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.383+0000 7f9d7d000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9d780ae010 0x7f9d780c8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.385 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.383+0000 7f9d7d000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d780c8940 0x7f9d780ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.385 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.383+0000 7f9d7d000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d780ae640 con 0x7f9d78140520 2024-08-17T02:27:43.385 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.383+0000 7f9d7d000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d780af4b0 con 0x7f9d780ae010 2024-08-17T02:27:43.385 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.383+0000 7f9d7d000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d780c8d80 con 0x7f9d780c8940 2024-08-17T02:27:43.385 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.384+0000 7f9d75e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9d78140520 0x7f9d780adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.385 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.384+0000 7f9d75e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9d78140520 0x7f9d780adad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49900/0 (socket says 172.21.15.106:49900) 2024-08-17T02:27:43.385 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.384+0000 7f9d75e00640 1 -- 172.21.15.106:0/1974825297 learned_addr learned my addr 172.21.15.106:0/1974825297 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:43.385 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.384+0000 7f9d76800640 1 --2- 172.21.15.106:0/1974825297 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d780c8940 0x7f9d780ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.385 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.384+0000 7f9d75400640 1 --2- 172.21.15.106:0/1974825297 >> v2:172.21.15.171:3300/0 conn(0x7f9d780ae010 0x7f9d780c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.385 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.384+0000 7f9d75e00640 1 -- 172.21.15.106:0/1974825297 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d780c8940 msgr2=0x7f9d780ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:43.385 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.384+0000 7f9d75e00640 1 --2- 172.21.15.106:0/1974825297 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d780c8940 0x7f9d780ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.385 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.384+0000 7f9d75e00640 1 -- 172.21.15.106:0/1974825297 >> v2:172.21.15.171:3300/0 conn(0x7f9d780ae010 msgr2=0x7f9d780c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:43.385 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.384+0000 7f9d75e00640 1 --2- 172.21.15.106:0/1974825297 >> v2:172.21.15.171:3300/0 conn(0x7f9d780ae010 0x7f9d780c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.386 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.384+0000 7f9d75e00640 1 -- 172.21.15.106:0/1974825297 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d780cb6c0 con 0x7f9d78140520 2024-08-17T02:27:43.386 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.384+0000 7f9d76800640 1 --2- 172.21.15.106:0/1974825297 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d780c8940 0x7f9d780ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:43.386 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.384+0000 7f9d75400640 1 --2- 172.21.15.106:0/1974825297 >> v2:172.21.15.171:3300/0 conn(0x7f9d780ae010 0x7f9d780c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:43.387 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.385+0000 7f9d75e00640 1 --2- 172.21.15.106:0/1974825297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d78140520 0x7f9d780adad0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9d7805ec20 tx=0x7f9d680091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f6319f7c90597b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:43.387 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.385+0000 7f9d74a00640 1 -- 172.21.15.106:0/1974825297 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6802add0 con 0x7f9d78140520 2024-08-17T02:27:43.387 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.385+0000 7f9d74a00640 1 -- 172.21.15.106:0/1974825297 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d68032440 con 0x7f9d78140520 2024-08-17T02:27:43.387 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.385+0000 7f9d74a00640 1 -- 172.21.15.106:0/1974825297 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d68032820 con 0x7f9d78140520 2024-08-17T02:27:43.387 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.386+0000 7f9d7d000640 1 -- 172.21.15.106:0/1974825297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d78140520 msgr2=0x7f9d780adad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.387 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.386+0000 7f9d7d000640 1 --2- 172.21.15.106:0/1974825297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d78140520 0x7f9d780adad0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9d7805ec20 tx=0x7f9d680091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.388 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.386+0000 7f9d7d000640 1 -- 172.21.15.106:0/1974825297 shutdown_connections 2024-08-17T02:27:43.388 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.386+0000 7f9d7d000640 1 --2- 172.21.15.106:0/1974825297 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d780c8940 0x7f9d780ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.388 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.386+0000 7f9d7d000640 1 --2- 172.21.15.106:0/1974825297 >> v2:172.21.15.171:3300/0 conn(0x7f9d780ae010 0x7f9d780c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.388 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.386+0000 7f9d7d000640 1 --2- 172.21.15.106:0/1974825297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d78140520 0x7f9d780adad0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.388 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.386+0000 7f9d7d000640 1 -- 172.21.15.106:0/1974825297 >> 172.21.15.106:0/1974825297 conn(0x7f9d78067810 msgr2=0x7f9d7806c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:43.388 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.386+0000 7f9d7d000640 1 -- 172.21.15.106:0/1974825297 shutdown_connections 2024-08-17T02:27:43.388 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.386+0000 7f9d7d000640 1 -- 172.21.15.106:0/1974825297 wait complete. 2024-08-17T02:27:43.390 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.387+0000 7f9d7d000640 1 Processor -- start 2024-08-17T02:27:43.390 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.388+0000 7f9d7d000640 1 -- start start 2024-08-17T02:27:43.390 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.388+0000 7f9d7d000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d780ae010 0x7f9d780c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.390 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.388+0000 7f9d7d000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d780c8940 0x7f9d7813d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.390 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.388+0000 7f9d7d000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d78140520 0x7f9d780c0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.390 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.389+0000 7f9d7d000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d780c3900 con 0x7f9d780ae010 2024-08-17T02:27:43.390 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.389+0000 7f9d7d000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d780c3be0 con 0x7f9d78140520 2024-08-17T02:27:43.390 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.389+0000 7f9d7d000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d780aad40 con 0x7f9d780c8940 2024-08-17T02:27:43.390 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.389+0000 7f9d75e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d780ae010 0x7f9d780c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.390 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.389+0000 7f9d75e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d780ae010 0x7f9d780c30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49910/0 (socket says 172.21.15.106:49910) 2024-08-17T02:27:43.391 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.389+0000 7f9d75e00640 1 -- 172.21.15.106:0/611936749 learned_addr learned my addr 172.21.15.106:0/611936749 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:43.391 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.389+0000 7f9d75400640 1 --2- 172.21.15.106:0/611936749 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d780c8940 0x7f9d7813d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.391 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.389+0000 7f9d76800640 1 --2- 172.21.15.106:0/611936749 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d78140520 0x7f9d780c0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.391 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.389+0000 7f9d75e00640 1 -- 172.21.15.106:0/611936749 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d780c8940 msgr2=0x7f9d7813d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.391 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.389+0000 7f9d75e00640 1 --2- 172.21.15.106:0/611936749 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d780c8940 0x7f9d7813d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.391 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.389+0000 7f9d75e00640 1 -- 172.21.15.106:0/611936749 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d78140520 msgr2=0x7f9d780c0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.391 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.389+0000 7f9d75e00640 1 --2- 172.21.15.106:0/611936749 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d78140520 0x7f9d780c0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.391 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.389+0000 7f9d75e00640 1 -- 172.21.15.106:0/611936749 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d68009450 con 0x7f9d780ae010 2024-08-17T02:27:43.391 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.390+0000 7f9d75e00640 1 --2- 172.21.15.106:0/611936749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d780ae010 0x7f9d780c30b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9d68035040 tx=0x7f9d68032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:43.392 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.390+0000 7f9d6d600640 1 -- 172.21.15.106:0/611936749 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d68000d10 con 0x7f9d780ae010 2024-08-17T02:27:43.392 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.390+0000 7f9d6d600640 1 -- 172.21.15.106:0/611936749 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d68031a40 con 0x7f9d780ae010 2024-08-17T02:27:43.392 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.390+0000 7f9d6d600640 1 -- 172.21.15.106:0/611936749 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d68031e60 con 0x7f9d780ae010 2024-08-17T02:27:43.392 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.390+0000 7f9d7d000640 1 -- 172.21.15.106:0/611936749 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d780ab020 con 0x7f9d780ae010 2024-08-17T02:27:43.392 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.390+0000 7f9d7d000640 1 -- 172.21.15.106:0/611936749 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d780c3ec0 con 0x7f9d780ae010 2024-08-17T02:27:43.392 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.391+0000 7f9d7d000640 1 -- 172.21.15.106:0/611936749 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d78064a50 con 0x7f9d780ae010 2024-08-17T02:27:43.392 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.392+0000 7f9d6d600640 1 -- 172.21.15.106:0/611936749 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9d68039040 con 0x7f9d780ae010 2024-08-17T02:27:43.394 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.393+0000 7f9d6d600640 1 --2- 172.21.15.106:0/611936749 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9d58065150 0x7f9d58067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.394 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.394+0000 7f9d6d600640 1 -- 172.21.15.106:0/611936749 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9d680a1d30 con 0x7f9d780ae010 2024-08-17T02:27:43.394 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.394+0000 7f9d75400640 1 --2- 172.21.15.106:0/611936749 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9d58065150 0x7f9d58067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.394 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.394+0000 7f9d75400640 1 --2- 172.21.15.106:0/611936749 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9d58065150 0x7f9d58067600 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9d780b04f0 tx=0x7f9d64008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:43.398 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.398+0000 7f9d6d600640 1 -- 172.21.15.106:0/611936749 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9d68070150 con 0x7f9d780ae010 2024-08-17T02:27:43.570 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.570+0000 7f9d7d000640 1 -- 172.21.15.106:0/611936749 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d780b07f0 con 0x7f9d780ae010 2024-08-17T02:27:43.571 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.571+0000 7f9d6d600640 1 -- 172.21.15.106:0/611936749 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12175 (secure 0 0 0) 0x7f9d68073770 con 0x7f9d780ae010 2024-08-17T02:27:43.571 INFO:teuthology.misc.health.smithi106.stdout: 2024-08-17T02:27:43.571 INFO:teuthology.misc.health.smithi106.stdout:{"epoch":16,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:27:40.169261+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:43.573 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.573+0000 7f9d7d000640 1 -- 172.21.15.106:0/611936749 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9d58065150 msgr2=0x7f9d58067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.573 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.573+0000 7f9d7d000640 1 --2- 172.21.15.106:0/611936749 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9d58065150 0x7f9d58067600 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9d780b04f0 tx=0x7f9d64008040 comp rx=0 tx=0).stop 2024-08-17T02:27:43.574 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.573+0000 7f9d7d000640 1 -- 172.21.15.106:0/611936749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d780ae010 msgr2=0x7f9d780c30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.574 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.573+0000 7f9d7d000640 1 --2- 172.21.15.106:0/611936749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d780ae010 0x7f9d780c30b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9d68035040 tx=0x7f9d68032000 comp rx=0 tx=0).stop 2024-08-17T02:27:43.574 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.573+0000 7f9d7d000640 1 -- 172.21.15.106:0/611936749 shutdown_connections 2024-08-17T02:27:43.574 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.573+0000 7f9d7d000640 1 --2- 172.21.15.106:0/611936749 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d78140520 0x7f9d780c0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.574 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.573+0000 7f9d7d000640 1 --2- 172.21.15.106:0/611936749 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d780c8940 0x7f9d7813d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.574 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.573+0000 7f9d7d000640 1 --2- 172.21.15.106:0/611936749 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9d58065150 0x7f9d58067600 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.574 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.573+0000 7f9d7d000640 1 --2- 172.21.15.106:0/611936749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d780ae010 0x7f9d780c30b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.574 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.573+0000 7f9d7d000640 1 -- 172.21.15.106:0/611936749 >> 172.21.15.106:0/611936749 conn(0x7f9d78067810 msgr2=0x7f9d7806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:43.574 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.573+0000 7f9d7d000640 1 -- 172.21.15.106:0/611936749 shutdown_connections 2024-08-17T02:27:43.574 INFO:teuthology.misc.health.smithi106.stderr:2024-08-17T02:27:43.573+0000 7f9d7d000640 1 -- 172.21.15.106:0/611936749 wait complete. 2024-08-17T02:27:43.585 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-17T02:27:43.586 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-17T02:27:43.586 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:27:43.586 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:27:43.590 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:27:43.590 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:27:43.590 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:27:43.594 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:27:43.594 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:27:43.594 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:27:43.599 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:27:43.599 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:27:43.599 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:27:43.603 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:27:43.603 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-08-17T02:27:43.603 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:43.715 INFO:tasks.ceph.mds.c.smithi106.stdout:starting mds.c at 2024-08-17T02:27:43.715 INFO:tasks.ceph.mds.a.smithi106.stdout:starting mds.a at 2024-08-17T02:27:43.733 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-08-17T02:27:43.735 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-08-17T02:27:43.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.760+0000 7f5c5fe00640 1 Processor -- start 2024-08-17T02:27:43.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.760+0000 7f5c5fe00640 1 -- start start 2024-08-17T02:27:43.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.761+0000 7f5c5fe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c60159ca0 0x7f5c600ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.761+0000 7f5c5fe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5c600ca8a0 0x7f5c600cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.761+0000 7f5c5fe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5c600ccad0 0x7f5c600cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.761+0000 7f5c5fe00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c600cd6e0 con 0x7f5c600ccad0 2024-08-17T02:27:43.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.761+0000 7f5c5fe00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c600ccf70 con 0x7f5c600ca8a0 2024-08-17T02:27:43.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.761+0000 7f5c5fe00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c600cadc0 con 0x7f5c60159ca0 2024-08-17T02:27:43.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.761+0000 7f5c5f400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5c600ccad0 0x7f5c600cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.761+0000 7f5c5f400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5c600ccad0 0x7f5c600cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49934/0 (socket says 172.21.15.106:49934) 2024-08-17T02:27:43.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.761+0000 7f5c5f400640 1 -- 172.21.15.106:0/3418822765 learned_addr learned my addr 172.21.15.106:0/3418822765 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:43.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.762+0000 7f5c5f400640 1 -- 172.21.15.106:0/3418822765 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c60159ca0 msgr2=0x7f5c600ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:43.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.762+0000 7f5c5f400640 1 --2- 172.21.15.106:0/3418822765 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c60159ca0 0x7f5c600ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.762+0000 7f5c5f400640 1 -- 172.21.15.106:0/3418822765 >> v2:172.21.15.171:3300/0 conn(0x7f5c600ca8a0 msgr2=0x7f5c600cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:43.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.762+0000 7f5c5f400640 1 --2- 172.21.15.106:0/3418822765 >> v2:172.21.15.171:3300/0 conn(0x7f5c600ca8a0 0x7f5c600cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.762+0000 7f5c5f400640 1 -- 172.21.15.106:0/3418822765 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c600cb060 con 0x7f5c600ccad0 2024-08-17T02:27:43.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.763+0000 7f5c5f400640 1 --2- 172.21.15.106:0/3418822765 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c600ccad0 0x7f5c600cdb30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5c60088cf0 tx=0x7f5c58009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc7a1a66f6dae3f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:43.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.763+0000 7f5c5d600640 1 -- 172.21.15.106:0/3418822765 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c58031400 con 0x7f5c600ccad0 2024-08-17T02:27:43.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.763+0000 7f5c5d600640 1 -- 172.21.15.106:0/3418822765 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5802d050 con 0x7f5c600ccad0 2024-08-17T02:27:43.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.763+0000 7f5c5d600640 1 -- 172.21.15.106:0/3418822765 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c580317d0 con 0x7f5c600ccad0 2024-08-17T02:27:43.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.763+0000 7f5c5fe00640 1 -- 172.21.15.106:0/3418822765 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c600ccad0 msgr2=0x7f5c600cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.763+0000 7f5c5fe00640 1 --2- 172.21.15.106:0/3418822765 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c600ccad0 0x7f5c600cdb30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5c60088cf0 tx=0x7f5c58009840 comp rx=0 tx=0).stop 2024-08-17T02:27:43.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.764+0000 7f5c5fe00640 1 -- 172.21.15.106:0/3418822765 shutdown_connections 2024-08-17T02:27:43.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.764+0000 7f5c5fe00640 1 --2- 172.21.15.106:0/3418822765 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c600ccad0 0x7f5c600cdb30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.764+0000 7f5c5fe00640 1 --2- 172.21.15.106:0/3418822765 >> v2:172.21.15.171:3300/0 conn(0x7f5c600ca8a0 0x7f5c600cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.764+0000 7f5c5fe00640 1 --2- 172.21.15.106:0/3418822765 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c60159ca0 0x7f5c600ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.764+0000 7f5c5fe00640 1 -- 172.21.15.106:0/3418822765 >> 172.21.15.106:0/3418822765 conn(0x7f5c60098e00 msgr2=0x7f5c6006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:43.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.764+0000 7f5c5fe00640 1 -- 172.21.15.106:0/3418822765 shutdown_connections 2024-08-17T02:27:43.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.764+0000 7f5c5fe00640 1 -- 172.21.15.106:0/3418822765 wait complete. 2024-08-17T02:27:43.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.765+0000 7f5c5fe00640 1 Processor -- start 2024-08-17T02:27:43.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.765+0000 7f5c5fe00640 1 -- start start 2024-08-17T02:27:43.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.766+0000 7f5c5fe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c600ca8a0 0x7f5c6016bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.766+0000 7f5c5fe00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c600ccad0 0x7f5c6016a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.766+0000 7f5c5fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c60159ca0 0x7f5c6016c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.766+0000 7f5c5fe00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6009cd00 con 0x7f5c60159ca0 2024-08-17T02:27:43.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.766+0000 7f5c5fe00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6016c500 con 0x7f5c600ccad0 2024-08-17T02:27:43.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.766+0000 7f5c5fe00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c600c7df0 con 0x7f5c600ca8a0 2024-08-17T02:27:43.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.766+0000 7f5c5f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c60159ca0 0x7f5c6016c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.766+0000 7f5c5f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c60159ca0 0x7f5c6016c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49948/0 (socket says 172.21.15.106:49948) 2024-08-17T02:27:43.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.766+0000 7f5c5f400640 1 -- 172.21.15.106:0/1735758422 learned_addr learned my addr 172.21.15.106:0/1735758422 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:43.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.766+0000 7f5c5ea00640 1 --2- 172.21.15.106:0/1735758422 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c600ca8a0 0x7f5c6016bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.766+0000 7f5c5e000640 1 --2- 172.21.15.106:0/1735758422 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c600ccad0 0x7f5c6016a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.767+0000 7f5c5f400640 1 -- 172.21.15.106:0/1735758422 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c600ca8a0 msgr2=0x7f5c6016bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.767+0000 7f5c5f400640 1 --2- 172.21.15.106:0/1735758422 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c600ca8a0 0x7f5c6016bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.767+0000 7f5c5f400640 1 -- 172.21.15.106:0/1735758422 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c600ccad0 msgr2=0x7f5c6016a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.767+0000 7f5c5f400640 1 --2- 172.21.15.106:0/1735758422 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c600ccad0 0x7f5c6016a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.767+0000 7f5c5f400640 1 -- 172.21.15.106:0/1735758422 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c58009ae0 con 0x7f5c60159ca0 2024-08-17T02:27:43.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.767+0000 7f5c5f400640 1 --2- 172.21.15.106:0/1735758422 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c60159ca0 0x7f5c6016c780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5c58009f50 tx=0x7f5c58034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:43.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.767+0000 7f5c56000640 1 -- 172.21.15.106:0/1735758422 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c580078e0 con 0x7f5c60159ca0 2024-08-17T02:27:43.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.767+0000 7f5c56000640 1 -- 172.21.15.106:0/1735758422 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c58007a40 con 0x7f5c60159ca0 2024-08-17T02:27:43.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.767+0000 7f5c5fe00640 1 -- 172.21.15.106:0/1735758422 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c600c80d0 con 0x7f5c60159ca0 2024-08-17T02:27:43.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.767+0000 7f5c56000640 1 -- 172.21.15.106:0/1735758422 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c58007dc0 con 0x7f5c60159ca0 2024-08-17T02:27:43.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.767+0000 7f5c5fe00640 1 -- 172.21.15.106:0/1735758422 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c600c8690 con 0x7f5c60159ca0 2024-08-17T02:27:43.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.768+0000 7f5c5fe00640 1 -- 172.21.15.106:0/1735758422 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c600c8880 con 0x7f5c60159ca0 2024-08-17T02:27:43.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.769+0000 7f5c56000640 1 -- 172.21.15.106:0/1735758422 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5c5803c630 con 0x7f5c60159ca0 2024-08-17T02:27:43.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.770+0000 7f5c56000640 1 --2- 172.21.15.106:0/1735758422 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5c40065150 0x7f5c40067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:43.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.770+0000 7f5c56000640 1 -- 172.21.15.106:0/1735758422 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5c580a3400 con 0x7f5c60159ca0 2024-08-17T02:27:43.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.770+0000 7f5c5ea00640 1 --2- 172.21.15.106:0/1735758422 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5c40065150 0x7f5c40067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:43.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.771+0000 7f5c5ea00640 1 --2- 172.21.15.106:0/1735758422 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5c40065150 0x7f5c40067600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5c50006960 tx=0x7f5c500068f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:43.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.774+0000 7f5c56000640 1 -- 172.21.15.106:0/1735758422 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5c580718a0 con 0x7f5c60159ca0 2024-08-17T02:27:43.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.947+0000 7f5c5fe00640 1 -- 172.21.15.106:0/1735758422 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c60071050 con 0x7f5c60159ca0 2024-08-17T02:27:43.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.948+0000 7f5c56000640 1 -- 172.21.15.106:0/1735758422 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12175 (secure 0 0 0) 0x7f5c58074ec0 con 0x7f5c60159ca0 2024-08-17T02:27:43.949 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:27:43.949 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":16,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:27:40.169261+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:43.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.950+0000 7f5c5fe00640 1 -- 172.21.15.106:0/1735758422 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5c40065150 msgr2=0x7f5c40067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.950+0000 7f5c5fe00640 1 --2- 172.21.15.106:0/1735758422 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5c40065150 0x7f5c40067600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5c50006960 tx=0x7f5c500068f0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.950+0000 7f5c5fe00640 1 -- 172.21.15.106:0/1735758422 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c60159ca0 msgr2=0x7f5c6016c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:43.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.950+0000 7f5c5fe00640 1 --2- 172.21.15.106:0/1735758422 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c60159ca0 0x7f5c6016c780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5c58009f50 tx=0x7f5c58034000 comp rx=0 tx=0).stop 2024-08-17T02:27:43.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.950+0000 7f5c5fe00640 1 -- 172.21.15.106:0/1735758422 shutdown_connections 2024-08-17T02:27:43.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.950+0000 7f5c5fe00640 1 --2- 172.21.15.106:0/1735758422 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5c40065150 0x7f5c40067600 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.950+0000 7f5c5fe00640 1 --2- 172.21.15.106:0/1735758422 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c60159ca0 0x7f5c6016c780 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.950+0000 7f5c5fe00640 1 --2- 172.21.15.106:0/1735758422 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c600ccad0 0x7f5c6016a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.950+0000 7f5c5fe00640 1 --2- 172.21.15.106:0/1735758422 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c600ca8a0 0x7f5c6016bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:43.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.950+0000 7f5c5fe00640 1 -- 172.21.15.106:0/1735758422 >> 172.21.15.106:0/1735758422 conn(0x7f5c60098e00 msgr2=0x7f5c60068990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:43.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.950+0000 7f5c5fe00640 1 -- 172.21.15.106:0/1735758422 shutdown_connections 2024-08-17T02:27:43.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:43.950+0000 7f5c5fe00640 1 -- 172.21.15.106:0/1735758422 wait complete. 2024-08-17T02:27:43.966 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:37.928826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:27:43.967 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:44.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.118+0000 7f76d7e00640 1 Processor -- start 2024-08-17T02:27:44.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.118+0000 7f76d7e00640 1 -- start start 2024-08-17T02:27:44.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.119+0000 7f76d7e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f76d8158e50 0x7f76d80cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.119+0000 7f76d7e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d80ceeb0 con 0x7f76d80cc700 2024-08-17T02:27:44.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.119+0000 7f76d7e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d80cf190 con 0x7f76d80ce790 2024-08-17T02:27:44.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.119+0000 7f76d7e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d80cf470 con 0x7f76d8158e50 2024-08-17T02:27:44.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.119+0000 7f76d6a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f76d8158e50 0x7f76d80cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.119+0000 7f76d6000640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f76d80cc700 0x7f76d80ce080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:57118/0 (socket says 172.21.15.106:57118) 2024-08-17T02:27:44.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.119+0000 7f76d6000640 1 -- 172.21.15.106:0/1014612238 learned_addr learned my addr 172.21.15.106:0/1014612238 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:44.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.120+0000 7f76d6a00640 1 -- 172.21.15.106:0/1014612238 >> v1:172.21.15.171:6789/0 conn(0x7f76d80ce790 legacy=0x7f76d80b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.120+0000 7f76d6a00640 1 -- 172.21.15.106:0/1014612238 >> v1:172.21.15.106:6789/0 conn(0x7f76d80cc700 legacy=0x7f76d80ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.120+0000 7f76d6a00640 1 -- 172.21.15.106:0/1014612238 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d80b2a00 con 0x7f76d8158e50 2024-08-17T02:27:44.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.120+0000 7f76d5600640 1 -- 172.21.15.106:0/1014612238 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663190448 0 0) 0x7f76d80ceeb0 con 0x7f76d80cc700 2024-08-17T02:27:44.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.121+0000 7f76d6a00640 1 --2- 172.21.15.106:0/1014612238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76d8158e50 0x7f76d80cc1c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f76c8009e60 tx=0x7f76c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4437d8a14c004e1c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:44.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.121+0000 7f76d5600640 1 -- 172.21.15.106:0/1014612238 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c8007550 con 0x7f76d8158e50 2024-08-17T02:27:44.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.121+0000 7f76d5600640 1 -- 172.21.15.106:0/1014612238 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c802d050 con 0x7f76d8158e50 2024-08-17T02:27:44.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.121+0000 7f76d5600640 1 -- 172.21.15.106:0/1014612238 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c8007900 con 0x7f76d8158e50 2024-08-17T02:27:44.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.121+0000 7f76d7e00640 1 -- 172.21.15.106:0/1014612238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76d8158e50 msgr2=0x7f76d80cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.121+0000 7f76d7e00640 1 --2- 172.21.15.106:0/1014612238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76d8158e50 0x7f76d80cc1c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f76c8009e60 tx=0x7f76c8009780 comp rx=0 tx=0).stop 2024-08-17T02:27:44.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.122+0000 7f76d7e00640 1 -- 172.21.15.106:0/1014612238 shutdown_connections 2024-08-17T02:27:44.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.122+0000 7f76d7e00640 1 --2- 172.21.15.106:0/1014612238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76d8158e50 0x7f76d80cc1c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.122+0000 7f76d7e00640 1 -- 172.21.15.106:0/1014612238 >> 172.21.15.106:0/1014612238 conn(0x7f76d8098de0 msgr2=0x7f76d806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:44.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.122+0000 7f76d7e00640 1 -- 172.21.15.106:0/1014612238 shutdown_connections 2024-08-17T02:27:44.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.122+0000 7f76d7e00640 1 -- 172.21.15.106:0/1014612238 wait complete. 2024-08-17T02:27:44.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.123+0000 7f76d7e00640 1 Processor -- start 2024-08-17T02:27:44.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.123+0000 7f76d7e00640 1 -- start start 2024-08-17T02:27:44.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.124+0000 7f76d7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76d80cc700 0x7f76d8144fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.124+0000 7f76d7e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76d80ce790 0x7f76d8168e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.124+0000 7f76d7e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76d8158e50 0x7f76d80c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.124+0000 7f76d7e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d80c8600 con 0x7f76d8158e50 2024-08-17T02:27:44.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.124+0000 7f76d7e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d80c79f0 con 0x7f76d80ce790 2024-08-17T02:27:44.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.124+0000 7f76d7e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d80c7cd0 con 0x7f76d80cc700 2024-08-17T02:27:44.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.124+0000 7f76d7400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76d8158e50 0x7f76d80c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.124+0000 7f76d7400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76d8158e50 0x7f76d80c8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49962/0 (socket says 172.21.15.106:49962) 2024-08-17T02:27:44.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.124+0000 7f76d7400640 1 -- 172.21.15.106:0/422121927 learned_addr learned my addr 172.21.15.106:0/422121927 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:44.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.124+0000 7f76d6000640 1 --2- 172.21.15.106:0/422121927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76d80ce790 0x7f76d8168e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.124+0000 7f76d6a00640 1 --2- 172.21.15.106:0/422121927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76d80cc700 0x7f76d8144fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.125+0000 7f76d7400640 1 -- 172.21.15.106:0/422121927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76d80cc700 msgr2=0x7f76d8144fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.125+0000 7f76d7400640 1 --2- 172.21.15.106:0/422121927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76d80cc700 0x7f76d8144fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.125+0000 7f76d7400640 1 -- 172.21.15.106:0/422121927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76d80ce790 msgr2=0x7f76d8168e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.125+0000 7f76d7400640 1 --2- 172.21.15.106:0/422121927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76d80ce790 0x7f76d8168e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.125+0000 7f76d7400640 1 -- 172.21.15.106:0/422121927 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c8009a20 con 0x7f76d8158e50 2024-08-17T02:27:44.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.125+0000 7f76d7400640 1 --2- 172.21.15.106:0/422121927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76d8158e50 0x7f76d80c8a90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f76d000c4e0 tx=0x7f76d0007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:44.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.125+0000 7f76ce000640 1 -- 172.21.15.106:0/422121927 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d0012630 con 0x7f76d8158e50 2024-08-17T02:27:44.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.125+0000 7f76ce000640 1 -- 172.21.15.106:0/422121927 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d0012790 con 0x7f76d8158e50 2024-08-17T02:27:44.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.125+0000 7f76d7e00640 1 -- 172.21.15.106:0/422121927 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d80c7fb0 con 0x7f76d8158e50 2024-08-17T02:27:44.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.125+0000 7f76ce000640 1 -- 172.21.15.106:0/422121927 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d0012b50 con 0x7f76d8158e50 2024-08-17T02:27:44.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.125+0000 7f76d7e00640 1 -- 172.21.15.106:0/422121927 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d81454f0 con 0x7f76d8158e50 2024-08-17T02:27:44.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.126+0000 7f76d7e00640 1 -- 172.21.15.106:0/422121927 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d8145710 con 0x7f76d8158e50 2024-08-17T02:27:44.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.127+0000 7f76ce000640 1 -- 172.21.15.106:0/422121927 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f76d001b400 con 0x7f76d8158e50 2024-08-17T02:27:44.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.128+0000 7f76ce000640 1 --2- 172.21.15.106:0/422121927 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f76b4065150 0x7f76b4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.128+0000 7f76ce000640 1 -- 172.21.15.106:0/422121927 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f76d0081ae0 con 0x7f76d8158e50 2024-08-17T02:27:44.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.128+0000 7f76d6a00640 1 --2- 172.21.15.106:0/422121927 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f76b4065150 0x7f76b4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.129+0000 7f76d6a00640 1 --2- 172.21.15.106:0/422121927 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f76b4065150 0x7f76b4067600 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f76c8034000 tx=0x7f76c8037000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:44.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.132+0000 7f76ce000640 1 -- 172.21.15.106:0/422121927 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f76d004ff80 con 0x7f76d8158e50 2024-08-17T02:27:44.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.303+0000 7f76d7e00640 1 -- 172.21.15.106:0/422121927 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f76d8071050 con 0x7f76d8158e50 2024-08-17T02:27:44.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.303+0000 7f76ce000640 1 -- 172.21.15.106:0/422121927 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f76d00535a0 con 0x7f76d8158e50 2024-08-17T02:27:44.304 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-08-17T02:27:44.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.305+0000 7f76d7e00640 1 -- 172.21.15.106:0/422121927 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f76b4065150 msgr2=0x7f76b4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.305+0000 7f76d7e00640 1 --2- 172.21.15.106:0/422121927 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f76b4065150 0x7f76b4067600 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f76c8034000 tx=0x7f76c8037000 comp rx=0 tx=0).stop 2024-08-17T02:27:44.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.305+0000 7f76d7e00640 1 -- 172.21.15.106:0/422121927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76d8158e50 msgr2=0x7f76d80c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.305+0000 7f76d7e00640 1 --2- 172.21.15.106:0/422121927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76d8158e50 0x7f76d80c8a90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f76d000c4e0 tx=0x7f76d0007e60 comp rx=0 tx=0).stop 2024-08-17T02:27:44.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.305+0000 7f76d7e00640 1 -- 172.21.15.106:0/422121927 shutdown_connections 2024-08-17T02:27:44.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.305+0000 7f76d7e00640 1 --2- 172.21.15.106:0/422121927 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f76b4065150 0x7f76b4067600 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.305+0000 7f76d7e00640 1 --2- 172.21.15.106:0/422121927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76d8158e50 0x7f76d80c8a90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.305+0000 7f76d7e00640 1 --2- 172.21.15.106:0/422121927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76d80ce790 0x7f76d8168e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.305+0000 7f76d7e00640 1 --2- 172.21.15.106:0/422121927 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f76d80cc700 0x7f76d8144fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.305+0000 7f76d7e00640 1 -- 172.21.15.106:0/422121927 >> 172.21.15.106:0/422121927 conn(0x7f76d8098de0 msgr2=0x7f76d80d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:44.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.306+0000 7f76d7e00640 1 -- 172.21.15.106:0/422121927 shutdown_connections 2024-08-17T02:27:44.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.306+0000 7f76d7e00640 1 -- 172.21.15.106:0/422121927 wait complete. 2024-08-17T02:27:44.320 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:44.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.466+0000 7feaeca00640 1 Processor -- start 2024-08-17T02:27:44.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.467+0000 7feaeca00640 1 -- start start 2024-08-17T02:27:44.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.468+0000 7feaeca00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feae80cc010 0x7feae80ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.468+0000 7feaeca00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feae80a98e0 0x7feae80afe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.468+0000 7feaeca00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae80ab950 con 0x7feae80b03d0 2024-08-17T02:27:44.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.468+0000 7feaeca00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae80abc30 con 0x7feae80cc010 2024-08-17T02:27:44.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.468+0000 7feaeca00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae80abf10 con 0x7feae80a98e0 2024-08-17T02:27:44.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.468+0000 7feae6800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feae80cc010 0x7feae80ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.468+0000 7feae6800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feae80cc010 0x7feae80ab2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49976/0 (socket says 172.21.15.106:49976) 2024-08-17T02:27:44.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.468+0000 7feae6800640 1 -- 172.21.15.106:0/3180544005 learned_addr learned my addr 172.21.15.106:0/3180544005 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:44.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.468+0000 7feadde00640 1 --2- 172.21.15.106:0/3180544005 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feae80a98e0 0x7feae80afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.468+0000 7feae6800640 1 -- 172.21.15.106:0/3180544005 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feae80a98e0 msgr2=0x7feae80afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:44.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.468+0000 7feae6800640 1 --2- 172.21.15.106:0/3180544005 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feae80a98e0 0x7feae80afe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.468+0000 7feae6800640 1 -- 172.21.15.106:0/3180544005 >> v1:172.21.15.171:6789/0 conn(0x7feae80b03d0 legacy=0x7feae815c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:44.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.469+0000 7feae6800640 1 -- 172.21.15.106:0/3180544005 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae80af970 con 0x7feae80cc010 2024-08-17T02:27:44.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.469+0000 7feadde00640 1 --2- 172.21.15.106:0/3180544005 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feae80a98e0 0x7feae80afe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:44.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.469+0000 7feae6800640 1 --2- 172.21.15.106:0/3180544005 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feae80cc010 0x7feae80ab2b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fead8009910 tx=0x7fead80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b24d9b8f43b68d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:44.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.470+0000 7feae5e00640 1 -- 172.21.15.106:0/3180544005 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead802adb0 con 0x7feae80cc010 2024-08-17T02:27:44.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.470+0000 7feae5e00640 1 -- 172.21.15.106:0/3180544005 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead8032440 con 0x7feae80cc010 2024-08-17T02:27:44.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.470+0000 7feae5e00640 1 -- 172.21.15.106:0/3180544005 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead8032820 con 0x7feae80cc010 2024-08-17T02:27:44.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.470+0000 7feaeca00640 1 -- 172.21.15.106:0/3180544005 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feae80cc010 msgr2=0x7feae80ab2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.470+0000 7feaeca00640 1 --2- 172.21.15.106:0/3180544005 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feae80cc010 0x7feae80ab2b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fead8009910 tx=0x7fead80091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.470+0000 7feaeca00640 1 -- 172.21.15.106:0/3180544005 shutdown_connections 2024-08-17T02:27:44.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.470+0000 7feaeca00640 1 --2- 172.21.15.106:0/3180544005 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feae80a98e0 0x7feae80afe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.470+0000 7feaeca00640 1 --2- 172.21.15.106:0/3180544005 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feae80cc010 0x7feae80ab2b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.470+0000 7feaeca00640 1 -- 172.21.15.106:0/3180544005 >> 172.21.15.106:0/3180544005 conn(0x7feae8067de0 msgr2=0x7feae80681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:44.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.470+0000 7feaeca00640 1 -- 172.21.15.106:0/3180544005 shutdown_connections 2024-08-17T02:27:44.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.470+0000 7feaeca00640 1 -- 172.21.15.106:0/3180544005 wait complete. 2024-08-17T02:27:44.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.472+0000 7feaeca00640 1 Processor -- start 2024-08-17T02:27:44.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.472+0000 7feaeca00640 1 -- start start 2024-08-17T02:27:44.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.473+0000 7feaeca00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feae80a98e0 0x7feae8146710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.473+0000 7feaeca00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feae80b03d0 0x7feae80c1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.473+0000 7feaeca00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feae80cc010 0x7feae815b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.473+0000 7feaeca00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae816a920 con 0x7feae80cc010 2024-08-17T02:27:44.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.473+0000 7feaeca00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae80c2130 con 0x7feae80b03d0 2024-08-17T02:27:44.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.473+0000 7feaeca00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae80c2410 con 0x7feae80a98e0 2024-08-17T02:27:44.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.473+0000 7feae7200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feae80cc010 0x7feae815b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.473+0000 7feae6800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feae80a98e0 0x7feae8146710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.473+0000 7feadde00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feae80b03d0 0x7feae80c1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.473+0000 7feae7200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feae80cc010 0x7feae815b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49992/0 (socket says 172.21.15.106:49992) 2024-08-17T02:27:44.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.473+0000 7feae7200640 1 -- 172.21.15.106:0/782261972 learned_addr learned my addr 172.21.15.106:0/782261972 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:44.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.473+0000 7feae7200640 1 -- 172.21.15.106:0/782261972 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feae80a98e0 msgr2=0x7feae8146710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.473+0000 7feae7200640 1 --2- 172.21.15.106:0/782261972 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feae80a98e0 0x7feae8146710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.473+0000 7feae7200640 1 -- 172.21.15.106:0/782261972 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feae80b03d0 msgr2=0x7feae80c1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.473+0000 7feae7200640 1 --2- 172.21.15.106:0/782261972 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feae80b03d0 0x7feae80c1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.474+0000 7feae7200640 1 -- 172.21.15.106:0/782261972 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead8009450 con 0x7feae80cc010 2024-08-17T02:27:44.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.474+0000 7feae7200640 1 --2- 172.21.15.106:0/782261972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feae80cc010 0x7feae815b350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feae000c860 tx=0x7feae0001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:44.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.474+0000 7feadea00640 1 -- 172.21.15.106:0/782261972 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae000ce50 con 0x7feae80cc010 2024-08-17T02:27:44.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.474+0000 7feadea00640 1 -- 172.21.15.106:0/782261972 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae000a850 con 0x7feae80cc010 2024-08-17T02:27:44.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.474+0000 7feaeca00640 1 -- 172.21.15.106:0/782261972 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae816a5b0 con 0x7feae80cc010 2024-08-17T02:27:44.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.474+0000 7feadea00640 1 -- 172.21.15.106:0/782261972 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae000ac10 con 0x7feae80cc010 2024-08-17T02:27:44.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.474+0000 7feaeca00640 1 -- 172.21.15.106:0/782261972 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae80c2d10 con 0x7feae80cc010 2024-08-17T02:27:44.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.475+0000 7feaeca00640 1 -- 172.21.15.106:0/782261972 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae80b0010 con 0x7feae80cc010 2024-08-17T02:27:44.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.476+0000 7feadea00640 1 -- 172.21.15.106:0/782261972 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7feae0012630 con 0x7feae80cc010 2024-08-17T02:27:44.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.477+0000 7feadea00640 1 --2- 172.21.15.106:0/782261972 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7feac4065150 0x7feac4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:44.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.477+0000 7feadea00640 1 -- 172.21.15.106:0/782261972 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7feae0082320 con 0x7feae80cc010 2024-08-17T02:27:44.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.477+0000 7feae6800640 1 --2- 172.21.15.106:0/782261972 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7feac4065150 0x7feac4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:44.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.477+0000 7feae6800640 1 --2- 172.21.15.106:0/782261972 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7feac4065150 0x7feac4067600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fead8034000 tx=0x7fead8032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:44.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.480+0000 7feadea00640 1 -- 172.21.15.106:0/782261972 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7feae80b0010 con 0x7feae80cc010 2024-08-17T02:27:44.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.686+0000 7feaeca00640 1 -- 172.21.15.106:0/782261972 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feae80b0010 con 0x7feae80cc010 2024-08-17T02:27:44.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.687+0000 7feadea00640 1 -- 172.21.15.106:0/782261972 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1259 (secure 0 0 0) 0x7feae80b0010 con 0x7feae80cc010 2024-08-17T02:27:44.688 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:27:44.688 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1696744783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1696744783},{"type":"v1","addr":"172.21.15.106:6837","nonce":1696744783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-08-17T02:27:44.688 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 2 2024-08-17T02:27:44.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.689+0000 7feaeca00640 1 -- 172.21.15.106:0/782261972 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7feac4065150 msgr2=0x7feac4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.689+0000 7feaeca00640 1 --2- 172.21.15.106:0/782261972 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7feac4065150 0x7feac4067600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fead8034000 tx=0x7fead8032000 comp rx=0 tx=0).stop 2024-08-17T02:27:44.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.689+0000 7feaeca00640 1 -- 172.21.15.106:0/782261972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feae80cc010 msgr2=0x7feae815b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:44.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.689+0000 7feaeca00640 1 --2- 172.21.15.106:0/782261972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feae80cc010 0x7feae815b350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feae000c860 tx=0x7feae0001690 comp rx=0 tx=0).stop 2024-08-17T02:27:44.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.689+0000 7feaeca00640 1 -- 172.21.15.106:0/782261972 shutdown_connections 2024-08-17T02:27:44.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.689+0000 7feaeca00640 1 --2- 172.21.15.106:0/782261972 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7feac4065150 0x7feac4067600 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.689+0000 7feaeca00640 1 --2- 172.21.15.106:0/782261972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feae80cc010 0x7feae815b350 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.689+0000 7feaeca00640 1 --2- 172.21.15.106:0/782261972 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feae80b03d0 0x7feae80c1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.689+0000 7feaeca00640 1 --2- 172.21.15.106:0/782261972 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feae80a98e0 0x7feae8146710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:44.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.689+0000 7feaeca00640 1 -- 172.21.15.106:0/782261972 >> 172.21.15.106:0/782261972 conn(0x7feae8067de0 msgr2=0x7feae806d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:44.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.689+0000 7feaeca00640 1 -- 172.21.15.106:0/782261972 shutdown_connections 2024-08-17T02:27:44.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:44.689+0000 7feaeca00640 1 -- 172.21.15.106:0/782261972 wait complete. 2024-08-17T02:27:46.705 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:46.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.866+0000 7f79b2800640 1 Processor -- start 2024-08-17T02:27:46.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.866+0000 7f79b2800640 1 -- start start 2024-08-17T02:27:46.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.868+0000 7f79b2800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f79ac0b1440 0x7f79ac0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:46.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.868+0000 7f79b2800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f79ac140580 0x7f79ac0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:46.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.868+0000 7f79b2800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79ac0caa80 con 0x7f79ac1401b0 2024-08-17T02:27:46.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.868+0000 7f79b2800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79ac0cb450 con 0x7f79ac140580 2024-08-17T02:27:46.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.868+0000 7f79b2800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79ac0c9e70 con 0x7f79ac0b1440 2024-08-17T02:27:46.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.868+0000 7f79abe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f79ac140580 0x7f79ac0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:46.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.868+0000 7f79ab400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f79ac1401b0 0x7f79ac0b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:57132/0 (socket says 172.21.15.106:57132) 2024-08-17T02:27:46.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.868+0000 7f79ab400640 1 -- 172.21.15.106:0/3846467944 learned_addr learned my addr 172.21.15.106:0/3846467944 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:46.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.868+0000 7f79a2a00640 1 --2- 172.21.15.106:0/3846467944 >> v2:172.21.15.171:3300/0 conn(0x7f79ac0b1440 0x7f79ac0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:46.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.868+0000 7f79abe00640 1 -- 172.21.15.106:0/3846467944 >> v2:172.21.15.171:3300/0 conn(0x7f79ac0b1440 msgr2=0x7f79ac0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:46.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.868+0000 7f79abe00640 1 --2- 172.21.15.106:0/3846467944 >> v2:172.21.15.171:3300/0 conn(0x7f79ac0b1440 0x7f79ac0caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.868+0000 7f79abe00640 1 -- 172.21.15.106:0/3846467944 >> v1:172.21.15.106:6789/0 conn(0x7f79ac1401b0 legacy=0x7f79ac0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.868+0000 7f79abe00640 1 -- 172.21.15.106:0/3846467944 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ac0ca150 con 0x7f79ac140580 2024-08-17T02:27:46.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.868+0000 7f79aaa00640 1 -- 172.21.15.106:0/3846467944 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3313827652 0 0) 0x7f79ac0caa80 con 0x7f79ac1401b0 2024-08-17T02:27:46.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.869+0000 7f79abe00640 1 --2- 172.21.15.106:0/3846467944 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ac140580 0x7f79ac0c9040 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f79ac06aa80 tx=0x7f79a4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7537f39b8403e01 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:46.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.870+0000 7f79aaa00640 1 -- 172.21.15.106:0/3846467944 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a4007550 con 0x7f79ac140580 2024-08-17T02:27:46.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.870+0000 7f79aaa00640 1 -- 172.21.15.106:0/3846467944 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a402d050 con 0x7f79ac140580 2024-08-17T02:27:46.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.870+0000 7f79aaa00640 1 -- 172.21.15.106:0/3846467944 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a40078e0 con 0x7f79ac140580 2024-08-17T02:27:46.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.870+0000 7f79b2800640 1 -- 172.21.15.106:0/3846467944 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ac140580 msgr2=0x7f79ac0c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.870+0000 7f79b2800640 1 --2- 172.21.15.106:0/3846467944 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ac140580 0x7f79ac0c9040 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f79ac06aa80 tx=0x7f79a4009780 comp rx=0 tx=0).stop 2024-08-17T02:27:46.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.870+0000 7f79b2800640 1 -- 172.21.15.106:0/3846467944 shutdown_connections 2024-08-17T02:27:46.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.870+0000 7f79b2800640 1 --2- 172.21.15.106:0/3846467944 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ac140580 0x7f79ac0c9040 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.870+0000 7f79b2800640 1 --2- 172.21.15.106:0/3846467944 >> v2:172.21.15.171:3300/0 conn(0x7f79ac0b1440 0x7f79ac0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.870+0000 7f79b2800640 1 -- 172.21.15.106:0/3846467944 >> 172.21.15.106:0/3846467944 conn(0x7f79ac0cb9b0 msgr2=0x7f79ac0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:46.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.870+0000 7f79b2800640 1 -- 172.21.15.106:0/3846467944 shutdown_connections 2024-08-17T02:27:46.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.870+0000 7f79b2800640 1 -- 172.21.15.106:0/3846467944 wait complete. 2024-08-17T02:27:46.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.872+0000 7f79b2800640 1 Processor -- start 2024-08-17T02:27:46.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.872+0000 7f79b2800640 1 -- start start 2024-08-17T02:27:46.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.873+0000 7f79b2800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79ac0b1440 0x7f79ac1660d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:46.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.873+0000 7f79b2800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79ac1401b0 0x7f79ac0a8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:46.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.873+0000 7f79b2800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ac140580 0x7f79ac0a8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:46.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.873+0000 7f79b2800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac0a65c0 con 0x7f79ac140580 2024-08-17T02:27:46.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.873+0000 7f79b2800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac0a6e60 con 0x7f79ac1401b0 2024-08-17T02:27:46.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.873+0000 7f79b2800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac166610 con 0x7f79ac0b1440 2024-08-17T02:27:46.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.873+0000 7f79abe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ac140580 0x7f79ac0a8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:46.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.873+0000 7f79abe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ac140580 0x7f79ac0a8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50016/0 (socket says 172.21.15.106:50016) 2024-08-17T02:27:46.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.873+0000 7f79abe00640 1 -- 172.21.15.106:0/1824823739 learned_addr learned my addr 172.21.15.106:0/1824823739 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:46.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.873+0000 7f79a2a00640 1 --2- 172.21.15.106:0/1824823739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79ac1401b0 0x7f79ac0a8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:46.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.873+0000 7f79ab400640 1 --2- 172.21.15.106:0/1824823739 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79ac0b1440 0x7f79ac1660d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:46.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.874+0000 7f79abe00640 1 -- 172.21.15.106:0/1824823739 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79ac0b1440 msgr2=0x7f79ac1660d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.874+0000 7f79abe00640 1 --2- 172.21.15.106:0/1824823739 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79ac0b1440 0x7f79ac1660d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.874+0000 7f79abe00640 1 -- 172.21.15.106:0/1824823739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79ac1401b0 msgr2=0x7f79ac0a8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:46.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.874+0000 7f79abe00640 1 --2- 172.21.15.106:0/1824823739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79ac1401b0 0x7f79ac0a8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:46.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.874+0000 7f79abe00640 1 -- 172.21.15.106:0/1824823739 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a4009a20 con 0x7f79ac140580 2024-08-17T02:27:46.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.874+0000 7f79abe00640 1 --2- 172.21.15.106:0/1824823739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ac140580 0x7f79ac0a8b60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f79a4009e90 tx=0x7f79a4037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:46.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.874+0000 7f79a3400640 1 -- 172.21.15.106:0/1824823739 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a4031890 con 0x7f79ac140580 2024-08-17T02:27:46.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.874+0000 7f79a3400640 1 -- 172.21.15.106:0/1824823739 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a4040070 con 0x7f79ac140580 2024-08-17T02:27:46.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.874+0000 7f79a3400640 1 -- 172.21.15.106:0/1824823739 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a4031c20 con 0x7f79ac140580 2024-08-17T02:27:46.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.874+0000 7f79b2800640 1 -- 172.21.15.106:0/1824823739 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79ac0c7800 con 0x7f79ac140580 2024-08-17T02:27:46.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.875+0000 7f79b2800640 1 -- 172.21.15.106:0/1824823739 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79ac0a6af0 con 0x7f79ac140580 2024-08-17T02:27:46.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.875+0000 7f79b2800640 1 -- 172.21.15.106:0/1824823739 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79ac0a6fd0 con 0x7f79ac140580 2024-08-17T02:27:46.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.876+0000 7f79a3400640 1 -- 172.21.15.106:0/1824823739 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f79a4042030 con 0x7f79ac140580 2024-08-17T02:27:46.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.877+0000 7f79a3400640 1 --2- 172.21.15.106:0/1824823739 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7988065180 0x7f7988067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:46.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.877+0000 7f79a3400640 1 -- 172.21.15.106:0/1824823739 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f79a40a38f0 con 0x7f79ac140580 2024-08-17T02:27:46.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.877+0000 7f79ab400640 1 --2- 172.21.15.106:0/1824823739 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7988065180 0x7f7988067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:46.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.878+0000 7f79ab400640 1 --2- 172.21.15.106:0/1824823739 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7988065180 0x7f7988067630 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f799c0011e0 tx=0x7f799c007ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:46.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:46.881+0000 7f79a3400640 1 -- 172.21.15.106:0/1824823739 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f79a4071d10 con 0x7f79ac140580 2024-08-17T02:27:47.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.089+0000 7f79b2800640 1 -- 172.21.15.106:0/1824823739 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79ac064db0 con 0x7f79ac140580 2024-08-17T02:27:47.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.090+0000 7f79a3400640 1 -- 172.21.15.106:0/1824823739 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3533 (secure 0 0 0) 0x7f79a4075330 con 0x7f79ac140580 2024-08-17T02:27:47.090 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:27:47.090 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1696744783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1696744783},{"type":"v1","addr":"172.21.15.106:6837","nonce":1696744783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/966571689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":966571689},{"type":"v1","addr":"172.21.15.171:6833","nonce":966571689}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/3205379168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3205379168},{"type":"v1","addr":"172.21.15.106:6836","nonce":3205379168}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/3901195482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3901195482},{"type":"v1","addr":"172.21.15.171:6835","nonce":3901195482}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-08-17T02:27:47.091 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 3 2024-08-17T02:27:47.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.091+0000 7f79b2800640 1 -- 172.21.15.106:0/1824823739 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7988065180 msgr2=0x7f7988067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.091+0000 7f79b2800640 1 --2- 172.21.15.106:0/1824823739 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7988065180 0x7f7988067630 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f799c0011e0 tx=0x7f799c007ca0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.091+0000 7f79b2800640 1 -- 172.21.15.106:0/1824823739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ac140580 msgr2=0x7f79ac0a8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.091+0000 7f79b2800640 1 --2- 172.21.15.106:0/1824823739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ac140580 0x7f79ac0a8b60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f79a4009e90 tx=0x7f79a4037000 comp rx=0 tx=0).stop 2024-08-17T02:27:47.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.092+0000 7f79b2800640 1 -- 172.21.15.106:0/1824823739 shutdown_connections 2024-08-17T02:27:47.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.092+0000 7f79b2800640 1 --2- 172.21.15.106:0/1824823739 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7988065180 0x7f7988067630 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.092+0000 7f79b2800640 1 --2- 172.21.15.106:0/1824823739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ac140580 0x7f79ac0a8b60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.092+0000 7f79b2800640 1 --2- 172.21.15.106:0/1824823739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79ac1401b0 0x7f79ac0a8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.092+0000 7f79b2800640 1 --2- 172.21.15.106:0/1824823739 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79ac0b1440 0x7f79ac1660d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.092+0000 7f79b2800640 1 -- 172.21.15.106:0/1824823739 >> 172.21.15.106:0/1824823739 conn(0x7f79ac0cb9b0 msgr2=0x7f79ac0c0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:47.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.092+0000 7f79b2800640 1 -- 172.21.15.106:0/1824823739 shutdown_connections 2024-08-17T02:27:47.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.092+0000 7f79b2800640 1 -- 172.21.15.106:0/1824823739 wait complete. 2024-08-17T02:27:47.107 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:47.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.254+0000 7f52a7200640 1 Processor -- start 2024-08-17T02:27:47.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.254+0000 7f52a7200640 1 -- start start 2024-08-17T02:27:47.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.256+0000 7f52a7200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f52a00cc430 0x7f52a00cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.256+0000 7f52a7200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f52a0067ef0 0x7f52a0159820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.256+0000 7f52a7200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52a00ca700 con 0x7f52a0062da0 2024-08-17T02:27:47.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.256+0000 7f52a7200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a00682e0 con 0x7f52a0067ef0 2024-08-17T02:27:47.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.256+0000 7f52a7200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a0159d60 con 0x7f52a00cc430 2024-08-17T02:27:47.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.257+0000 7f52a5200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f52a0067ef0 0x7f52a0159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.257+0000 7f529f400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f52a0062da0 0x7f52a00cab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:57136/0 (socket says 172.21.15.106:57136) 2024-08-17T02:27:47.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.257+0000 7f529f400640 1 -- 172.21.15.106:0/2786416923 learned_addr learned my addr 172.21.15.106:0/2786416923 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:47.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.257+0000 7f529fe00640 1 --2- 172.21.15.106:0/2786416923 >> v2:172.21.15.171:3300/0 conn(0x7f52a00cc430 0x7f52a00cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.257+0000 7f52a5200640 1 -- 172.21.15.106:0/2786416923 >> v2:172.21.15.171:3300/0 conn(0x7f52a00cc430 msgr2=0x7f52a00cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:47.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.257+0000 7f52a5200640 1 --2- 172.21.15.106:0/2786416923 >> v2:172.21.15.171:3300/0 conn(0x7f52a00cc430 0x7f52a00cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.257+0000 7f52a5200640 1 -- 172.21.15.106:0/2786416923 >> v1:172.21.15.106:6789/0 conn(0x7f52a0062da0 legacy=0x7f52a00cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.257+0000 7f52a5200640 1 -- 172.21.15.106:0/2786416923 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a00684f0 con 0x7f52a0067ef0 2024-08-17T02:27:47.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.258+0000 7f52a5200640 1 --2- 172.21.15.106:0/2786416923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52a0067ef0 0x7f52a0159820 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f52a0070890 tx=0x7f5298009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1c6e4738a9f7cc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.258+0000 7f529ea00640 1 -- 172.21.15.106:0/2786416923 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5298007550 con 0x7f52a0067ef0 2024-08-17T02:27:47.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.258+0000 7f529ea00640 1 -- 172.21.15.106:0/2786416923 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529802d050 con 0x7f52a0067ef0 2024-08-17T02:27:47.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.258+0000 7f529ea00640 1 -- 172.21.15.106:0/2786416923 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5298007920 con 0x7f52a0067ef0 2024-08-17T02:27:47.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.259+0000 7f52a7200640 1 -- 172.21.15.106:0/2786416923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52a0067ef0 msgr2=0x7f52a0159820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.259+0000 7f52a7200640 1 --2- 172.21.15.106:0/2786416923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52a0067ef0 0x7f52a0159820 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f52a0070890 tx=0x7f5298009780 comp rx=0 tx=0).stop 2024-08-17T02:27:47.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.259+0000 7f52a7200640 1 -- 172.21.15.106:0/2786416923 shutdown_connections 2024-08-17T02:27:47.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.259+0000 7f52a7200640 1 --2- 172.21.15.106:0/2786416923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52a0067ef0 0x7f52a0159820 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.259+0000 7f52a7200640 1 --2- 172.21.15.106:0/2786416923 >> v2:172.21.15.171:3300/0 conn(0x7f52a00cc430 0x7f52a00cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.259+0000 7f52a7200640 1 -- 172.21.15.106:0/2786416923 >> 172.21.15.106:0/2786416923 conn(0x7f52a00afc30 msgr2=0x7f52a00b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:47.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.259+0000 7f52a7200640 1 -- 172.21.15.106:0/2786416923 shutdown_connections 2024-08-17T02:27:47.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.259+0000 7f52a7200640 1 -- 172.21.15.106:0/2786416923 wait complete. 2024-08-17T02:27:47.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.260+0000 7f52a7200640 1 Processor -- start 2024-08-17T02:27:47.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.260+0000 7f52a7200640 1 -- start start 2024-08-17T02:27:47.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.261+0000 7f52a7200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52a0062da0 0x7f52a00c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.261+0000 7f52a7200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52a0067ef0 0x7f52a00c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.261+0000 7f52a7200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52a00cc430 0x7f52a00ad5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.261+0000 7f52a7200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a01556c0 con 0x7f52a00cc430 2024-08-17T02:27:47.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.261+0000 7f52a7200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a016d8c0 con 0x7f52a0062da0 2024-08-17T02:27:47.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.261+0000 7f52a7200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a016d5e0 con 0x7f52a0067ef0 2024-08-17T02:27:47.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.261+0000 7f52a5200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52a00cc430 0x7f52a00ad5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.261+0000 7f52a5200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52a00cc430 0x7f52a00ad5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50030/0 (socket says 172.21.15.106:50030) 2024-08-17T02:27:47.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.261+0000 7f52a5200640 1 -- 172.21.15.106:0/2876503154 learned_addr learned my addr 172.21.15.106:0/2876503154 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:47.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.262+0000 7f529f400640 1 --2- 172.21.15.106:0/2876503154 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52a0067ef0 0x7f52a00c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.262+0000 7f529fe00640 1 --2- 172.21.15.106:0/2876503154 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52a0062da0 0x7f52a00c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.262+0000 7f52a5200640 1 -- 172.21.15.106:0/2876503154 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52a0067ef0 msgr2=0x7f52a00c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.262+0000 7f52a5200640 1 --2- 172.21.15.106:0/2876503154 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52a0067ef0 0x7f52a00c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.262+0000 7f52a5200640 1 -- 172.21.15.106:0/2876503154 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52a0062da0 msgr2=0x7f52a00c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.262+0000 7f52a5200640 1 --2- 172.21.15.106:0/2876503154 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52a0062da0 0x7f52a00c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.262+0000 7f52a5200640 1 -- 172.21.15.106:0/2876503154 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5298009a20 con 0x7f52a00cc430 2024-08-17T02:27:47.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.262+0000 7f52a5200640 1 --2- 172.21.15.106:0/2876503154 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52a00cc430 0x7f52a00ad5d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5298009e90 tx=0x7f5298037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.262+0000 7f5297400640 1 -- 172.21.15.106:0/2876503154 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5298031890 con 0x7f52a00cc430 2024-08-17T02:27:47.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.263+0000 7f5297400640 1 -- 172.21.15.106:0/2876503154 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5298040070 con 0x7f52a00cc430 2024-08-17T02:27:47.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.263+0000 7f5297400640 1 -- 172.21.15.106:0/2876503154 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5298031c20 con 0x7f52a00cc430 2024-08-17T02:27:47.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.263+0000 7f52a7200640 1 -- 172.21.15.106:0/2876503154 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a0097b60 con 0x7f52a00cc430 2024-08-17T02:27:47.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.263+0000 7f52a7200640 1 -- 172.21.15.106:0/2876503154 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a0098120 con 0x7f52a00cc430 2024-08-17T02:27:47.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.264+0000 7f52a7200640 1 -- 172.21.15.106:0/2876503154 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a0064db0 con 0x7f52a00cc430 2024-08-17T02:27:47.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.264+0000 7f5297400640 1 -- 172.21.15.106:0/2876503154 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5298042030 con 0x7f52a00cc430 2024-08-17T02:27:47.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.265+0000 7f5297400640 1 --2- 172.21.15.106:0/2876503154 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5280065150 0x7f5280067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.265+0000 7f5297400640 1 -- 172.21.15.106:0/2876503154 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f52980a37e0 con 0x7f52a00cc430 2024-08-17T02:27:47.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.265+0000 7f529fe00640 1 --2- 172.21.15.106:0/2876503154 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5280065150 0x7f5280067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.266+0000 7f529fe00640 1 --2- 172.21.15.106:0/2876503154 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5280065150 0x7f5280067600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5290009d20 tx=0x7f52900090f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.269+0000 7f5297400640 1 -- 172.21.15.106:0/2876503154 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5298071d60 con 0x7f52a00cc430 2024-08-17T02:27:47.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.441+0000 7f52a7200640 1 -- 172.21.15.106:0/2876503154 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52a0067cd0 con 0x7f52a00cc430 2024-08-17T02:27:47.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.441+0000 7f5297400640 1 -- 172.21.15.106:0/2876503154 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12175 (secure 0 0 0) 0x7f5298075380 con 0x7f52a00cc430 2024-08-17T02:27:47.442 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:27:47.442 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":16,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:27:40.169261+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:47.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.444+0000 7f52a7200640 1 -- 172.21.15.106:0/2876503154 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5280065150 msgr2=0x7f5280067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.444+0000 7f52a7200640 1 --2- 172.21.15.106:0/2876503154 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5280065150 0x7f5280067600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5290009d20 tx=0x7f52900090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.444+0000 7f52a7200640 1 -- 172.21.15.106:0/2876503154 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52a00cc430 msgr2=0x7f52a00ad5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.444+0000 7f52a7200640 1 --2- 172.21.15.106:0/2876503154 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52a00cc430 0x7f52a00ad5d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5298009e90 tx=0x7f5298037000 comp rx=0 tx=0).stop 2024-08-17T02:27:47.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.444+0000 7f52a7200640 1 -- 172.21.15.106:0/2876503154 shutdown_connections 2024-08-17T02:27:47.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.444+0000 7f52a7200640 1 --2- 172.21.15.106:0/2876503154 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5280065150 0x7f5280067600 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.444+0000 7f52a7200640 1 --2- 172.21.15.106:0/2876503154 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52a00cc430 0x7f52a00ad5d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.444+0000 7f52a7200640 1 --2- 172.21.15.106:0/2876503154 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52a0067ef0 0x7f52a00c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.444+0000 7f52a7200640 1 --2- 172.21.15.106:0/2876503154 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52a0062da0 0x7f52a00c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.444+0000 7f52a7200640 1 -- 172.21.15.106:0/2876503154 >> 172.21.15.106:0/2876503154 conn(0x7f52a00afc30 msgr2=0x7f52a006e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:47.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.444+0000 7f52a7200640 1 -- 172.21.15.106:0/2876503154 shutdown_connections 2024-08-17T02:27:47.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.444+0000 7f52a7200640 1 -- 172.21.15.106:0/2876503154 wait complete. 2024-08-17T02:27:47.459 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:37.928826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:27:47.460 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:27:47.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.608+0000 7f12ea000640 1 Processor -- start 2024-08-17T02:27:47.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.608+0000 7f12ea000640 1 -- start start 2024-08-17T02:27:47.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.609+0000 7f12ea000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f12e4159610 0x7f12e40b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.609+0000 7f12ea000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e40ae540 con 0x7f12e40accf0 2024-08-17T02:27:47.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.609+0000 7f12ea000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e40ad930 con 0x7f12e40afd90 2024-08-17T02:27:47.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.609+0000 7f12ea000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e40adc10 con 0x7f12e4159610 2024-08-17T02:27:47.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.609+0000 7f12e3400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f12e40accf0 0x7f12e40af680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:57152/0 (socket says 172.21.15.106:57152) 2024-08-17T02:27:47.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.609+0000 7f12e3400640 1 -- 172.21.15.106:0/3258197120 learned_addr learned my addr 172.21.15.106:0/3258197120 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:47.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.609+0000 7f12e3e00640 1 --2- 172.21.15.106:0/3258197120 >> v2:172.21.15.106:3300/0 conn(0x7f12e4159610 0x7f12e40b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.610+0000 7f12e3e00640 1 -- 172.21.15.106:0/3258197120 >> v1:172.21.15.171:6789/0 conn(0x7f12e40afd90 legacy=0x7f12e4157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.610+0000 7f12e3e00640 1 -- 172.21.15.106:0/3258197120 >> v1:172.21.15.106:6789/0 conn(0x7f12e40accf0 legacy=0x7f12e40af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.610+0000 7f12e2a00640 1 -- 172.21.15.106:0/3258197120 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365791270 0 0) 0x7f12e40ae540 con 0x7f12e40accf0 2024-08-17T02:27:47.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.610+0000 7f12e3e00640 1 -- 172.21.15.106:0/3258197120 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e40adef0 con 0x7f12e4159610 2024-08-17T02:27:47.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.611+0000 7f12e3e00640 1 --2- 172.21.15.106:0/3258197120 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12e4159610 0x7f12e40b1670 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f12dc009e90 tx=0x7f12dc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d03ae599548750f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.611+0000 7f12e2a00640 1 -- 172.21.15.106:0/3258197120 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc007550 con 0x7f12e4159610 2024-08-17T02:27:47.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.611+0000 7f12e2a00640 1 -- 172.21.15.106:0/3258197120 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12dc02d050 con 0x7f12e4159610 2024-08-17T02:27:47.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.611+0000 7f12e2a00640 1 -- 172.21.15.106:0/3258197120 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc0078e0 con 0x7f12e4159610 2024-08-17T02:27:47.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.612+0000 7f12ea000640 1 -- 172.21.15.106:0/3258197120 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12e4159610 msgr2=0x7f12e40b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.612+0000 7f12ea000640 1 --2- 172.21.15.106:0/3258197120 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12e4159610 0x7f12e40b1670 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f12dc009e90 tx=0x7f12dc009780 comp rx=0 tx=0).stop 2024-08-17T02:27:47.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.612+0000 7f12ea000640 1 -- 172.21.15.106:0/3258197120 shutdown_connections 2024-08-17T02:27:47.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.612+0000 7f12ea000640 1 --2- 172.21.15.106:0/3258197120 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12e4159610 0x7f12e40b1670 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.612+0000 7f12ea000640 1 -- 172.21.15.106:0/3258197120 >> 172.21.15.106:0/3258197120 conn(0x7f12e4067750 msgr2=0x7f12e40cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:47.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.612+0000 7f12ea000640 1 -- 172.21.15.106:0/3258197120 shutdown_connections 2024-08-17T02:27:47.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.612+0000 7f12ea000640 1 -- 172.21.15.106:0/3258197120 wait complete. 2024-08-17T02:27:47.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.613+0000 7f12ea000640 1 Processor -- start 2024-08-17T02:27:47.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.613+0000 7f12ea000640 1 -- start start 2024-08-17T02:27:47.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.614+0000 7f12ea000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12e40accf0 0x7f12e4169680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.614+0000 7f12ea000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12e40afd90 0x7f12e4144d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.614+0000 7f12ea000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12e4159610 0x7f12e40689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.614+0000 7f12ea000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e416abf0 con 0x7f12e4159610 2024-08-17T02:27:47.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.614+0000 7f12ea000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e4169fe0 con 0x7f12e40afd90 2024-08-17T02:27:47.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.614+0000 7f12ea000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e416a2c0 con 0x7f12e40accf0 2024-08-17T02:27:47.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.614+0000 7f12e3e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12e4159610 0x7f12e40689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.614+0000 7f12e3e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12e4159610 0x7f12e40689f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50048/0 (socket says 172.21.15.106:50048) 2024-08-17T02:27:47.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.614+0000 7f12e3e00640 1 -- 172.21.15.106:0/2932847144 learned_addr learned my addr 172.21.15.106:0/2932847144 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:47.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.615+0000 7f12e3400640 1 --2- 172.21.15.106:0/2932847144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12e40accf0 0x7f12e4169680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.615+0000 7f12daa00640 1 --2- 172.21.15.106:0/2932847144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12e40afd90 0x7f12e4144d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.615+0000 7f12e3e00640 1 -- 172.21.15.106:0/2932847144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12e40accf0 msgr2=0x7f12e4169680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.615+0000 7f12e3e00640 1 --2- 172.21.15.106:0/2932847144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12e40accf0 0x7f12e4169680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.615+0000 7f12e3e00640 1 -- 172.21.15.106:0/2932847144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12e40afd90 msgr2=0x7f12e4144d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.615+0000 7f12e3e00640 1 --2- 172.21.15.106:0/2932847144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12e40afd90 0x7f12e4144d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.615+0000 7f12e3e00640 1 -- 172.21.15.106:0/2932847144 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc009a20 con 0x7f12e4159610 2024-08-17T02:27:47.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.615+0000 7f12e3e00640 1 --2- 172.21.15.106:0/2932847144 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12e4159610 0x7f12e40689f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0099f0 tx=0x7f12dc037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.615+0000 7f12db400640 1 -- 172.21.15.106:0/2932847144 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc031e40 con 0x7f12e4159610 2024-08-17T02:27:47.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.615+0000 7f12db400640 1 -- 172.21.15.106:0/2932847144 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12dc03c420 con 0x7f12e4159610 2024-08-17T02:27:47.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.615+0000 7f12ea000640 1 -- 172.21.15.106:0/2932847144 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e416a5a0 con 0x7f12e4159610 2024-08-17T02:27:47.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.615+0000 7f12db400640 1 -- 172.21.15.106:0/2932847144 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc03c7e0 con 0x7f12e4159610 2024-08-17T02:27:47.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.616+0000 7f12ea000640 1 -- 172.21.15.106:0/2932847144 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e41669b0 con 0x7f12e4159610 2024-08-17T02:27:47.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.616+0000 7f12ea000640 1 -- 172.21.15.106:0/2932847144 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e416ad60 con 0x7f12e4159610 2024-08-17T02:27:47.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.617+0000 7f12db400640 1 -- 172.21.15.106:0/2932847144 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f12dc03cb90 con 0x7f12e4159610 2024-08-17T02:27:47.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.618+0000 7f12db400640 1 --2- 172.21.15.106:0/2932847144 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f12c0065150 0x7f12c0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.618+0000 7f12db400640 1 -- 172.21.15.106:0/2932847144 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f12dc0a3a70 con 0x7f12e4159610 2024-08-17T02:27:47.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.618+0000 7f12e3400640 1 --2- 172.21.15.106:0/2932847144 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f12c0065150 0x7f12c0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.619+0000 7f12e3400640 1 --2- 172.21.15.106:0/2932847144 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f12c0065150 0x7f12c0067600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f12d40011e0 tx=0x7f12d4007c80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.622+0000 7f12db400640 1 -- 172.21.15.106:0/2932847144 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f12dc071e90 con 0x7f12e4159610 2024-08-17T02:27:47.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.793+0000 7f12ea000640 1 -- 172.21.15.106:0/2932847144 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f12e4064db0 con 0x7f12e4159610 2024-08-17T02:27:47.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.794+0000 7f12db400640 1 -- 172.21.15.106:0/2932847144 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f12dc0754b0 con 0x7f12e4159610 2024-08-17T02:27:47.794 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-08-17T02:27:47.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.796+0000 7f12ea000640 1 -- 172.21.15.106:0/2932847144 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f12c0065150 msgr2=0x7f12c0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.796+0000 7f12ea000640 1 --2- 172.21.15.106:0/2932847144 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f12c0065150 0x7f12c0067600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f12d40011e0 tx=0x7f12d4007c80 comp rx=0 tx=0).stop 2024-08-17T02:27:47.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.796+0000 7f12ea000640 1 -- 172.21.15.106:0/2932847144 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12e4159610 msgr2=0x7f12e40689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.796+0000 7f12ea000640 1 --2- 172.21.15.106:0/2932847144 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12e4159610 0x7f12e40689f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0099f0 tx=0x7f12dc037000 comp rx=0 tx=0).stop 2024-08-17T02:27:47.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.796+0000 7f12ea000640 1 -- 172.21.15.106:0/2932847144 shutdown_connections 2024-08-17T02:27:47.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.796+0000 7f12ea000640 1 --2- 172.21.15.106:0/2932847144 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f12c0065150 0x7f12c0067600 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.796+0000 7f12ea000640 1 --2- 172.21.15.106:0/2932847144 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12e4159610 0x7f12e40689f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.796+0000 7f12ea000640 1 --2- 172.21.15.106:0/2932847144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12e40afd90 0x7f12e4144d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.796+0000 7f12ea000640 1 --2- 172.21.15.106:0/2932847144 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12e40accf0 0x7f12e4169680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.796+0000 7f12ea000640 1 -- 172.21.15.106:0/2932847144 >> 172.21.15.106:0/2932847144 conn(0x7f12e4067750 msgr2=0x7f12e4069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:47.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.796+0000 7f12ea000640 1 -- 172.21.15.106:0/2932847144 shutdown_connections 2024-08-17T02:27:47.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.796+0000 7f12ea000640 1 -- 172.21.15.106:0/2932847144 wait complete. 2024-08-17T02:27:47.811 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:27:47.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.958+0000 7f886b800640 1 Processor -- start 2024-08-17T02:27:47.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.958+0000 7f886b800640 1 -- start start 2024-08-17T02:27:47.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.960+0000 7f886b800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88640d08d0 0x7f88640c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.960+0000 7f886b800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f88640cb340 0x7f88641590b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.960+0000 7f886b800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88640cb7c0 con 0x7f8864158ce0 2024-08-17T02:27:47.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.960+0000 7f886b800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88640cf0c0 con 0x7f88640cb340 2024-08-17T02:27:47.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.960+0000 7f886b800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8864089000 con 0x7f88640d08d0 2024-08-17T02:27:47.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.960+0000 7f8869800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f88640cb340 0x7f88641590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.960+0000 7f8869800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f88640cb340 0x7f88641590b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50050/0 (socket says 172.21.15.106:50050) 2024-08-17T02:27:47.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.960+0000 7f8869800640 1 -- 172.21.15.106:0/4195370658 learned_addr learned my addr 172.21.15.106:0/4195370658 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:47.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.960+0000 7f885be00640 1 --2- 172.21.15.106:0/4195370658 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88640d08d0 0x7f88640c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.960+0000 7f8869800640 1 -- 172.21.15.106:0/4195370658 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88640d08d0 msgr2=0x7f88640c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:47.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.960+0000 7f8869800640 1 --2- 172.21.15.106:0/4195370658 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88640d08d0 0x7f88640c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.960+0000 7f8869800640 1 -- 172.21.15.106:0/4195370658 >> v1:172.21.15.171:6789/0 conn(0x7f8864158ce0 legacy=0x7f88640cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.960+0000 7f8869800640 1 -- 172.21.15.106:0/4195370658 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88640ceb20 con 0x7f88640cb340 2024-08-17T02:27:47.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.961+0000 7f8869800640 1 --2- 172.21.15.106:0/4195370658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88640cb340 0x7f88641590b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f885c009f50 tx=0x7f885c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=154c9d9ddccdc12c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.962+0000 7f8863e00640 1 -- 172.21.15.106:0/4195370658 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c031400 con 0x7f88640cb340 2024-08-17T02:27:47.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.962+0000 7f8863e00640 1 -- 172.21.15.106:0/4195370658 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c02d050 con 0x7f88640cb340 2024-08-17T02:27:47.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.962+0000 7f8863e00640 1 -- 172.21.15.106:0/4195370658 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c0317b0 con 0x7f88640cb340 2024-08-17T02:27:47.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.962+0000 7f886b800640 1 -- 172.21.15.106:0/4195370658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88640cb340 msgr2=0x7f88641590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.962+0000 7f886b800640 1 --2- 172.21.15.106:0/4195370658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88640cb340 0x7f88641590b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f885c009f50 tx=0x7f885c009840 comp rx=0 tx=0).stop 2024-08-17T02:27:47.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.962+0000 7f886b800640 1 -- 172.21.15.106:0/4195370658 shutdown_connections 2024-08-17T02:27:47.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.962+0000 7f886b800640 1 --2- 172.21.15.106:0/4195370658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88640cb340 0x7f88641590b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.962+0000 7f886b800640 1 --2- 172.21.15.106:0/4195370658 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88640d08d0 0x7f88640c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.962+0000 7f886b800640 1 -- 172.21.15.106:0/4195370658 >> 172.21.15.106:0/4195370658 conn(0x7f88640cfdc0 msgr2=0x7f88640d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:47.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.962+0000 7f886b800640 1 -- 172.21.15.106:0/4195370658 shutdown_connections 2024-08-17T02:27:47.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.962+0000 7f886b800640 1 -- 172.21.15.106:0/4195370658 wait complete. 2024-08-17T02:27:47.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.964+0000 7f886b800640 1 Processor -- start 2024-08-17T02:27:47.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.964+0000 7f886b800640 1 -- start start 2024-08-17T02:27:47.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.965+0000 7f886b800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88640cb340 0x7f88640b5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.965+0000 7f886b800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88640d08d0 0x7f8864150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.965+0000 7f886b800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8864158ce0 0x7f8864150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.965+0000 7f886b800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88641420c0 con 0x7f8864158ce0 2024-08-17T02:27:47.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.965+0000 7f886b800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88640b31c0 con 0x7f88640cb340 2024-08-17T02:27:47.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.965+0000 7f886b800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88640c82e0 con 0x7f88640d08d0 2024-08-17T02:27:47.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.965+0000 7f8869800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8864158ce0 0x7f8864150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.965+0000 7f8869800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8864158ce0 0x7f8864150e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50052/0 (socket says 172.21.15.106:50052) 2024-08-17T02:27:47.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.965+0000 7f8869800640 1 -- 172.21.15.106:0/734422827 learned_addr learned my addr 172.21.15.106:0/734422827 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:47.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.965+0000 7f8868e00640 1 --2- 172.21.15.106:0/734422827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88640cb340 0x7f88640b5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.965+0000 7f885be00640 1 --2- 172.21.15.106:0/734422827 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88640d08d0 0x7f8864150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.965+0000 7f8869800640 1 -- 172.21.15.106:0/734422827 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88640d08d0 msgr2=0x7f8864150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.965+0000 7f8869800640 1 --2- 172.21.15.106:0/734422827 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88640d08d0 0x7f8864150920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.965+0000 7f8869800640 1 -- 172.21.15.106:0/734422827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88640cb340 msgr2=0x7f88640b5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:47.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.965+0000 7f8869800640 1 --2- 172.21.15.106:0/734422827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88640cb340 0x7f88640b5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:47.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.965+0000 7f8869800640 1 -- 172.21.15.106:0/734422827 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c009ae0 con 0x7f8864158ce0 2024-08-17T02:27:47.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.965+0000 7f885be00640 1 --2- 172.21.15.106:0/734422827 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88640d08d0 0x7f8864150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:47.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.966+0000 7f8869800640 1 --2- 172.21.15.106:0/734422827 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8864158ce0 0x7f8864150e60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f885c009f50 tx=0x7f885c036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.966+0000 7f8860c00640 1 -- 172.21.15.106:0/734422827 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c008770 con 0x7f8864158ce0 2024-08-17T02:27:47.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.966+0000 7f8860c00640 1 -- 172.21.15.106:0/734422827 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c0088f0 con 0x7f8864158ce0 2024-08-17T02:27:47.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.966+0000 7f8860c00640 1 -- 172.21.15.106:0/734422827 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c008cb0 con 0x7f8864158ce0 2024-08-17T02:27:47.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.966+0000 7f886b800640 1 -- 172.21.15.106:0/734422827 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88640b2c00 con 0x7f8864158ce0 2024-08-17T02:27:47.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.966+0000 7f886b800640 1 -- 172.21.15.106:0/734422827 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88640c7f70 con 0x7f8864158ce0 2024-08-17T02:27:47.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.967+0000 7f886b800640 1 -- 172.21.15.106:0/734422827 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88640c8450 con 0x7f8864158ce0 2024-08-17T02:27:47.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.968+0000 7f8860c00640 1 -- 172.21.15.106:0/734422827 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f885c038050 con 0x7f8864158ce0 2024-08-17T02:27:47.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.968+0000 7f8860c00640 1 --2- 172.21.15.106:0/734422827 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8840065150 0x7f8840067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:47.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.969+0000 7f8860c00640 1 -- 172.21.15.106:0/734422827 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f885c0a25e0 con 0x7f8864158ce0 2024-08-17T02:27:47.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.969+0000 7f8868e00640 1 --2- 172.21.15.106:0/734422827 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8840065150 0x7f8840067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:47.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.969+0000 7f8868e00640 1 --2- 172.21.15.106:0/734422827 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8840065150 0x7f8840067600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8854007fd0 tx=0x7f8854007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:47.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:47.972+0000 7f8860c00640 1 -- 172.21.15.106:0/734422827 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f885c070a10 con 0x7f8864158ce0 2024-08-17T02:27:48.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.148+0000 7f886b800640 1 -- 172.21.15.106:0/734422827 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8864064db0 con 0x7f8864158ce0 2024-08-17T02:27:48.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.148+0000 7f8860c00640 1 -- 172.21.15.106:0/734422827 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f885c074030 con 0x7f8864158ce0 2024-08-17T02:27:48.149 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:27:48.149 INFO:teuthology.orchestra.run.smithi106.stdout:[ 2024-08-17T02:27:48.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:27:48.149 INFO:teuthology.orchestra.run.smithi106.stdout: "poolnum": 1, 2024-08-17T02:27:48.149 INFO:teuthology.orchestra.run.smithi106.stdout: "poolname": ".mgr" 2024-08-17T02:27:48.149 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:27:48.149 INFO:teuthology.orchestra.run.smithi106.stdout:] 2024-08-17T02:27:48.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.150+0000 7f886b800640 1 -- 172.21.15.106:0/734422827 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8840065150 msgr2=0x7f8840067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.150+0000 7f886b800640 1 --2- 172.21.15.106:0/734422827 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8840065150 0x7f8840067600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8854007fd0 tx=0x7f8854007e30 comp rx=0 tx=0).stop 2024-08-17T02:27:48.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.150+0000 7f886b800640 1 -- 172.21.15.106:0/734422827 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8864158ce0 msgr2=0x7f8864150e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.150+0000 7f886b800640 1 --2- 172.21.15.106:0/734422827 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8864158ce0 0x7f8864150e60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f885c009f50 tx=0x7f885c036000 comp rx=0 tx=0).stop 2024-08-17T02:27:48.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.150+0000 7f886b800640 1 -- 172.21.15.106:0/734422827 shutdown_connections 2024-08-17T02:27:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.150+0000 7f886b800640 1 --2- 172.21.15.106:0/734422827 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8840065150 0x7f8840067600 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.150+0000 7f886b800640 1 --2- 172.21.15.106:0/734422827 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8864158ce0 0x7f8864150e60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.150+0000 7f886b800640 1 --2- 172.21.15.106:0/734422827 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88640d08d0 0x7f8864150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.150+0000 7f886b800640 1 --2- 172.21.15.106:0/734422827 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88640cb340 0x7f88640b5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.150+0000 7f886b800640 1 -- 172.21.15.106:0/734422827 >> 172.21.15.106:0/734422827 conn(0x7f88640cfdc0 msgr2=0x7f88640cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.151+0000 7f886b800640 1 -- 172.21.15.106:0/734422827 shutdown_connections 2024-08-17T02:27:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.151+0000 7f886b800640 1 -- 172.21.15.106:0/734422827 wait complete. 2024-08-17T02:27:48.166 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:27:48.166 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:27:48.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.318+0000 7fab35200640 1 Processor -- start 2024-08-17T02:27:48.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.319+0000 7fab35200640 1 -- start start 2024-08-17T02:27:48.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.320+0000 7fab35200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fab3015a0e0 0x7fab3006e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.320+0000 7fab35200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab300ab010 0x7fab300ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.320+0000 7fab35200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab300af5f0 con 0x7fab3006df00 2024-08-17T02:27:48.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.320+0000 7fab35200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab30159600 con 0x7fab3015a0e0 2024-08-17T02:27:48.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.320+0000 7fab35200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab301598e0 con 0x7fab300ab010 2024-08-17T02:27:48.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.320+0000 7fab2f400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fab3006df00 0x7fab300aa900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:57166/0 (socket says 172.21.15.106:57166) 2024-08-17T02:27:48.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.320+0000 7fab2f400640 1 -- 172.21.15.106:0/2945823527 learned_addr learned my addr 172.21.15.106:0/2945823527 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:48.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.320+0000 7fab2fe00640 1 --2- 172.21.15.106:0/2945823527 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab300ab010 0x7fab300ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.320+0000 7fab2ea00640 1 -- 172.21.15.106:0/2945823527 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1654178514 0 0) 0x7fab300af5f0 con 0x7fab3006df00 2024-08-17T02:27:48.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.320+0000 7fab26a00640 1 --2- 172.21.15.106:0/2945823527 >> v2:172.21.15.171:3300/0 conn(0x7fab3015a0e0 0x7fab3006e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.320+0000 7fab2ea00640 1 -- 172.21.15.106:0/2945823527 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab140034e0 con 0x7fab3006df00 2024-08-17T02:27:48.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.321+0000 7fab2ea00640 1 -- 172.21.15.106:0/2945823527 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2261211934 0 0) 0x7fab140034e0 con 0x7fab3006df00 2024-08-17T02:27:48.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.321+0000 7fab2ea00640 1 -- 172.21.15.106:0/2945823527 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab300ab010 msgr2=0x7fab300ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:48.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.321+0000 7fab2ea00640 1 --2- 172.21.15.106:0/2945823527 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab300ab010 0x7fab300ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.321+0000 7fab2ea00640 1 -- 172.21.15.106:0/2945823527 >> v2:172.21.15.171:3300/0 conn(0x7fab3015a0e0 msgr2=0x7fab3006e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:48.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.321+0000 7fab2ea00640 1 --2- 172.21.15.106:0/2945823527 >> v2:172.21.15.171:3300/0 conn(0x7fab3015a0e0 0x7fab3006e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.321+0000 7fab2ea00640 1 -- 172.21.15.106:0/2945823527 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab30159bc0 con 0x7fab3006df00 2024-08-17T02:27:48.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.321+0000 7fab2ea00640 1 -- 172.21.15.106:0/2945823527 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7fab20001470 con 0x7fab3006df00 2024-08-17T02:27:48.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.321+0000 7fab2ea00640 1 -- 172.21.15.106:0/2945823527 >> v1:172.21.15.106:6789/0 conn(0x7fab3006df00 legacy=0x7fab300aa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.321+0000 7fab2ea00640 1 --2- 172.21.15.106:0/2945823527 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab300ab010 0x7fab14003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.321+0000 7fab2ea00640 1 --2- 172.21.15.106:0/2945823527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab14004020 0x7fab14004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.321+0000 7fab2ea00640 1 --2- 172.21.15.106:0/2945823527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab14004cc0 0x7fab14005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.321+0000 7fab2ea00640 1 -- 172.21.15.106:0/2945823527 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab30159600 con 0x7fab14004020 2024-08-17T02:27:48.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.321+0000 7fab2ea00640 1 -- 172.21.15.106:0/2945823527 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab301598e0 con 0x7fab14004cc0 2024-08-17T02:27:48.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.321+0000 7fab2ea00640 1 -- 172.21.15.106:0/2945823527 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1400bad0 con 0x7fab300ab010 2024-08-17T02:27:48.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.321+0000 7fab26a00640 1 --2- 172.21.15.106:0/2945823527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab14004020 0x7fab14004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.321+0000 7fab2f400640 1 --2- 172.21.15.106:0/2945823527 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab300ab010 0x7fab14003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.321+0000 7fab2fe00640 1 --2- 172.21.15.106:0/2945823527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab14004cc0 0x7fab14005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.321+0000 7fab26a00640 1 -- 172.21.15.106:0/2945823527 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab300ab010 msgr2=0x7fab14003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:48.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.321+0000 7fab26a00640 1 --2- 172.21.15.106:0/2945823527 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab300ab010 0x7fab14003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.321+0000 7fab26a00640 1 -- 172.21.15.106:0/2945823527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab14004cc0 msgr2=0x7fab14005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:48.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.321+0000 7fab26a00640 1 --2- 172.21.15.106:0/2945823527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab14004cc0 0x7fab14005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.322+0000 7fab26a00640 1 -- 172.21.15.106:0/2945823527 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab140034e0 con 0x7fab14004020 2024-08-17T02:27:48.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.322+0000 7fab2f400640 1 --2- 172.21.15.106:0/2945823527 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab300ab010 0x7fab14003a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:48.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.322+0000 7fab2fe00640 1 --2- 172.21.15.106:0/2945823527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab14004cc0 0x7fab14005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:48.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.322+0000 7fab26a00640 1 --2- 172.21.15.106:0/2945823527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab14004020 0x7fab14004780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fab18006e70 tx=0x7fab180090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed91106d675a8df9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:48.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.323+0000 7fab2ea00640 1 -- 172.21.15.106:0/2945823527 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab18031400 con 0x7fab14004020 2024-08-17T02:27:48.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.323+0000 7fab2ea00640 1 -- 172.21.15.106:0/2945823527 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1802d050 con 0x7fab14004020 2024-08-17T02:27:48.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.323+0000 7fab2ea00640 1 -- 172.21.15.106:0/2945823527 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab18031790 con 0x7fab14004020 2024-08-17T02:27:48.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.323+0000 7fab35200640 1 -- 172.21.15.106:0/2945823527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab14004020 msgr2=0x7fab14004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.323+0000 7fab35200640 1 --2- 172.21.15.106:0/2945823527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab14004020 0x7fab14004780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fab18006e70 tx=0x7fab180090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.323+0000 7fab2fe00640 1 -- 172.21.15.106:0/2945823527 reap_dead start 2024-08-17T02:27:48.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.323+0000 7fab35200640 1 -- 172.21.15.106:0/2945823527 shutdown_connections 2024-08-17T02:27:48.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.323+0000 7fab35200640 1 -- 172.21.15.106:0/2945823527 >> 172.21.15.106:0/2945823527 conn(0x7fab30067750 msgr2=0x7fab3006c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:48.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.323+0000 7fab35200640 1 -- 172.21.15.106:0/2945823527 shutdown_connections 2024-08-17T02:27:48.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.323+0000 7fab35200640 1 -- 172.21.15.106:0/2945823527 wait complete. 2024-08-17T02:27:48.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.325+0000 7fab35200640 1 Processor -- start 2024-08-17T02:27:48.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.325+0000 7fab35200640 1 -- start start 2024-08-17T02:27:48.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.326+0000 7fab35200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab14004020 0x7fab3013b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.326+0000 7fab35200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab3013b6b0 0x7fab3013a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.326+0000 7fab35200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab3013a7d0 0x7fab30138650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.326+0000 7fab35200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab30154940 con 0x7fab14004020 2024-08-17T02:27:48.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.326+0000 7fab35200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab301391f0 con 0x7fab3013b6b0 2024-08-17T02:27:48.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.326+0000 7fab35200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab301394d0 con 0x7fab3013a7d0 2024-08-17T02:27:48.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.326+0000 7fab2f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab14004020 0x7fab3013b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.326+0000 7fab2f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab14004020 0x7fab3013b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50076/0 (socket says 172.21.15.106:50076) 2024-08-17T02:27:48.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.326+0000 7fab2f400640 1 -- 172.21.15.106:0/2060095899 learned_addr learned my addr 172.21.15.106:0/2060095899 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:48.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.326+0000 7fab2fe00640 1 --2- 172.21.15.106:0/2060095899 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab3013a7d0 0x7fab30138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.326+0000 7fab26a00640 1 --2- 172.21.15.106:0/2060095899 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab3013b6b0 0x7fab3013a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.326+0000 7fab2f400640 1 -- 172.21.15.106:0/2060095899 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab3013a7d0 msgr2=0x7fab30138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.326+0000 7fab2f400640 1 --2- 172.21.15.106:0/2060095899 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab3013a7d0 0x7fab30138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.326+0000 7fab2f400640 1 -- 172.21.15.106:0/2060095899 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab3013b6b0 msgr2=0x7fab3013a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:48.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.326+0000 7fab2f400640 1 --2- 172.21.15.106:0/2060095899 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab3013b6b0 0x7fab3013a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:48.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.326+0000 7fab2f400640 1 -- 172.21.15.106:0/2060095899 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab301397b0 con 0x7fab14004020 2024-08-17T02:27:48.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.326+0000 7fab26a00640 1 --2- 172.21.15.106:0/2060095899 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab3013b6b0 0x7fab3013a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:48.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.327+0000 7fab2f400640 1 --2- 172.21.15.106:0/2060095899 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab14004020 0x7fab3013b170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fab2000e990 tx=0x7fab300b1500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:48.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.327+0000 7fab27400640 1 -- 172.21.15.106:0/2060095899 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2000c7f0 con 0x7fab14004020 2024-08-17T02:27:48.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.327+0000 7fab27400640 1 -- 172.21.15.106:0/2060095899 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2000c950 con 0x7fab14004020 2024-08-17T02:27:48.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.327+0000 7fab27400640 1 -- 172.21.15.106:0/2060095899 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2000cd10 con 0x7fab14004020 2024-08-17T02:27:48.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.327+0000 7fab35200640 1 -- 172.21.15.106:0/2060095899 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab30139a90 con 0x7fab14004020 2024-08-17T02:27:48.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.327+0000 7fab35200640 1 -- 172.21.15.106:0/2060095899 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab30138b90 con 0x7fab14004020 2024-08-17T02:27:48.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.328+0000 7fab35200640 1 -- 172.21.15.106:0/2060095899 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab30139f10 con 0x7fab14004020 2024-08-17T02:27:48.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.329+0000 7fab27400640 1 -- 172.21.15.106:0/2060095899 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fab20013630 con 0x7fab14004020 2024-08-17T02:27:48.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.330+0000 7fab27400640 1 --2- 172.21.15.106:0/2060095899 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fab0c065150 0x7fab0c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:48.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.330+0000 7fab27400640 1 -- 172.21.15.106:0/2060095899 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fab200820c0 con 0x7fab14004020 2024-08-17T02:27:48.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.330+0000 7fab26a00640 1 --2- 172.21.15.106:0/2060095899 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fab0c065150 0x7fab0c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:48.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.331+0000 7fab26a00640 1 --2- 172.21.15.106:0/2060095899 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fab0c065150 0x7fab0c067600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fab18034000 tx=0x7fab18035000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:48.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.334+0000 7fab27400640 1 -- 172.21.15.106:0/2060095899 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fab20050430 con 0x7fab14004020 2024-08-17T02:27:48.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:48.509+0000 7fab35200640 1 -- 172.21.15.106:0/2060095899 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fab30071050 con 0x7fab14004020 2024-08-17T02:27:49.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.267+0000 7fab27400640 1 -- 172.21.15.106:0/2060095899 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fab20053a50 con 0x7fab14004020 2024-08-17T02:27:49.268 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_metadata' created 2024-08-17T02:27:49.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.270+0000 7fab35200640 1 -- 172.21.15.106:0/2060095899 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fab0c065150 msgr2=0x7fab0c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.270+0000 7fab35200640 1 --2- 172.21.15.106:0/2060095899 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fab0c065150 0x7fab0c067600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fab18034000 tx=0x7fab18035000 comp rx=0 tx=0).stop 2024-08-17T02:27:49.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.270+0000 7fab35200640 1 -- 172.21.15.106:0/2060095899 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab14004020 msgr2=0x7fab3013b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.270+0000 7fab35200640 1 --2- 172.21.15.106:0/2060095899 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab14004020 0x7fab3013b170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fab2000e990 tx=0x7fab300b1500 comp rx=0 tx=0).stop 2024-08-17T02:27:49.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.270+0000 7fab35200640 1 -- 172.21.15.106:0/2060095899 shutdown_connections 2024-08-17T02:27:49.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.270+0000 7fab35200640 1 --2- 172.21.15.106:0/2060095899 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fab3013a7d0 0x7fab30138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.270+0000 7fab35200640 1 --2- 172.21.15.106:0/2060095899 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fab3013b6b0 0x7fab3013a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.271+0000 7fab35200640 1 --2- 172.21.15.106:0/2060095899 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fab0c065150 0x7fab0c067600 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.271+0000 7fab35200640 1 --2- 172.21.15.106:0/2060095899 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fab14004020 0x7fab3013b170 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.271+0000 7fab35200640 1 -- 172.21.15.106:0/2060095899 >> 172.21.15.106:0/2060095899 conn(0x7fab30067750 msgr2=0x7fab3006c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:49.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.271+0000 7fab35200640 1 -- 172.21.15.106:0/2060095899 shutdown_connections 2024-08-17T02:27:49.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.271+0000 7fab35200640 1 -- 172.21.15.106:0/2060095899 wait complete. 2024-08-17T02:27:49.292 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:27:49.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.444+0000 7f58d6a00640 1 Processor -- start 2024-08-17T02:27:49.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.445+0000 7f58d6a00640 1 -- start start 2024-08-17T02:27:49.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.446+0000 7f58d6a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f58d0150130 0x7f58d00aa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.446+0000 7f58d6a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58d0156d40 0x7f58d006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.446+0000 7f58d6a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d01568b0 con 0x7f58d006e420 2024-08-17T02:27:49.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.446+0000 7f58d6a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d006e8a0 con 0x7f58d0150130 2024-08-17T02:27:49.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.446+0000 7f58d6a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d0150500 con 0x7f58d0156d40 2024-08-17T02:27:49.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.446+0000 7f58d4a00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f58d006e420 0x7f58d00afbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:57168/0 (socket says 172.21.15.106:57168) 2024-08-17T02:27:49.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.446+0000 7f58d4a00640 1 -- 172.21.15.106:0/1801108018 learned_addr learned my addr 172.21.15.106:0/1801108018 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:49.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.446+0000 7f58cf400640 1 --2- 172.21.15.106:0/1801108018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58d0156d40 0x7f58d006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.447+0000 7f58cfe00640 1 --2- 172.21.15.106:0/1801108018 >> v2:172.21.15.171:3300/0 conn(0x7f58d0150130 0x7f58d00aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.447+0000 7f58cea00640 1 -- 172.21.15.106:0/1801108018 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 29578054 0 0) 0x7f58d01568b0 con 0x7f58d006e420 2024-08-17T02:27:49.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.447+0000 7f58cea00640 1 -- 172.21.15.106:0/1801108018 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58b40034e0 con 0x7f58d006e420 2024-08-17T02:27:49.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.447+0000 7f58cea00640 1 -- 172.21.15.106:0/1801108018 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2275979797 0 0) 0x7f58b40034e0 con 0x7f58d006e420 2024-08-17T02:27:49.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.447+0000 7f58cea00640 1 -- 172.21.15.106:0/1801108018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58d0156d40 msgr2=0x7f58d006dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:49.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.447+0000 7f58cea00640 1 --2- 172.21.15.106:0/1801108018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58d0156d40 0x7f58d006dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.447+0000 7f58cea00640 1 -- 172.21.15.106:0/1801108018 >> v2:172.21.15.171:3300/0 conn(0x7f58d0150130 msgr2=0x7f58d00aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:49.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.447+0000 7f58cea00640 1 --2- 172.21.15.106:0/1801108018 >> v2:172.21.15.171:3300/0 conn(0x7f58d0150130 0x7f58d00aa730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.447+0000 7f58cea00640 1 -- 172.21.15.106:0/1801108018 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d0155fc0 con 0x7f58d006e420 2024-08-17T02:27:49.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.447+0000 7f58cea00640 1 -- 172.21.15.106:0/1801108018 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7f58c80017f0 con 0x7f58d006e420 2024-08-17T02:27:49.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.447+0000 7f58cf400640 1 --2- 172.21.15.106:0/1801108018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58d0156d40 0x7f58d006dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:49.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.447+0000 7f58cea00640 1 -- 172.21.15.106:0/1801108018 >> v1:172.21.15.106:6789/0 conn(0x7f58d006e420 legacy=0x7f58d00afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.447+0000 7f58cea00640 1 --2- 172.21.15.106:0/1801108018 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58b40039d0 0x7f58b4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.447+0000 7f58cea00640 1 --2- 172.21.15.106:0/1801108018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58d0156d40 0x7f58b4004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.447+0000 7f58cea00640 1 --2- 172.21.15.106:0/1801108018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58b4004cc0 0x7f58b4005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.447+0000 7f58cea00640 1 -- 172.21.15.106:0/1801108018 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d006e8a0 con 0x7f58b40039d0 2024-08-17T02:27:49.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.447+0000 7f58cea00640 1 -- 172.21.15.106:0/1801108018 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d0150500 con 0x7f58b4004cc0 2024-08-17T02:27:49.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.447+0000 7f58cea00640 1 -- 172.21.15.106:0/1801108018 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b400b9d0 con 0x7f58d0156d40 2024-08-17T02:27:49.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.447+0000 7f58cfe00640 1 --2- 172.21.15.106:0/1801108018 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58b40039d0 0x7f58b4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.447+0000 7f58cf400640 1 --2- 172.21.15.106:0/1801108018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58d0156d40 0x7f58b4004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.447+0000 7f58d4a00640 1 --2- 172.21.15.106:0/1801108018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58b4004cc0 0x7f58b4005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.448+0000 7f58cfe00640 1 -- 172.21.15.106:0/1801108018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58d0156d40 msgr2=0x7f58b4004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:49.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.448+0000 7f58cfe00640 1 --2- 172.21.15.106:0/1801108018 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58d0156d40 0x7f58b4004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.448+0000 7f58cfe00640 1 -- 172.21.15.106:0/1801108018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58b4004cc0 msgr2=0x7f58b4005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:49.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.448+0000 7f58cfe00640 1 --2- 172.21.15.106:0/1801108018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58b4004cc0 0x7f58b4005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.448+0000 7f58cfe00640 1 -- 172.21.15.106:0/1801108018 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58bc009390 con 0x7f58b40039d0 2024-08-17T02:27:49.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.448+0000 7f58d4a00640 1 --2- 172.21.15.106:0/1801108018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58b4004cc0 0x7f58b4005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:49.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.449+0000 7f58cfe00640 1 --2- 172.21.15.106:0/1801108018 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58b40039d0 0x7f58b4003de0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f58c0009b70 tx=0x7f58c00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aacb5851ecfc3a16 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.449+0000 7f58cea00640 1 -- 172.21.15.106:0/1801108018 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c0031400 con 0x7f58b40039d0 2024-08-17T02:27:49.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.449+0000 7f58cea00640 1 -- 172.21.15.106:0/1801108018 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c002d050 con 0x7f58b40039d0 2024-08-17T02:27:49.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.449+0000 7f58cea00640 1 -- 172.21.15.106:0/1801108018 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c0031790 con 0x7f58b40039d0 2024-08-17T02:27:49.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.449+0000 7f58d6a00640 1 -- 172.21.15.106:0/1801108018 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58b40039d0 msgr2=0x7f58b4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.449+0000 7f58d6a00640 1 --2- 172.21.15.106:0/1801108018 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58b40039d0 0x7f58b4003de0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f58c0009b70 tx=0x7f58c00090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.449+0000 7f58d4a00640 1 -- 172.21.15.106:0/1801108018 reap_dead start 2024-08-17T02:27:49.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.450+0000 7f58d6a00640 1 -- 172.21.15.106:0/1801108018 shutdown_connections 2024-08-17T02:27:49.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.450+0000 7f58d6a00640 1 -- 172.21.15.106:0/1801108018 >> 172.21.15.106:0/1801108018 conn(0x7f58d0067750 msgr2=0x7f58d006c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:49.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.450+0000 7f58d6a00640 1 -- 172.21.15.106:0/1801108018 shutdown_connections 2024-08-17T02:27:49.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.450+0000 7f58d6a00640 1 -- 172.21.15.106:0/1801108018 wait complete. 2024-08-17T02:27:49.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.451+0000 7f58d6a00640 1 Processor -- start 2024-08-17T02:27:49.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.451+0000 7f58d6a00640 1 -- start start 2024-08-17T02:27:49.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.452+0000 7f58d6a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58b40039d0 0x7f58d014f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.452+0000 7f58d6a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58d00aa120 0x7f58d0133b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.452+0000 7f58d6a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58d014da70 0x7f58d01506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.452+0000 7f58d6a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d014f9d0 con 0x7f58b40039d0 2024-08-17T02:27:49.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.452+0000 7f58d6a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d0149950 con 0x7f58d00aa120 2024-08-17T02:27:49.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.452+0000 7f58d6a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d014e3f0 con 0x7f58d014da70 2024-08-17T02:27:49.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.452+0000 7f58cfe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58b40039d0 0x7f58d014f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.452+0000 7f58cfe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58b40039d0 0x7f58d014f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:50086/0 (socket says 172.21.15.106:50086) 2024-08-17T02:27:49.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.452+0000 7f58cfe00640 1 -- 172.21.15.106:0/4112147454 learned_addr learned my addr 172.21.15.106:0/4112147454 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:49.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.452+0000 7f58cf400640 1 --2- 172.21.15.106:0/4112147454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58d00aa120 0x7f58d0133b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.452+0000 7f58d4a00640 1 --2- 172.21.15.106:0/4112147454 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58d014da70 0x7f58d01506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.453+0000 7f58cfe00640 1 -- 172.21.15.106:0/4112147454 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58d014da70 msgr2=0x7f58d01506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.453+0000 7f58cfe00640 1 --2- 172.21.15.106:0/4112147454 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58d014da70 0x7f58d01506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.453+0000 7f58cfe00640 1 -- 172.21.15.106:0/4112147454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58d00aa120 msgr2=0x7f58d0133b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:49.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.453+0000 7f58cfe00640 1 --2- 172.21.15.106:0/4112147454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58d00aa120 0x7f58d0133b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:49.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.453+0000 7f58cfe00640 1 -- 172.21.15.106:0/4112147454 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d014e6d0 con 0x7f58b40039d0 2024-08-17T02:27:49.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.453+0000 7f58cfe00640 1 --2- 172.21.15.106:0/4112147454 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58b40039d0 0x7f58d014f490 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f58c002aaf0 tx=0x7f58c0035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.453+0000 7f58c7400640 1 -- 172.21.15.106:0/4112147454 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c0030850 con 0x7f58b40039d0 2024-08-17T02:27:49.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.453+0000 7f58c7400640 1 -- 172.21.15.106:0/4112147454 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c00309b0 con 0x7f58b40039d0 2024-08-17T02:27:49.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.453+0000 7f58c7400640 1 -- 172.21.15.106:0/4112147454 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c0030d70 con 0x7f58b40039d0 2024-08-17T02:27:49.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.453+0000 7f58d6a00640 1 -- 172.21.15.106:0/4112147454 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d014e9b0 con 0x7f58b40039d0 2024-08-17T02:27:49.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.453+0000 7f58d6a00640 1 -- 172.21.15.106:0/4112147454 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d014ef70 con 0x7f58b40039d0 2024-08-17T02:27:49.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.454+0000 7f58d6a00640 1 -- 172.21.15.106:0/4112147454 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d00710c0 con 0x7f58b40039d0 2024-08-17T02:27:49.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.455+0000 7f58c7400640 1 -- 172.21.15.106:0/4112147454 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f58c003c630 con 0x7f58b40039d0 2024-08-17T02:27:49.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.456+0000 7f58c7400640 1 --2- 172.21.15.106:0/4112147454 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f58b0065150 0x7f58b0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:49.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.456+0000 7f58c7400640 1 -- 172.21.15.106:0/4112147454 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f58c00a35e0 con 0x7f58b40039d0 2024-08-17T02:27:49.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.456+0000 7f58cf400640 1 --2- 172.21.15.106:0/4112147454 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f58b0065150 0x7f58b0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:49.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.457+0000 7f58cf400640 1 --2- 172.21.15.106:0/4112147454 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f58b0065150 0x7f58b0067600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f58d006de90 tx=0x7f58bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:49.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.461+0000 7f58c7400640 1 -- 172.21.15.106:0/4112147454 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f58c00717e0 con 0x7f58b40039d0 2024-08-17T02:27:49.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:49.633+0000 7f58d6a00640 1 -- 172.21.15.106:0/4112147454 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f58d00acf60 con 0x7f58b40039d0 2024-08-17T02:27:50.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.276+0000 7f58c7400640 1 -- 172.21.15.106:0/4112147454 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f58c0074e00 con 0x7f58b40039d0 2024-08-17T02:27:50.277 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_data' created 2024-08-17T02:27:50.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.282+0000 7f58d6a00640 1 -- 172.21.15.106:0/4112147454 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f58b0065150 msgr2=0x7f58b0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.282+0000 7f58d6a00640 1 --2- 172.21.15.106:0/4112147454 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f58b0065150 0x7f58b0067600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f58d006de90 tx=0x7f58bc008040 comp rx=0 tx=0).stop 2024-08-17T02:27:50.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.282+0000 7f58d6a00640 1 -- 172.21.15.106:0/4112147454 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58b40039d0 msgr2=0x7f58d014f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.282+0000 7f58d6a00640 1 --2- 172.21.15.106:0/4112147454 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58b40039d0 0x7f58d014f490 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f58c002aaf0 tx=0x7f58c0035000 comp rx=0 tx=0).stop 2024-08-17T02:27:50.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.282+0000 7f58d6a00640 1 -- 172.21.15.106:0/4112147454 shutdown_connections 2024-08-17T02:27:50.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.282+0000 7f58d6a00640 1 --2- 172.21.15.106:0/4112147454 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58d014da70 0x7f58d01506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.282+0000 7f58d6a00640 1 --2- 172.21.15.106:0/4112147454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58d00aa120 0x7f58d0133b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.282+0000 7f58d6a00640 1 --2- 172.21.15.106:0/4112147454 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f58b0065150 0x7f58b0067600 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.282+0000 7f58d6a00640 1 --2- 172.21.15.106:0/4112147454 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58b40039d0 0x7f58d014f490 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.282+0000 7f58d6a00640 1 -- 172.21.15.106:0/4112147454 >> 172.21.15.106:0/4112147454 conn(0x7f58d0067750 msgr2=0x7f58d0069fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:50.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.283+0000 7f58d6a00640 1 -- 172.21.15.106:0/4112147454 shutdown_connections 2024-08-17T02:27:50.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.284+0000 7f58d6a00640 1 -- 172.21.15.106:0/4112147454 wait complete. 2024-08-17T02:27:50.309 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:27:50.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.458+0000 7f9deae00640 1 Processor -- start 2024-08-17T02:27:50.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.458+0000 7f9deae00640 1 -- start start 2024-08-17T02:27:50.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.460+0000 7f9deae00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9de4069230 0x7f9de4069600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.460+0000 7f9deae00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9de4096e70 0x7f9de40abfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.460+0000 7f9deae00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de40ac4f0 con 0x7f9de4067de0 2024-08-17T02:27:50.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.460+0000 7f9deae00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9de40ad010 con 0x7f9de4069230 2024-08-17T02:27:50.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.460+0000 7f9deae00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9de40ae3a0 con 0x7f9de4096e70 2024-08-17T02:27:50.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.460+0000 7f9de9a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9de4069230 0x7f9de4069600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.460+0000 7f9de9a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9de4069230 0x7f9de4069600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56300/0 (socket says 172.21.15.106:56300) 2024-08-17T02:27:50.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.460+0000 7f9de9a00640 1 -- 172.21.15.106:0/829294676 learned_addr learned my addr 172.21.15.106:0/829294676 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:50.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.460+0000 7f9de9a00640 1 -- 172.21.15.106:0/829294676 >> v2:172.21.15.171:3300/0 conn(0x7f9de4096e70 msgr2=0x7f9de40abfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:50.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.460+0000 7f9de9a00640 1 --2- 172.21.15.106:0/829294676 >> v2:172.21.15.171:3300/0 conn(0x7f9de4096e70 0x7f9de40abfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.460+0000 7f9de9a00640 1 -- 172.21.15.106:0/829294676 >> v1:172.21.15.171:6789/0 conn(0x7f9de4067de0 legacy=0x7f9de40681e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:50.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.460+0000 7f9de9a00640 1 -- 172.21.15.106:0/829294676 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de40ac770 con 0x7f9de4069230 2024-08-17T02:27:50.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.461+0000 7f9de9a00640 1 --2- 172.21.15.106:0/829294676 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9de4069230 0x7f9de4069600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9de40974f0 tx=0x7f9dd80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ba3aa953db7280 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.462+0000 7f9de3e00640 1 -- 172.21.15.106:0/829294676 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd802ad50 con 0x7f9de4069230 2024-08-17T02:27:50.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.462+0000 7f9de3e00640 1 -- 172.21.15.106:0/829294676 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd8032440 con 0x7f9de4069230 2024-08-17T02:27:50.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.462+0000 7f9de3e00640 1 -- 172.21.15.106:0/829294676 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8032820 con 0x7f9de4069230 2024-08-17T02:27:50.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.462+0000 7f9deae00640 1 -- 172.21.15.106:0/829294676 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9de4069230 msgr2=0x7f9de4069600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.462+0000 7f9deae00640 1 --2- 172.21.15.106:0/829294676 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9de4069230 0x7f9de4069600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9de40974f0 tx=0x7f9dd80091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.462+0000 7f9deae00640 1 -- 172.21.15.106:0/829294676 shutdown_connections 2024-08-17T02:27:50.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.462+0000 7f9deae00640 1 --2- 172.21.15.106:0/829294676 >> v2:172.21.15.171:3300/0 conn(0x7f9de4096e70 0x7f9de40abfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.462+0000 7f9deae00640 1 --2- 172.21.15.106:0/829294676 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9de4069230 0x7f9de4069600 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.462+0000 7f9deae00640 1 -- 172.21.15.106:0/829294676 >> 172.21.15.106:0/829294676 conn(0x7f9de4096a70 msgr2=0x7f9de40cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:50.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.462+0000 7f9deae00640 1 -- 172.21.15.106:0/829294676 shutdown_connections 2024-08-17T02:27:50.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.462+0000 7f9deae00640 1 -- 172.21.15.106:0/829294676 wait complete. 2024-08-17T02:27:50.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.464+0000 7f9deae00640 1 Processor -- start 2024-08-17T02:27:50.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.464+0000 7f9deae00640 1 -- start start 2024-08-17T02:27:50.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.464+0000 7f9deae00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9de4067de0 0x7f9de4150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.464+0000 7f9deae00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9de4069230 0x7f9de40b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.464+0000 7f9deae00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9de4096e70 0x7f9de4154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.465+0000 7f9deae00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de4150bb0 con 0x7f9de4069230 2024-08-17T02:27:50.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.465+0000 7f9deae00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de40b19a0 con 0x7f9de4067de0 2024-08-17T02:27:50.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.465+0000 7f9deae00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de40b0ab0 con 0x7f9de4096e70 2024-08-17T02:27:50.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.465+0000 7f9de9000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9de4069230 0x7f9de40b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.465+0000 7f9de9000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9de4069230 0x7f9de40b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56308/0 (socket says 172.21.15.106:56308) 2024-08-17T02:27:50.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.465+0000 7f9de9000640 1 -- 172.21.15.106:0/210454194 learned_addr learned my addr 172.21.15.106:0/210454194 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:50.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.465+0000 7f9de9a00640 1 --2- 172.21.15.106:0/210454194 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9de4067de0 0x7f9de4150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.465+0000 7f9dea400640 1 --2- 172.21.15.106:0/210454194 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9de4096e70 0x7f9de4154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.465+0000 7f9de9000640 1 -- 172.21.15.106:0/210454194 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9de4096e70 msgr2=0x7f9de4154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.465+0000 7f9de9000640 1 --2- 172.21.15.106:0/210454194 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9de4096e70 0x7f9de4154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.465+0000 7f9de9000640 1 -- 172.21.15.106:0/210454194 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9de4067de0 msgr2=0x7f9de4150670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:50.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.465+0000 7f9de9000640 1 --2- 172.21.15.106:0/210454194 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9de4067de0 0x7f9de4150670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:50.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.465+0000 7f9de9000640 1 -- 172.21.15.106:0/210454194 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd8009450 con 0x7f9de4069230 2024-08-17T02:27:50.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.465+0000 7f9dea400640 1 --2- 172.21.15.106:0/210454194 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9de4096e70 0x7f9de4154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:50.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.465+0000 7f9de9a00640 1 --2- 172.21.15.106:0/210454194 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9de4067de0 0x7f9de4150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:50.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.465+0000 7f9de9000640 1 --2- 172.21.15.106:0/210454194 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9de4069230 0x7f9de40b1e30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000b810 tx=0x7f9dd00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.466+0000 7f9de0c00640 1 -- 172.21.15.106:0/210454194 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd000be60 con 0x7f9de4069230 2024-08-17T02:27:50.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.466+0000 7f9de0c00640 1 -- 172.21.15.106:0/210454194 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd000c730 con 0x7f9de4069230 2024-08-17T02:27:50.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.466+0000 7f9de0c00640 1 -- 172.21.15.106:0/210454194 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd000cb10 con 0x7f9de4069230 2024-08-17T02:27:50.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.466+0000 7f9deae00640 1 -- 172.21.15.106:0/210454194 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de40b0d90 con 0x7f9de4069230 2024-08-17T02:27:50.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.466+0000 7f9deae00640 1 -- 172.21.15.106:0/210454194 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de40b1350 con 0x7f9de4069230 2024-08-17T02:27:50.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.467+0000 7f9deae00640 1 -- 172.21.15.106:0/210454194 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de4071050 con 0x7f9de4069230 2024-08-17T02:27:50.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.468+0000 7f9de0c00640 1 -- 172.21.15.106:0/210454194 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9dd0012070 con 0x7f9de4069230 2024-08-17T02:27:50.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.468+0000 7f9de0c00640 1 --2- 172.21.15.106:0/210454194 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9dc4065150 0x7f9dc4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:50.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.469+0000 7f9de0c00640 1 -- 172.21.15.106:0/210454194 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f9dd0081a50 con 0x7f9de4069230 2024-08-17T02:27:50.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.469+0000 7f9de9a00640 1 --2- 172.21.15.106:0/210454194 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9dc4065150 0x7f9dc4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:50.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.469+0000 7f9de9a00640 1 --2- 172.21.15.106:0/210454194 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9dc4065150 0x7f9dc4067600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8034000 tx=0x7f9dd8032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:50.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.473+0000 7f9de0c00640 1 -- 172.21.15.106:0/210454194 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9dd004fad0 con 0x7f9de4069230 2024-08-17T02:27:50.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:50.681+0000 7f9deae00640 1 -- 172.21.15.106:0/210454194 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9de40b1ae0 con 0x7f9de4069230 2024-08-17T02:27:51.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.279+0000 7f9de0c00640 1 -- 172.21.15.106:0/210454194 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9dd00530f0 con 0x7f9de4069230 2024-08-17T02:27:51.280 INFO:teuthology.orchestra.run.smithi106.stderr:new fs with metadata pool 2 and data pool 3 2024-08-17T02:27:51.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.284+0000 7f9deae00640 1 -- 172.21.15.106:0/210454194 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9dc4065150 msgr2=0x7f9dc4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.284+0000 7f9deae00640 1 --2- 172.21.15.106:0/210454194 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9dc4065150 0x7f9dc4067600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8034000 tx=0x7f9dd8032000 comp rx=0 tx=0).stop 2024-08-17T02:27:51.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.284+0000 7f9deae00640 1 -- 172.21.15.106:0/210454194 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9de4069230 msgr2=0x7f9de40b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.284+0000 7f9deae00640 1 --2- 172.21.15.106:0/210454194 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9de4069230 0x7f9de40b1e30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000b810 tx=0x7f9dd00091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.287+0000 7f9deae00640 1 -- 172.21.15.106:0/210454194 shutdown_connections 2024-08-17T02:27:51.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.287+0000 7f9deae00640 1 --2- 172.21.15.106:0/210454194 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9de4096e70 0x7f9de4154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.287+0000 7f9deae00640 1 --2- 172.21.15.106:0/210454194 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9dc4065150 0x7f9dc4067600 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.287+0000 7f9deae00640 1 --2- 172.21.15.106:0/210454194 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9de4069230 0x7f9de40b1e30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.287+0000 7f9deae00640 1 --2- 172.21.15.106:0/210454194 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9de4067de0 0x7f9de4150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.287+0000 7f9deae00640 1 -- 172.21.15.106:0/210454194 >> 172.21.15.106:0/210454194 conn(0x7f9de4096a70 msgr2=0x7f9de406a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:51.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.287+0000 7f9deae00640 1 -- 172.21.15.106:0/210454194 shutdown_connections 2024-08-17T02:27:51.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.288+0000 7f9deae00640 1 -- 172.21.15.106:0/210454194 wait complete. 2024-08-17T02:27:51.315 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:51.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.461+0000 7f2a4f200640 1 Processor -- start 2024-08-17T02:27:51.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.461+0000 7f2a4f200640 1 -- start start 2024-08-17T02:27:51.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.462+0000 7f2a4f200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2a48158ce0 0x7f2a480c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.462+0000 7f2a4f200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a480d08d0 0x7f2a481590b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.462+0000 7f2a4f200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a480cb7c0 con 0x7f2a480cac30 2024-08-17T02:27:51.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.462+0000 7f2a4f200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a480cf0c0 con 0x7f2a48158ce0 2024-08-17T02:27:51.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.462+0000 7f2a4f200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a48089000 con 0x7f2a480d08d0 2024-08-17T02:27:51.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.462+0000 7f2a47e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2a48158ce0 0x7f2a480c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.462+0000 7f2a4d200640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2a480cac30 0x7f2a480cb0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39794/0 (socket says 172.21.15.106:39794) 2024-08-17T02:27:51.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.462+0000 7f2a4d200640 1 -- 172.21.15.106:0/3001215781 learned_addr learned my addr 172.21.15.106:0/3001215781 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:51.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.463+0000 7f2a3f400640 1 --2- 172.21.15.106:0/3001215781 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a480d08d0 0x7f2a481590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.463+0000 7f2a47e00640 1 -- 172.21.15.106:0/3001215781 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a480d08d0 msgr2=0x7f2a481590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:51.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.463+0000 7f2a47e00640 1 --2- 172.21.15.106:0/3001215781 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a480d08d0 0x7f2a481590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.463+0000 7f2a47e00640 1 -- 172.21.15.106:0/3001215781 >> v1:172.21.15.106:6789/0 conn(0x7f2a480cac30 legacy=0x7f2a480cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.463+0000 7f2a47e00640 1 -- 172.21.15.106:0/3001215781 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a480ceb20 con 0x7f2a48158ce0 2024-08-17T02:27:51.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.463+0000 7f2a47400640 1 -- 172.21.15.106:0/3001215781 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 777389923 0 0) 0x7f2a480cb7c0 con 0x7f2a480cac30 2024-08-17T02:27:51.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.464+0000 7f2a47e00640 1 --2- 172.21.15.106:0/3001215781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a48158ce0 0x7f2a480c68c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2a38009880 tx=0x7f2a380090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b49d6ccac4fecb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.464+0000 7f2a47400640 1 -- 172.21.15.106:0/3001215781 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3802ad70 con 0x7f2a48158ce0 2024-08-17T02:27:51.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.464+0000 7f2a47400640 1 -- 172.21.15.106:0/3001215781 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a38032440 con 0x7f2a48158ce0 2024-08-17T02:27:51.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.464+0000 7f2a47400640 1 -- 172.21.15.106:0/3001215781 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a380327e0 con 0x7f2a48158ce0 2024-08-17T02:27:51.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.465+0000 7f2a4f200640 1 -- 172.21.15.106:0/3001215781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a48158ce0 msgr2=0x7f2a480c68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.465+0000 7f2a4f200640 1 --2- 172.21.15.106:0/3001215781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a48158ce0 0x7f2a480c68c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2a38009880 tx=0x7f2a380090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.465+0000 7f2a4f200640 1 -- 172.21.15.106:0/3001215781 shutdown_connections 2024-08-17T02:27:51.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.465+0000 7f2a4f200640 1 --2- 172.21.15.106:0/3001215781 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a480d08d0 0x7f2a481590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.465+0000 7f2a4f200640 1 --2- 172.21.15.106:0/3001215781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a48158ce0 0x7f2a480c68c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.465+0000 7f2a4f200640 1 -- 172.21.15.106:0/3001215781 >> 172.21.15.106:0/3001215781 conn(0x7f2a480cfdc0 msgr2=0x7f2a480d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:51.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.465+0000 7f2a4f200640 1 -- 172.21.15.106:0/3001215781 shutdown_connections 2024-08-17T02:27:51.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.465+0000 7f2a4f200640 1 -- 172.21.15.106:0/3001215781 wait complete. 2024-08-17T02:27:51.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.466+0000 7f2a4f200640 1 Processor -- start 2024-08-17T02:27:51.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.466+0000 7f2a4f200640 1 -- start start 2024-08-17T02:27:51.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.467+0000 7f2a4f200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a480cac30 0x7f2a480c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.467+0000 7f2a4f200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a480d08d0 0x7f2a481574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.467+0000 7f2a4f200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a48158ce0 0x7f2a480b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.467+0000 7f2a4f200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a480c8e90 con 0x7f2a48158ce0 2024-08-17T02:27:51.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.467+0000 7f2a4f200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a480c8280 con 0x7f2a480d08d0 2024-08-17T02:27:51.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.467+0000 7f2a4f200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a480c8560 con 0x7f2a480cac30 2024-08-17T02:27:51.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.467+0000 7f2a4d200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a48158ce0 0x7f2a480b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.468+0000 7f2a4d200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a48158ce0 0x7f2a480b3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56322/0 (socket says 172.21.15.106:56322) 2024-08-17T02:27:51.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.468+0000 7f2a4d200640 1 -- 172.21.15.106:0/1907684885 learned_addr learned my addr 172.21.15.106:0/1907684885 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:51.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.468+0000 7f2a3f400640 1 --2- 172.21.15.106:0/1907684885 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a480d08d0 0x7f2a481574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.468+0000 7f2a47e00640 1 --2- 172.21.15.106:0/1907684885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a480cac30 0x7f2a480c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.468+0000 7f2a4d200640 1 -- 172.21.15.106:0/1907684885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a480cac30 msgr2=0x7f2a480c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.468+0000 7f2a4d200640 1 --2- 172.21.15.106:0/1907684885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a480cac30 0x7f2a480c9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.468+0000 7f2a4d200640 1 -- 172.21.15.106:0/1907684885 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a480d08d0 msgr2=0x7f2a481574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.468+0000 7f2a4d200640 1 --2- 172.21.15.106:0/1907684885 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a480d08d0 0x7f2a481574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.468+0000 7f2a4d200640 1 -- 172.21.15.106:0/1907684885 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a38009390 con 0x7f2a48158ce0 2024-08-17T02:27:51.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.468+0000 7f2a4d200640 1 --2- 172.21.15.106:0/1907684885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a48158ce0 0x7f2a480b3490 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2a4000cc90 tx=0x7f2a40001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.468+0000 7f2a3fe00640 1 -- 172.21.15.106:0/1907684885 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4000a8e0 con 0x7f2a48158ce0 2024-08-17T02:27:51.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.468+0000 7f2a3fe00640 1 -- 172.21.15.106:0/1907684885 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4000aa40 con 0x7f2a48158ce0 2024-08-17T02:27:51.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.468+0000 7f2a4f200640 1 -- 172.21.15.106:0/1907684885 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a480c8840 con 0x7f2a48158ce0 2024-08-17T02:27:51.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.468+0000 7f2a3fe00640 1 -- 172.21.15.106:0/1907684885 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4000ae00 con 0x7f2a48158ce0 2024-08-17T02:27:51.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.469+0000 7f2a4f200640 1 -- 172.21.15.106:0/1907684885 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a480c7f10 con 0x7f2a48158ce0 2024-08-17T02:27:51.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.470+0000 7f2a4f200640 1 -- 172.21.15.106:0/1907684885 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a480c9040 con 0x7f2a48158ce0 2024-08-17T02:27:51.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.470+0000 7f2a3fe00640 1 -- 172.21.15.106:0/1907684885 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2a40007300 con 0x7f2a48158ce0 2024-08-17T02:27:51.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.471+0000 7f2a3fe00640 1 --2- 172.21.15.106:0/1907684885 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2a24065150 0x7f2a24067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.471+0000 7f2a3fe00640 1 -- 172.21.15.106:0/1907684885 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2a40082580 con 0x7f2a48158ce0 2024-08-17T02:27:51.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.471+0000 7f2a47e00640 1 --2- 172.21.15.106:0/1907684885 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2a24065150 0x7f2a24067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.472+0000 7f2a47e00640 1 --2- 172.21.15.106:0/1907684885 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2a24065150 0x7f2a24067600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2a38034000 tx=0x7f2a38032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.475+0000 7f2a3fe00640 1 -- 172.21.15.106:0/1907684885 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2a480c9040 con 0x7f2a48158ce0 2024-08-17T02:27:51.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.651+0000 7f2a4f200640 1 -- 172.21.15.106:0/1907684885 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a48064db0 con 0x7f2a48158ce0 2024-08-17T02:27:51.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.652+0000 7f2a3fe00640 1 -- 172.21.15.106:0/1907684885 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f2a400506d0 con 0x7f2a48158ce0 2024-08-17T02:27:51.652 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:27:51.653 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":19,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:27:50.683117+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:48.547438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:49.671073+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:51.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.654+0000 7f2a4f200640 1 -- 172.21.15.106:0/1907684885 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2a24065150 msgr2=0x7f2a24067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.654+0000 7f2a4f200640 1 --2- 172.21.15.106:0/1907684885 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2a24065150 0x7f2a24067600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2a38034000 tx=0x7f2a38032000 comp rx=0 tx=0).stop 2024-08-17T02:27:51.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.654+0000 7f2a4f200640 1 -- 172.21.15.106:0/1907684885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a48158ce0 msgr2=0x7f2a480b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.654+0000 7f2a4f200640 1 --2- 172.21.15.106:0/1907684885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a48158ce0 0x7f2a480b3490 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2a4000cc90 tx=0x7f2a40001a80 comp rx=0 tx=0).stop 2024-08-17T02:27:51.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.654+0000 7f2a4f200640 1 -- 172.21.15.106:0/1907684885 shutdown_connections 2024-08-17T02:27:51.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.654+0000 7f2a4f200640 1 --2- 172.21.15.106:0/1907684885 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2a24065150 0x7f2a24067600 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.654+0000 7f2a4f200640 1 --2- 172.21.15.106:0/1907684885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a48158ce0 0x7f2a480b3490 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.654+0000 7f2a4f200640 1 --2- 172.21.15.106:0/1907684885 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a480d08d0 0x7f2a481574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.654+0000 7f2a4f200640 1 --2- 172.21.15.106:0/1907684885 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a480cac30 0x7f2a480c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.654+0000 7f2a4f200640 1 -- 172.21.15.106:0/1907684885 >> 172.21.15.106:0/1907684885 conn(0x7f2a480cfdc0 msgr2=0x7f2a480cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:51.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.654+0000 7f2a4f200640 1 -- 172.21.15.106:0/1907684885 shutdown_connections 2024-08-17T02:27:51.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.654+0000 7f2a4f200640 1 -- 172.21.15.106:0/1907684885 wait complete. 2024-08-17T02:27:51.670 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:51.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.816+0000 7ff8abe00640 1 Processor -- start 2024-08-17T02:27:51.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.816+0000 7ff8abe00640 1 -- start start 2024-08-17T02:27:51.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.817+0000 7ff8abe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff8ac159ca0 0x7ff8ac0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.817+0000 7ff8abe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8ac0ca8a0 0x7ff8ac0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.817+0000 7ff8abe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff8ac0ccad0 0x7ff8ac0cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.817+0000 7ff8abe00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8ac0cd6e0 con 0x7ff8ac159ca0 2024-08-17T02:27:51.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.817+0000 7ff8abe00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8ac0ccf70 con 0x7ff8ac0ccad0 2024-08-17T02:27:51.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.817+0000 7ff8abe00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac0cadc0 con 0x7ff8ac0ca8a0 2024-08-17T02:27:51.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.817+0000 7ff8aaa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff8ac159ca0 0x7ff8ac0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.817+0000 7ff8aaa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff8ac159ca0 0x7ff8ac0ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56330/0 (socket says 172.21.15.106:56330) 2024-08-17T02:27:51.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.817+0000 7ff8aaa00640 1 -- 172.21.15.106:0/3412132389 learned_addr learned my addr 172.21.15.106:0/3412132389 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:51.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.817+0000 7ff8a3e00640 1 --2- 172.21.15.106:0/3412132389 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8ac0ca8a0 0x7ff8ac0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.817+0000 7ff8ab400640 1 --2- 172.21.15.106:0/3412132389 >> v2:172.21.15.171:3300/0 conn(0x7ff8ac0ccad0 0x7ff8ac0cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.818+0000 7ff8aaa00640 1 -- 172.21.15.106:0/3412132389 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8ac0ca8a0 msgr2=0x7ff8ac0cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:51.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.818+0000 7ff8aaa00640 1 --2- 172.21.15.106:0/3412132389 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8ac0ca8a0 0x7ff8ac0cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.818+0000 7ff8aaa00640 1 -- 172.21.15.106:0/3412132389 >> v2:172.21.15.171:3300/0 conn(0x7ff8ac0ccad0 msgr2=0x7ff8ac0cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:51.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.818+0000 7ff8aaa00640 1 --2- 172.21.15.106:0/3412132389 >> v2:172.21.15.171:3300/0 conn(0x7ff8ac0ccad0 0x7ff8ac0cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.818+0000 7ff8aaa00640 1 -- 172.21.15.106:0/3412132389 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ac0cb060 con 0x7ff8ac159ca0 2024-08-17T02:27:51.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.818+0000 7ff8ab400640 1 --2- 172.21.15.106:0/3412132389 >> v2:172.21.15.171:3300/0 conn(0x7ff8ac0ccad0 0x7ff8ac0cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:51.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.819+0000 7ff8aaa00640 1 --2- 172.21.15.106:0/3412132389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8ac159ca0 0x7ff8ac0ca360 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac0b5c60 tx=0x7ff89c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=559117dafb2754ac server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.819+0000 7ff8aa000640 1 -- 172.21.15.106:0/3412132389 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c02add0 con 0x7ff8ac159ca0 2024-08-17T02:27:51.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.819+0000 7ff8aa000640 1 -- 172.21.15.106:0/3412132389 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89c032440 con 0x7ff8ac159ca0 2024-08-17T02:27:51.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.819+0000 7ff8aa000640 1 -- 172.21.15.106:0/3412132389 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89c032820 con 0x7ff8ac159ca0 2024-08-17T02:27:51.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.819+0000 7ff8abe00640 1 -- 172.21.15.106:0/3412132389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8ac159ca0 msgr2=0x7ff8ac0ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.820+0000 7ff8abe00640 1 --2- 172.21.15.106:0/3412132389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8ac159ca0 0x7ff8ac0ca360 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac0b5c60 tx=0x7ff89c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.820+0000 7ff8abe00640 1 -- 172.21.15.106:0/3412132389 shutdown_connections 2024-08-17T02:27:51.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.820+0000 7ff8abe00640 1 --2- 172.21.15.106:0/3412132389 >> v2:172.21.15.171:3300/0 conn(0x7ff8ac0ccad0 0x7ff8ac0cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.820+0000 7ff8abe00640 1 --2- 172.21.15.106:0/3412132389 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8ac0ca8a0 0x7ff8ac0cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.820+0000 7ff8abe00640 1 --2- 172.21.15.106:0/3412132389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8ac159ca0 0x7ff8ac0ca360 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.820+0000 7ff8abe00640 1 -- 172.21.15.106:0/3412132389 >> 172.21.15.106:0/3412132389 conn(0x7ff8ac098e00 msgr2=0x7ff8ac06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:51.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.820+0000 7ff8abe00640 1 -- 172.21.15.106:0/3412132389 shutdown_connections 2024-08-17T02:27:51.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.820+0000 7ff8abe00640 1 -- 172.21.15.106:0/3412132389 wait complete. 2024-08-17T02:27:51.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.821+0000 7ff8abe00640 1 Processor -- start 2024-08-17T02:27:51.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.821+0000 7ff8abe00640 1 -- start start 2024-08-17T02:27:51.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.822+0000 7ff8abe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8ac0ca8a0 0x7ff8ac1550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.822+0000 7ff8abe00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8ac0ccad0 0x7ff8ac15d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.822+0000 7ff8abe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8ac159ca0 0x7ff8ac0b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.822+0000 7ff8abe00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac0c4710 con 0x7ff8ac159ca0 2024-08-17T02:27:51.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.822+0000 7ff8abe00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac0c3b00 con 0x7ff8ac0ccad0 2024-08-17T02:27:51.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.822+0000 7ff8abe00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac0c3de0 con 0x7ff8ac0ca8a0 2024-08-17T02:27:51.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.822+0000 7ff8ab400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8ac159ca0 0x7ff8ac0b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.822+0000 7ff8ab400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8ac159ca0 0x7ff8ac0b3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56344/0 (socket says 172.21.15.106:56344) 2024-08-17T02:27:51.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.822+0000 7ff8ab400640 1 -- 172.21.15.106:0/2400051081 learned_addr learned my addr 172.21.15.106:0/2400051081 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:51.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.822+0000 7ff8aaa00640 1 --2- 172.21.15.106:0/2400051081 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8ac0ca8a0 0x7ff8ac1550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.822+0000 7ff8a3e00640 1 --2- 172.21.15.106:0/2400051081 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8ac0ccad0 0x7ff8ac15d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.823+0000 7ff8ab400640 1 -- 172.21.15.106:0/2400051081 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8ac0ca8a0 msgr2=0x7ff8ac1550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.823+0000 7ff8ab400640 1 --2- 172.21.15.106:0/2400051081 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8ac0ca8a0 0x7ff8ac1550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.823+0000 7ff8ab400640 1 -- 172.21.15.106:0/2400051081 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8ac0ccad0 msgr2=0x7ff8ac15d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:51.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.823+0000 7ff8ab400640 1 --2- 172.21.15.106:0/2400051081 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8ac0ccad0 0x7ff8ac15d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:51.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.823+0000 7ff8ab400640 1 -- 172.21.15.106:0/2400051081 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff89c009450 con 0x7ff8ac159ca0 2024-08-17T02:27:51.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.823+0000 7ff8ab400640 1 --2- 172.21.15.106:0/2400051081 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8ac159ca0 0x7ff8ac0b3ef0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff8a400d180 tx=0x7ff8a4009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.823+0000 7ff8a2000640 1 -- 172.21.15.106:0/2400051081 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4015440 con 0x7ff8ac159ca0 2024-08-17T02:27:51.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.823+0000 7ff8a2000640 1 -- 172.21.15.106:0/2400051081 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a400f040 con 0x7ff8ac159ca0 2024-08-17T02:27:51.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.823+0000 7ff8abe00640 1 -- 172.21.15.106:0/2400051081 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8ac0c40c0 con 0x7ff8ac159ca0 2024-08-17T02:27:51.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.823+0000 7ff8a2000640 1 -- 172.21.15.106:0/2400051081 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4015810 con 0x7ff8ac159ca0 2024-08-17T02:27:51.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.823+0000 7ff8abe00640 1 -- 172.21.15.106:0/2400051081 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8ac155630 con 0x7ff8ac159ca0 2024-08-17T02:27:51.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.824+0000 7ff8abe00640 1 -- 172.21.15.106:0/2400051081 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8ac0c48c0 con 0x7ff8ac159ca0 2024-08-17T02:27:51.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.825+0000 7ff8a2000640 1 -- 172.21.15.106:0/2400051081 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff8a401e3b0 con 0x7ff8ac159ca0 2024-08-17T02:27:51.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.826+0000 7ff8a2000640 1 --2- 172.21.15.106:0/2400051081 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ff888065180 0x7ff888067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:51.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.826+0000 7ff8a2000640 1 -- 172.21.15.106:0/2400051081 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff8a4082e30 con 0x7ff8ac159ca0 2024-08-17T02:27:51.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.826+0000 7ff8aaa00640 1 --2- 172.21.15.106:0/2400051081 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ff888065180 0x7ff888067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:51.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.827+0000 7ff8aaa00640 1 --2- 172.21.15.106:0/2400051081 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ff888065180 0x7ff888067630 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff89c034000 tx=0x7ff89c032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:51.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:51.830+0000 7ff8a2000640 1 -- 172.21.15.106:0/2400051081 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff8ac0c48c0 con 0x7ff8ac159ca0 2024-08-17T02:27:52.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.004+0000 7ff8abe00640 1 -- 172.21.15.106:0/2400051081 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8ac071050 con 0x7ff8ac159ca0 2024-08-17T02:27:52.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.005+0000 7ff8a2000640 1 -- 172.21.15.106:0/2400051081 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15411 (secure 0 0 0) 0x7ff8a4050f00 con 0x7ff8ac159ca0 2024-08-17T02:27:52.005 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:27:52.006 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":19,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:27:50.683117+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:48.547438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:49.671073+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:52.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.007+0000 7ff8abe00640 1 -- 172.21.15.106:0/2400051081 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ff888065180 msgr2=0x7ff888067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.007+0000 7ff8abe00640 1 --2- 172.21.15.106:0/2400051081 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ff888065180 0x7ff888067630 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff89c034000 tx=0x7ff89c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:52.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.007+0000 7ff8abe00640 1 -- 172.21.15.106:0/2400051081 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8ac159ca0 msgr2=0x7ff8ac0b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.007+0000 7ff8abe00640 1 --2- 172.21.15.106:0/2400051081 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8ac159ca0 0x7ff8ac0b3ef0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff8a400d180 tx=0x7ff8a4009a50 comp rx=0 tx=0).stop 2024-08-17T02:27:52.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.007+0000 7ff8abe00640 1 -- 172.21.15.106:0/2400051081 shutdown_connections 2024-08-17T02:27:52.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.007+0000 7ff8abe00640 1 --2- 172.21.15.106:0/2400051081 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ff888065180 0x7ff888067630 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.007+0000 7ff8abe00640 1 --2- 172.21.15.106:0/2400051081 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8ac159ca0 0x7ff8ac0b3ef0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.007+0000 7ff8abe00640 1 --2- 172.21.15.106:0/2400051081 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8ac0ccad0 0x7ff8ac15d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.007+0000 7ff8abe00640 1 --2- 172.21.15.106:0/2400051081 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8ac0ca8a0 0x7ff8ac1550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.007+0000 7ff8abe00640 1 -- 172.21.15.106:0/2400051081 >> 172.21.15.106:0/2400051081 conn(0x7ff8ac098e00 msgr2=0x7ff8ac1570c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:52.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.007+0000 7ff8abe00640 1 -- 172.21.15.106:0/2400051081 shutdown_connections 2024-08-17T02:27:52.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.007+0000 7ff8abe00640 1 -- 172.21.15.106:0/2400051081 wait complete. 2024-08-17T02:27:52.023 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:27:52.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.172+0000 7ffaeb200640 1 Processor -- start 2024-08-17T02:27:52.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.173+0000 7ffaeb200640 1 -- start start 2024-08-17T02:27:52.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.174+0000 7ffaeb200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ffaec0c4950 0x7ffaec0ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.174+0000 7ffaeb200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ffaec0cb980 0x7ffaec158730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.174+0000 7ffaeb200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaec0c5a40 con 0x7ffaec0ce250 2024-08-17T02:27:52.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.174+0000 7ffaeb200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaec0c4e30 con 0x7ffaec0c4950 2024-08-17T02:27:52.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.174+0000 7ffaeb200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaec0c5110 con 0x7ffaec0cb980 2024-08-17T02:27:52.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.174+0000 7ffae9e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ffaec0ce250 0x7ffaec0b2970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39796/0 (socket says 172.21.15.106:39796) 2024-08-17T02:27:52.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.174+0000 7ffae9e00640 1 -- 172.21.15.106:0/2639557425 learned_addr learned my addr 172.21.15.106:0/2639557425 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:52.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.174+0000 7ffae1400640 1 --2- 172.21.15.106:0/2639557425 >> v2:172.21.15.106:3300/0 conn(0x7ffaec0c4950 0x7ffaec0ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.174+0000 7ffaea800640 1 --2- 172.21.15.106:0/2639557425 >> v2:172.21.15.171:3300/0 conn(0x7ffaec0cb980 0x7ffaec158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.175+0000 7ffae9400640 1 -- 172.21.15.106:0/2639557425 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2981970388 0 0) 0x7ffaec0c5a40 con 0x7ffaec0ce250 2024-08-17T02:27:52.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.175+0000 7ffae9400640 1 -- 172.21.15.106:0/2639557425 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffad00034e0 con 0x7ffaec0ce250 2024-08-17T02:27:52.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.175+0000 7ffae1400640 1 -- 172.21.15.106:0/2639557425 >> v2:172.21.15.171:3300/0 conn(0x7ffaec0cb980 msgr2=0x7ffaec158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:52.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.175+0000 7ffae1400640 1 --2- 172.21.15.106:0/2639557425 >> v2:172.21.15.171:3300/0 conn(0x7ffaec0cb980 0x7ffaec158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.175+0000 7ffae1400640 1 -- 172.21.15.106:0/2639557425 >> v1:172.21.15.106:6789/0 conn(0x7ffaec0ce250 legacy=0x7ffaec0b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.175+0000 7ffae1400640 1 -- 172.21.15.106:0/2639557425 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaec0c53f0 con 0x7ffaec0c4950 2024-08-17T02:27:52.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.175+0000 7ffaea800640 1 --2- 172.21.15.106:0/2639557425 >> v2:172.21.15.171:3300/0 conn(0x7ffaec0cb980 0x7ffaec158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:52.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.176+0000 7ffae1400640 1 --2- 172.21.15.106:0/2639557425 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffaec0c4950 0x7ffaec0ce620 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffaec0cf740 tx=0x7ffad40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d308440c3b397a12 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.176+0000 7ffae9400640 1 -- 172.21.15.106:0/2639557425 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad402adb0 con 0x7ffaec0c4950 2024-08-17T02:27:52.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.176+0000 7ffae9400640 1 -- 172.21.15.106:0/2639557425 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad4032440 con 0x7ffaec0c4950 2024-08-17T02:27:52.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.176+0000 7ffae9400640 1 -- 172.21.15.106:0/2639557425 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad4032800 con 0x7ffaec0c4950 2024-08-17T02:27:52.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.176+0000 7ffaeb200640 1 -- 172.21.15.106:0/2639557425 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffaec0c4950 msgr2=0x7ffaec0ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.176+0000 7ffaeb200640 1 --2- 172.21.15.106:0/2639557425 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffaec0c4950 0x7ffaec0ce620 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffaec0cf740 tx=0x7ffad40090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.177+0000 7ffaeb200640 1 -- 172.21.15.106:0/2639557425 shutdown_connections 2024-08-17T02:27:52.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.177+0000 7ffaeb200640 1 --2- 172.21.15.106:0/2639557425 >> v2:172.21.15.171:3300/0 conn(0x7ffaec0cb980 0x7ffaec158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.177+0000 7ffaeb200640 1 --2- 172.21.15.106:0/2639557425 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffaec0c4950 0x7ffaec0ce620 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.177+0000 7ffaeb200640 1 -- 172.21.15.106:0/2639557425 >> 172.21.15.106:0/2639557425 conn(0x7ffaec098e30 msgr2=0x7ffaec06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:52.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.177+0000 7ffaeb200640 1 -- 172.21.15.106:0/2639557425 shutdown_connections 2024-08-17T02:27:52.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.177+0000 7ffaeb200640 1 -- 172.21.15.106:0/2639557425 wait complete. 2024-08-17T02:27:52.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.178+0000 7ffaeb200640 1 Processor -- start 2024-08-17T02:27:52.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.178+0000 7ffaeb200640 1 -- start start 2024-08-17T02:27:52.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.179+0000 7ffaeb200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffaec0c4950 0x7ffaec13df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.179+0000 7ffaeb200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffaec0cb980 0x7ffaec09bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.179+0000 7ffaeb200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffaec0ce250 0x7ffaec152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.179+0000 7ffaeb200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec13e440 con 0x7ffaec0c4950 2024-08-17T02:27:52.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.179+0000 7ffaeb200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec09d2c0 con 0x7ffaec0ce250 2024-08-17T02:27:52.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.179+0000 7ffaeb200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec09c6b0 con 0x7ffaec0cb980 2024-08-17T02:27:52.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.179+0000 7ffae9e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffaec0c4950 0x7ffaec13df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.179+0000 7ffae9e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffaec0c4950 0x7ffaec13df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56368/0 (socket says 172.21.15.106:56368) 2024-08-17T02:27:52.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.179+0000 7ffae9e00640 1 -- 172.21.15.106:0/4275516985 learned_addr learned my addr 172.21.15.106:0/4275516985 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:52.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.180+0000 7ffae9e00640 1 -- 172.21.15.106:0/4275516985 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffaec0cb980 msgr2=0x7ffaec09bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.180+0000 7ffae9e00640 1 --2- 172.21.15.106:0/4275516985 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffaec0cb980 0x7ffaec09bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.180+0000 7ffae9e00640 1 -- 172.21.15.106:0/4275516985 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffaec0ce250 msgr2=0x7ffaec152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:52.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.180+0000 7ffae9e00640 1 --2- 172.21.15.106:0/4275516985 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffaec0ce250 0x7ffaec152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:52.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.180+0000 7ffae9e00640 1 -- 172.21.15.106:0/4275516985 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad4009390 con 0x7ffaec0c4950 2024-08-17T02:27:52.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.180+0000 7ffae9e00640 1 --2- 172.21.15.106:0/4275516985 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffaec0c4950 0x7ffaec13df00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00c4b0 tx=0x7ffadc007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.180+0000 7ffae2000640 1 -- 172.21.15.106:0/4275516985 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc005aa0 con 0x7ffaec0c4950 2024-08-17T02:27:52.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.180+0000 7ffae2000640 1 -- 172.21.15.106:0/4275516985 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffadc005c00 con 0x7ffaec0c4950 2024-08-17T02:27:52.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.180+0000 7ffaeb200640 1 -- 172.21.15.106:0/4275516985 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaec09c990 con 0x7ffaec0c4950 2024-08-17T02:27:52.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.180+0000 7ffae2000640 1 -- 172.21.15.106:0/4275516985 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc0070d0 con 0x7ffaec0c4950 2024-08-17T02:27:52.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.180+0000 7ffaeb200640 1 -- 172.21.15.106:0/4275516985 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaec09cf50 con 0x7ffaec0c4950 2024-08-17T02:27:52.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.181+0000 7ffaeb200640 1 -- 172.21.15.106:0/4275516985 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaec071050 con 0x7ffaec0c4950 2024-08-17T02:27:52.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.182+0000 7ffae2000640 1 -- 172.21.15.106:0/4275516985 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ffadc0074c0 con 0x7ffaec0c4950 2024-08-17T02:27:52.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.183+0000 7ffae2000640 1 --2- 172.21.15.106:0/4275516985 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ffac8065150 0x7ffac8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:52.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.183+0000 7ffae2000640 1 -- 172.21.15.106:0/4275516985 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffadc0818b0 con 0x7ffaec0c4950 2024-08-17T02:27:52.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.183+0000 7ffae1400640 1 --2- 172.21.15.106:0/4275516985 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ffac8065150 0x7ffac8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:52.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.184+0000 7ffae1400640 1 --2- 172.21.15.106:0/4275516985 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ffac8065150 0x7ffac8067600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffad4034000 tx=0x7ffad4032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:52.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.187+0000 7ffae2000640 1 -- 172.21.15.106:0/4275516985 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ffadc04f970 con 0x7ffaec0c4950 2024-08-17T02:27:52.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:52.397+0000 7ffaeb200640 1 -- 172.21.15.106:0/4275516985 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ffaec0b30d0 con 0x7ffaec0c4950 2024-08-17T02:27:53.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.296+0000 7ffae2000640 1 -- 172.21.15.106:0/4275516985 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7ffadc017020 con 0x7ffaec0c4950 2024-08-17T02:27:53.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.299+0000 7ffaeb200640 1 -- 172.21.15.106:0/4275516985 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ffac8065150 msgr2=0x7ffac8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.299+0000 7ffaeb200640 1 --2- 172.21.15.106:0/4275516985 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ffac8065150 0x7ffac8067600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffad4034000 tx=0x7ffad4032000 comp rx=0 tx=0).stop 2024-08-17T02:27:53.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.299+0000 7ffaeb200640 1 -- 172.21.15.106:0/4275516985 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffaec0c4950 msgr2=0x7ffaec13df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.299+0000 7ffaeb200640 1 --2- 172.21.15.106:0/4275516985 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffaec0c4950 0x7ffaec13df00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00c4b0 tx=0x7ffadc007d60 comp rx=0 tx=0).stop 2024-08-17T02:27:53.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.299+0000 7ffaeb200640 1 -- 172.21.15.106:0/4275516985 shutdown_connections 2024-08-17T02:27:53.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.299+0000 7ffaeb200640 1 --2- 172.21.15.106:0/4275516985 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffaec0ce250 0x7ffaec152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.299+0000 7ffaeb200640 1 --2- 172.21.15.106:0/4275516985 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffaec0cb980 0x7ffaec09bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.299+0000 7ffaeb200640 1 --2- 172.21.15.106:0/4275516985 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ffac8065150 0x7ffac8067600 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.299+0000 7ffaeb200640 1 --2- 172.21.15.106:0/4275516985 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffaec0c4950 0x7ffaec13df00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.299+0000 7ffaeb200640 1 -- 172.21.15.106:0/4275516985 >> 172.21.15.106:0/4275516985 conn(0x7ffaec098e30 msgr2=0x7ffaec0681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:53.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.299+0000 7ffaeb200640 1 -- 172.21.15.106:0/4275516985 shutdown_connections 2024-08-17T02:27:53.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.299+0000 7ffaeb200640 1 -- 172.21.15.106:0/4275516985 wait complete. 2024-08-17T02:27:53.315 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:27:53.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.467+0000 7fc105a00640 1 Processor -- start 2024-08-17T02:27:53.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.467+0000 7fc105a00640 1 -- start start 2024-08-17T02:27:53.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.468+0000 7fc105a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc100155a80 0x7fc10006dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.468+0000 7fc105a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1000c7db0 0x7fc1000c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.468+0000 7fc105a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1001598f0 con 0x7fc100155e50 2024-08-17T02:27:53.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.468+0000 7fc105a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc100159bd0 con 0x7fc100155a80 2024-08-17T02:27:53.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.468+0000 7fc105a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc100159eb0 con 0x7fc1000c7db0 2024-08-17T02:27:53.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.469+0000 7fc0fe000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1000c7db0 0x7fc1000c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.469+0000 7fc0ff400640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fc100155e50 0x7fc10006c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:53784/0 (socket says 172.21.15.106:53784) 2024-08-17T02:27:53.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.469+0000 7fc0fea00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc100155a80 0x7fc10006dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.469+0000 7fc0ff400640 1 -- 172.21.15.106:0/1224654847 learned_addr learned my addr 172.21.15.106:0/1224654847 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:53.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.470+0000 7fc0fea00640 1 -- 172.21.15.106:0/1224654847 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1000c7db0 msgr2=0x7fc1000c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:53.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.470+0000 7fc0fea00640 1 --2- 172.21.15.106:0/1224654847 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1000c7db0 0x7fc1000c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.470+0000 7fc0fea00640 1 -- 172.21.15.106:0/1224654847 >> v1:172.21.15.171:6789/0 conn(0x7fc100155e50 legacy=0x7fc10006c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.470+0000 7fc0fea00640 1 -- 172.21.15.106:0/1224654847 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10015a190 con 0x7fc100155a80 2024-08-17T02:27:53.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.470+0000 7fc0fe000640 1 --2- 172.21.15.106:0/1224654847 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1000c7db0 0x7fc1000c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:53.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.470+0000 7fc0fd600640 1 -- 172.21.15.106:0/1224654847 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1728895529 0 0) 0x7fc1001598f0 con 0x7fc100155e50 2024-08-17T02:27:53.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.471+0000 7fc0fea00640 1 --2- 172.21.15.106:0/1224654847 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc100155a80 0x7fc10006dc00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc0f000baf0 tx=0x7fc0f000b3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7582acfdd64dbc34 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.471+0000 7fc0fd600640 1 -- 172.21.15.106:0/1224654847 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f00325e0 con 0x7fc100155a80 2024-08-17T02:27:53.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.471+0000 7fc0fd600640 1 -- 172.21.15.106:0/1224654847 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f0032740 con 0x7fc100155a80 2024-08-17T02:27:53.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.471+0000 7fc0fd600640 1 -- 172.21.15.106:0/1224654847 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0032ae0 con 0x7fc100155a80 2024-08-17T02:27:53.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.471+0000 7fc105a00640 1 -- 172.21.15.106:0/1224654847 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc100155a80 msgr2=0x7fc10006dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.471+0000 7fc105a00640 1 --2- 172.21.15.106:0/1224654847 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc100155a80 0x7fc10006dc00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc0f000baf0 tx=0x7fc0f000b3b0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.472+0000 7fc105a00640 1 -- 172.21.15.106:0/1224654847 shutdown_connections 2024-08-17T02:27:53.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.472+0000 7fc105a00640 1 --2- 172.21.15.106:0/1224654847 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1000c7db0 0x7fc1000c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.472+0000 7fc105a00640 1 --2- 172.21.15.106:0/1224654847 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc100155a80 0x7fc10006dc00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.472+0000 7fc105a00640 1 -- 172.21.15.106:0/1224654847 >> 172.21.15.106:0/1224654847 conn(0x7fc100067750 msgr2=0x7fc1000c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:53.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.472+0000 7fc105a00640 1 -- 172.21.15.106:0/1224654847 shutdown_connections 2024-08-17T02:27:53.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.472+0000 7fc105a00640 1 -- 172.21.15.106:0/1224654847 wait complete. 2024-08-17T02:27:53.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.473+0000 7fc105a00640 1 Processor -- start 2024-08-17T02:27:53.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.473+0000 7fc105a00640 1 -- start start 2024-08-17T02:27:53.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.474+0000 7fc105a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1000c7db0 0x7fc100148790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.474+0000 7fc105a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc100155a80 0x7fc100153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.474+0000 7fc105a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc100155e50 0x7fc10015eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.474+0000 7fc105a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1000ac070 con 0x7fc100155a80 2024-08-17T02:27:53.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.474+0000 7fc105a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc100148cd0 con 0x7fc100155e50 2024-08-17T02:27:53.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.474+0000 7fc105a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc100153b80 con 0x7fc1000c7db0 2024-08-17T02:27:53.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.474+0000 7fc0fe000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc100155a80 0x7fc100153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.474+0000 7fc0fe000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc100155a80 0x7fc100153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56374/0 (socket says 172.21.15.106:56374) 2024-08-17T02:27:53.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.474+0000 7fc0fe000640 1 -- 172.21.15.106:0/2004645022 learned_addr learned my addr 172.21.15.106:0/2004645022 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:53.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.474+0000 7fc0ff400640 1 --2- 172.21.15.106:0/2004645022 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc100155e50 0x7fc10015eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.474+0000 7fc0fea00640 1 --2- 172.21.15.106:0/2004645022 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1000c7db0 0x7fc100148790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.475+0000 7fc0fe000640 1 -- 172.21.15.106:0/2004645022 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1000c7db0 msgr2=0x7fc100148790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.475+0000 7fc0fe000640 1 --2- 172.21.15.106:0/2004645022 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1000c7db0 0x7fc100148790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.475+0000 7fc0fe000640 1 -- 172.21.15.106:0/2004645022 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc100155e50 msgr2=0x7fc10015eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:53.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.475+0000 7fc0fe000640 1 --2- 172.21.15.106:0/2004645022 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc100155e50 0x7fc10015eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:53.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.475+0000 7fc0fe000640 1 -- 172.21.15.106:0/2004645022 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ec009390 con 0x7fc100155a80 2024-08-17T02:27:53.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.475+0000 7fc0fe000640 1 --2- 172.21.15.106:0/2004645022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc100155a80 0x7fc100153250 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec00ec80 tx=0x7fc0ec0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.475+0000 7fc0f6000640 1 -- 172.21.15.106:0/2004645022 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec00eec0 con 0x7fc100155a80 2024-08-17T02:27:53.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.475+0000 7fc0f6000640 1 -- 172.21.15.106:0/2004645022 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0ec00cbc0 con 0x7fc100155a80 2024-08-17T02:27:53.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.475+0000 7fc105a00640 1 -- 172.21.15.106:0/2004645022 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f000b630 con 0x7fc100155a80 2024-08-17T02:27:53.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.475+0000 7fc0f6000640 1 -- 172.21.15.106:0/2004645022 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec013470 con 0x7fc100155a80 2024-08-17T02:27:53.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.475+0000 7fc105a00640 1 -- 172.21.15.106:0/2004645022 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc100154140 con 0x7fc100155a80 2024-08-17T02:27:53.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.477+0000 7fc105a00640 1 -- 172.21.15.106:0/2004645022 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1000ac1e0 con 0x7fc100155a80 2024-08-17T02:27:53.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.477+0000 7fc0f6000640 1 -- 172.21.15.106:0/2004645022 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc0ec0137e0 con 0x7fc100155a80 2024-08-17T02:27:53.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.478+0000 7fc0f6000640 1 --2- 172.21.15.106:0/2004645022 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc0e0065150 0x7fc0e0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:53.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.478+0000 7fc0f6000640 1 -- 172.21.15.106:0/2004645022 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc0ec0827a0 con 0x7fc100155a80 2024-08-17T02:27:53.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.479+0000 7fc0fea00640 1 --2- 172.21.15.106:0/2004645022 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc0e0065150 0x7fc0e0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:53.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.479+0000 7fc0fea00640 1 --2- 172.21.15.106:0/2004645022 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc0e0065150 0x7fc0e0067600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0037000 tx=0x7fc0f003a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:53.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.482+0000 7fc0f6000640 1 -- 172.21.15.106:0/2004645022 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc0ec050910 con 0x7fc100155a80 2024-08-17T02:27:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:53.692+0000 7fc105a00640 1 -- 172.21.15.106:0/2004645022 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc100071050 con 0x7fc100155a80 2024-08-17T02:27:54.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.302+0000 7fc0f6000640 1 -- 172.21.15.106:0/2004645022 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc0ec053f30 con 0x7fc100155a80 2024-08-17T02:27:54.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.304+0000 7fc105a00640 1 -- 172.21.15.106:0/2004645022 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc0e0065150 msgr2=0x7fc0e0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.304+0000 7fc105a00640 1 --2- 172.21.15.106:0/2004645022 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc0e0065150 0x7fc0e0067600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0037000 tx=0x7fc0f003a000 comp rx=0 tx=0).stop 2024-08-17T02:27:54.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.304+0000 7fc105a00640 1 -- 172.21.15.106:0/2004645022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc100155a80 msgr2=0x7fc100153250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.304+0000 7fc105a00640 1 --2- 172.21.15.106:0/2004645022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc100155a80 0x7fc100153250 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec00ec80 tx=0x7fc0ec0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.305+0000 7fc105a00640 1 -- 172.21.15.106:0/2004645022 shutdown_connections 2024-08-17T02:27:54.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.305+0000 7fc105a00640 1 --2- 172.21.15.106:0/2004645022 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc100155e50 0x7fc10015eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.305+0000 7fc105a00640 1 --2- 172.21.15.106:0/2004645022 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc0e0065150 0x7fc0e0067600 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.305+0000 7fc105a00640 1 --2- 172.21.15.106:0/2004645022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc100155a80 0x7fc100153250 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.305+0000 7fc105a00640 1 --2- 172.21.15.106:0/2004645022 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc1000c7db0 0x7fc100148790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.305+0000 7fc105a00640 1 -- 172.21.15.106:0/2004645022 >> 172.21.15.106:0/2004645022 conn(0x7fc100067750 msgr2=0x7fc1000c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:54.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.305+0000 7fc105a00640 1 -- 172.21.15.106:0/2004645022 shutdown_connections 2024-08-17T02:27:54.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.305+0000 7fc105a00640 1 -- 172.21.15.106:0/2004645022 wait complete. 2024-08-17T02:27:54.321 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:27:54.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.467+0000 7febacc00640 1 Processor -- start 2024-08-17T02:27:54.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.467+0000 7febacc00640 1 -- start start 2024-08-17T02:27:54.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.468+0000 7febacc00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7feba806da20 0x7feba806ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.468+0000 7febacc00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feba80aa7d0 0x7feba8158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.468+0000 7febacc00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba80a9a10 con 0x7feba8158dd0 2024-08-17T02:27:54.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.468+0000 7febacc00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba80ac400 con 0x7feba80aa7d0 2024-08-17T02:27:54.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.468+0000 7febacc00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba80a9cf0 con 0x7feba806da20 2024-08-17T02:27:54.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.469+0000 7feba6800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7feba8158dd0 0x7feba80ab6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39808/0 (socket says 172.21.15.106:39808) 2024-08-17T02:27:54.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.469+0000 7feba6800640 1 -- 172.21.15.106:0/4149010430 learned_addr learned my addr 172.21.15.106:0/4149010430 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:54.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.469+0000 7feba5400640 1 --2- 172.21.15.106:0/4149010430 >> v2:172.21.15.106:3300/0 conn(0x7feba80aa7d0 0x7feba8158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.469+0000 7feba5e00640 1 --2- 172.21.15.106:0/4149010430 >> v2:172.21.15.171:3300/0 conn(0x7feba806da20 0x7feba806ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.469+0000 7feba5400640 1 -- 172.21.15.106:0/4149010430 >> v2:172.21.15.171:3300/0 conn(0x7feba806da20 msgr2=0x7feba806ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:54.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.469+0000 7feba5400640 1 --2- 172.21.15.106:0/4149010430 >> v2:172.21.15.171:3300/0 conn(0x7feba806da20 0x7feba806ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.469+0000 7feba5400640 1 -- 172.21.15.106:0/4149010430 >> v1:172.21.15.106:6789/0 conn(0x7feba8158dd0 legacy=0x7feba80ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.469+0000 7feba5400640 1 -- 172.21.15.106:0/4149010430 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba80a9fd0 con 0x7feba80aa7d0 2024-08-17T02:27:54.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.469+0000 7feba4a00640 1 -- 172.21.15.106:0/4149010430 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2582081412 0 0) 0x7feba80a9a10 con 0x7feba8158dd0 2024-08-17T02:27:54.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.470+0000 7feba5400640 1 --2- 172.21.15.106:0/4149010430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feba80aa7d0 0x7feba8158890 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7feba8068280 tx=0x7feb940090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa60f75cfe9fead8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:54.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.470+0000 7feba4a00640 1 -- 172.21.15.106:0/4149010430 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9402ad20 con 0x7feba80aa7d0 2024-08-17T02:27:54.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.470+0000 7feba4a00640 1 -- 172.21.15.106:0/4149010430 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9402ae80 con 0x7feba80aa7d0 2024-08-17T02:27:54.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.470+0000 7feba4a00640 1 -- 172.21.15.106:0/4149010430 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb94032670 con 0x7feba80aa7d0 2024-08-17T02:27:54.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.471+0000 7febacc00640 1 -- 172.21.15.106:0/4149010430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feba80aa7d0 msgr2=0x7feba8158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.471+0000 7febacc00640 1 --2- 172.21.15.106:0/4149010430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feba80aa7d0 0x7feba8158890 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7feba8068280 tx=0x7feb940090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.471+0000 7febacc00640 1 -- 172.21.15.106:0/4149010430 shutdown_connections 2024-08-17T02:27:54.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.471+0000 7febacc00640 1 --2- 172.21.15.106:0/4149010430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feba80aa7d0 0x7feba8158890 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.471+0000 7febacc00640 1 --2- 172.21.15.106:0/4149010430 >> v2:172.21.15.171:3300/0 conn(0x7feba806da20 0x7feba806ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.471+0000 7febacc00640 1 -- 172.21.15.106:0/4149010430 >> 172.21.15.106:0/4149010430 conn(0x7feba80cb9b0 msgr2=0x7feba80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:54.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.471+0000 7febacc00640 1 -- 172.21.15.106:0/4149010430 shutdown_connections 2024-08-17T02:27:54.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.471+0000 7febacc00640 1 -- 172.21.15.106:0/4149010430 wait complete. 2024-08-17T02:27:54.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.472+0000 7febacc00640 1 Processor -- start 2024-08-17T02:27:54.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.472+0000 7febacc00640 1 -- start start 2024-08-17T02:27:54.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.473+0000 7febacc00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feba806da20 0x7feba816d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.473+0000 7febacc00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feba80aa7d0 0x7feba80c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.473+0000 7febacc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feba8158dd0 0x7feba8153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.473+0000 7febacc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba815a6f0 con 0x7feba8158dd0 2024-08-17T02:27:54.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.473+0000 7febacc00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba80c8980 con 0x7feba806da20 2024-08-17T02:27:54.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.473+0000 7febacc00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba80c8c20 con 0x7feba80aa7d0 2024-08-17T02:27:54.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.474+0000 7feba6800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feba8158dd0 0x7feba8153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.474+0000 7feba6800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feba8158dd0 0x7feba8153040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56392/0 (socket says 172.21.15.106:56392) 2024-08-17T02:27:54.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.474+0000 7feba6800640 1 -- 172.21.15.106:0/894692207 learned_addr learned my addr 172.21.15.106:0/894692207 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:54.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.474+0000 7feba5e00640 1 --2- 172.21.15.106:0/894692207 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feba806da20 0x7feba816d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.474+0000 7feba5400640 1 --2- 172.21.15.106:0/894692207 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feba80aa7d0 0x7feba80c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.474+0000 7feba6800640 1 -- 172.21.15.106:0/894692207 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feba80aa7d0 msgr2=0x7feba80c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.474+0000 7feba6800640 1 --2- 172.21.15.106:0/894692207 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feba80aa7d0 0x7feba80c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.474+0000 7feba6800640 1 -- 172.21.15.106:0/894692207 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feba806da20 msgr2=0x7feba816d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.474+0000 7feba6800640 1 --2- 172.21.15.106:0/894692207 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feba806da20 0x7feba816d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.474+0000 7feba6800640 1 -- 172.21.15.106:0/894692207 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb94009390 con 0x7feba8158dd0 2024-08-17T02:27:54.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.474+0000 7feba6800640 1 --2- 172.21.15.106:0/894692207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feba8158dd0 0x7feba8153040 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feba000cc90 tx=0x7feba0001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:54.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.474+0000 7feb9d600640 1 -- 172.21.15.106:0/894692207 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba000a850 con 0x7feba8158dd0 2024-08-17T02:27:54.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.475+0000 7feb9d600640 1 -- 172.21.15.106:0/894692207 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba000a9b0 con 0x7feba8158dd0 2024-08-17T02:27:54.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.475+0000 7feb9d600640 1 -- 172.21.15.106:0/894692207 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba000ad70 con 0x7feba8158dd0 2024-08-17T02:27:54.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.475+0000 7febacc00640 1 -- 172.21.15.106:0/894692207 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba80c8f00 con 0x7feba8158dd0 2024-08-17T02:27:54.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.475+0000 7febacc00640 1 -- 172.21.15.106:0/894692207 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba80c94c0 con 0x7feba8158dd0 2024-08-17T02:27:54.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.476+0000 7febacc00640 1 -- 172.21.15.106:0/894692207 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba8064db0 con 0x7feba8158dd0 2024-08-17T02:27:54.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.476+0000 7feb9d600640 1 -- 172.21.15.106:0/894692207 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7feba0007300 con 0x7feba8158dd0 2024-08-17T02:27:54.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.477+0000 7feb9d600640 1 --2- 172.21.15.106:0/894692207 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7feb88065150 0x7feb88067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.477+0000 7feb9d600640 1 -- 172.21.15.106:0/894692207 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feba0082560 con 0x7feba8158dd0 2024-08-17T02:27:54.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.477+0000 7feba5e00640 1 --2- 172.21.15.106:0/894692207 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7feb88065150 0x7feb88067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.478+0000 7feba5e00640 1 --2- 172.21.15.106:0/894692207 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7feb88065150 0x7feb88067600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feb98009c80 tx=0x7feb980090f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:54.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.481+0000 7feb9d600640 1 -- 172.21.15.106:0/894692207 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7feba00506b0 con 0x7feba8158dd0 2024-08-17T02:27:54.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.686+0000 7febacc00640 1 -- 172.21.15.106:0/894692207 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feba80cc430 con 0x7feba8158dd0 2024-08-17T02:27:54.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.686+0000 7feb9d600640 1 -- 172.21.15.106:0/894692207 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7feba000b0d0 con 0x7feba8158dd0 2024-08-17T02:27:54.687 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:27:54.687 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1696744783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1696744783},{"type":"v1","addr":"172.21.15.106:6837","nonce":1696744783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/966571689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":966571689},{"type":"v1","addr":"172.21.15.171:6833","nonce":966571689}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/3205379168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3205379168},{"type":"v1","addr":"172.21.15.106:6836","nonce":3205379168}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:50.683483+0000","modified":"2024-08-17T02:27:54.296580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6835/3901195482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3901195482},{"type":"v1","addr":"172.21.15.171:6835","nonce":3901195482}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:27:54.687 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 8 2024-08-17T02:27:54.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.688+0000 7febacc00640 1 -- 172.21.15.106:0/894692207 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7feb88065150 msgr2=0x7feb88067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.688+0000 7febacc00640 1 --2- 172.21.15.106:0/894692207 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7feb88065150 0x7feb88067600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feb98009c80 tx=0x7feb980090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.688+0000 7febacc00640 1 -- 172.21.15.106:0/894692207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feba8158dd0 msgr2=0x7feba8153040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.688+0000 7febacc00640 1 --2- 172.21.15.106:0/894692207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feba8158dd0 0x7feba8153040 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feba000cc90 tx=0x7feba0001a80 comp rx=0 tx=0).stop 2024-08-17T02:27:54.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.688+0000 7febacc00640 1 -- 172.21.15.106:0/894692207 shutdown_connections 2024-08-17T02:27:54.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.688+0000 7febacc00640 1 --2- 172.21.15.106:0/894692207 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7feb88065150 0x7feb88067600 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.688+0000 7febacc00640 1 --2- 172.21.15.106:0/894692207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feba8158dd0 0x7feba8153040 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.688+0000 7febacc00640 1 --2- 172.21.15.106:0/894692207 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feba80aa7d0 0x7feba80c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.688+0000 7febacc00640 1 --2- 172.21.15.106:0/894692207 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feba806da20 0x7feba816d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.688+0000 7febacc00640 1 -- 172.21.15.106:0/894692207 >> 172.21.15.106:0/894692207 conn(0x7feba80cb9b0 msgr2=0x7feba80b03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:54.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.689+0000 7febacc00640 1 -- 172.21.15.106:0/894692207 shutdown_connections 2024-08-17T02:27:54.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.689+0000 7febacc00640 1 -- 172.21.15.106:0/894692207 wait complete. 2024-08-17T02:27:54.704 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:54.736 INFO:tasks.ceph.mds.d.smithi171.stderr:2024-08-17T02:27:54.735+0000 7f1006400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:27:54.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.850+0000 7f1324e00640 1 Processor -- start 2024-08-17T02:27:54.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.850+0000 7f1324e00640 1 -- start start 2024-08-17T02:27:54.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.851+0000 7f1324e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f132006da20 0x7f132006ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.851+0000 7f1324e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f13200aa7d0 0x7f1320158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.851+0000 7f1324e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1320158dd0 0x7f13200ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.851+0000 7f1324e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13200ac400 con 0x7f13200aa7d0 2024-08-17T02:27:54.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.851+0000 7f1324e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13200a9a10 con 0x7f132006da20 2024-08-17T02:27:54.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.851+0000 7f1324e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13200a9cf0 con 0x7f1320158dd0 2024-08-17T02:27:54.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.852+0000 7f131d400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f13200aa7d0 0x7f1320158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.852+0000 7f131d400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f13200aa7d0 0x7f1320158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56402/0 (socket says 172.21.15.106:56402) 2024-08-17T02:27:54.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.852+0000 7f131d400640 1 -- 172.21.15.106:0/3602426279 learned_addr learned my addr 172.21.15.106:0/3602426279 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:54.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.852+0000 7f131e800640 1 --2- 172.21.15.106:0/3602426279 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1320158dd0 0x7f13200ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.852+0000 7f131de00640 1 --2- 172.21.15.106:0/3602426279 >> v2:172.21.15.171:3300/0 conn(0x7f132006da20 0x7f132006ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.852+0000 7f131d400640 1 -- 172.21.15.106:0/3602426279 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1320158dd0 msgr2=0x7f13200ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:54.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.852+0000 7f131d400640 1 --2- 172.21.15.106:0/3602426279 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1320158dd0 0x7f13200ab6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.852+0000 7f131d400640 1 -- 172.21.15.106:0/3602426279 >> v2:172.21.15.171:3300/0 conn(0x7f132006da20 msgr2=0x7f132006ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:54.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.852+0000 7f131d400640 1 --2- 172.21.15.106:0/3602426279 >> v2:172.21.15.171:3300/0 conn(0x7f132006da20 0x7f132006ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.852+0000 7f131d400640 1 -- 172.21.15.106:0/3602426279 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13200a9fd0 con 0x7f13200aa7d0 2024-08-17T02:27:54.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.852+0000 7f131e800640 1 --2- 172.21.15.106:0/3602426279 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1320158dd0 0x7f13200ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:54.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.853+0000 7f131d400640 1 --2- 172.21.15.106:0/3602426279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13200aa7d0 0x7f1320158890 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1320068280 tx=0x7f130c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3990c624393eb266 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:54.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.853+0000 7f131ca00640 1 -- 172.21.15.106:0/3602426279 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c02ad40 con 0x7f13200aa7d0 2024-08-17T02:27:54.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.853+0000 7f131ca00640 1 -- 172.21.15.106:0/3602426279 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c032440 con 0x7f13200aa7d0 2024-08-17T02:27:54.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.853+0000 7f131ca00640 1 -- 172.21.15.106:0/3602426279 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c02aea0 con 0x7f13200aa7d0 2024-08-17T02:27:54.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.854+0000 7f1324e00640 1 -- 172.21.15.106:0/3602426279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13200aa7d0 msgr2=0x7f1320158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.854+0000 7f1324e00640 1 --2- 172.21.15.106:0/3602426279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13200aa7d0 0x7f1320158890 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1320068280 tx=0x7f130c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.854+0000 7f1324e00640 1 -- 172.21.15.106:0/3602426279 shutdown_connections 2024-08-17T02:27:54.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.854+0000 7f1324e00640 1 --2- 172.21.15.106:0/3602426279 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1320158dd0 0x7f13200ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.854+0000 7f1324e00640 1 --2- 172.21.15.106:0/3602426279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13200aa7d0 0x7f1320158890 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.854+0000 7f1324e00640 1 --2- 172.21.15.106:0/3602426279 >> v2:172.21.15.171:3300/0 conn(0x7f132006da20 0x7f132006ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.854+0000 7f1324e00640 1 -- 172.21.15.106:0/3602426279 >> 172.21.15.106:0/3602426279 conn(0x7f13200cb9b0 msgr2=0x7f13200cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:54.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.854+0000 7f1324e00640 1 -- 172.21.15.106:0/3602426279 shutdown_connections 2024-08-17T02:27:54.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.854+0000 7f1324e00640 1 -- 172.21.15.106:0/3602426279 wait complete. 2024-08-17T02:27:54.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.855+0000 7f1324e00640 1 Processor -- start 2024-08-17T02:27:54.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.856+0000 7f1324e00640 1 -- start start 2024-08-17T02:27:54.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.856+0000 7f1324e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f132006da20 0x7f1320168d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.856+0000 7f1324e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13200aa7d0 0x7f1320152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.856+0000 7f1324e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1320158dd0 0x7f1320155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.856+0000 7f1324e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1320156230 con 0x7f13200aa7d0 2024-08-17T02:27:54.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.856+0000 7f1324e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13201550f0 con 0x7f1320158dd0 2024-08-17T02:27:54.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.856+0000 7f1324e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13200ca200 con 0x7f132006da20 2024-08-17T02:27:54.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.857+0000 7f131d400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13200aa7d0 0x7f1320152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.857+0000 7f131d400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13200aa7d0 0x7f1320152260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56414/0 (socket says 172.21.15.106:56414) 2024-08-17T02:27:54.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.857+0000 7f131d400640 1 -- 172.21.15.106:0/2063374648 learned_addr learned my addr 172.21.15.106:0/2063374648 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:54.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.857+0000 7f131e800640 1 --2- 172.21.15.106:0/2063374648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1320158dd0 0x7f1320155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.857+0000 7f131de00640 1 --2- 172.21.15.106:0/2063374648 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f132006da20 0x7f1320168d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.857+0000 7f131d400640 1 -- 172.21.15.106:0/2063374648 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f132006da20 msgr2=0x7f1320168d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.857+0000 7f131d400640 1 --2- 172.21.15.106:0/2063374648 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f132006da20 0x7f1320168d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.857+0000 7f131d400640 1 -- 172.21.15.106:0/2063374648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1320158dd0 msgr2=0x7f1320155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:54.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.857+0000 7f131d400640 1 --2- 172.21.15.106:0/2063374648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1320158dd0 0x7f1320155650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:54.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.857+0000 7f131d400640 1 -- 172.21.15.106:0/2063374648 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130c009450 con 0x7f13200aa7d0 2024-08-17T02:27:54.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.857+0000 7f131d400640 1 --2- 172.21.15.106:0/2063374648 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13200aa7d0 0x7f1320152260 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f130c009210 tx=0x7f130c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:54.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.858+0000 7f1315600640 1 -- 172.21.15.106:0/2063374648 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c006b30 con 0x7f13200aa7d0 2024-08-17T02:27:54.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.858+0000 7f1315600640 1 -- 172.21.15.106:0/2063374648 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c031a60 con 0x7f13200aa7d0 2024-08-17T02:27:54.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.858+0000 7f1315600640 1 -- 172.21.15.106:0/2063374648 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c031e80 con 0x7f13200aa7d0 2024-08-17T02:27:54.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.858+0000 7f1324e00640 1 -- 172.21.15.106:0/2063374648 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13200c98d0 con 0x7f13200aa7d0 2024-08-17T02:27:54.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.858+0000 7f1324e00640 1 -- 172.21.15.106:0/2063374648 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13200c9e90 con 0x7f13200aa7d0 2024-08-17T02:27:54.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.859+0000 7f1324e00640 1 -- 172.21.15.106:0/2063374648 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1320064db0 con 0x7f13200aa7d0 2024-08-17T02:27:54.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.860+0000 7f1315600640 1 -- 172.21.15.106:0/2063374648 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f130c039040 con 0x7f13200aa7d0 2024-08-17T02:27:54.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.861+0000 7f1315600640 1 --2- 172.21.15.106:0/2063374648 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1300065250 0x7f1300067700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:54.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.861+0000 7f1315600640 1 -- 172.21.15.106:0/2063374648 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f130c0a2350 con 0x7f13200aa7d0 2024-08-17T02:27:54.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.861+0000 7f131de00640 1 --2- 172.21.15.106:0/2063374648 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1300065250 0x7f1300067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:54.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.861+0000 7f131de00640 1 --2- 172.21.15.106:0/2063374648 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1300065250 0x7f1300067700 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f131000bb40 tx=0x7f1310008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:54.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:54.865+0000 7f1315600640 1 -- 172.21.15.106:0/2063374648 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f130c070490 con 0x7f13200aa7d0 2024-08-17T02:27:55.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.035+0000 7f1324e00640 1 -- 172.21.15.106:0/2063374648 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13200ca340 con 0x7f13200aa7d0 2024-08-17T02:27:55.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.036+0000 7f1315600640 1 -- 172.21.15.106:0/2063374648 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f130c073ab0 con 0x7f13200aa7d0 2024-08-17T02:27:55.037 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:27:55.037 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:27:52.284039+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:48.547438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:49.671073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:55.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.038+0000 7f1324e00640 1 -- 172.21.15.106:0/2063374648 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1300065250 msgr2=0x7f1300067700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.038+0000 7f1324e00640 1 --2- 172.21.15.106:0/2063374648 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1300065250 0x7f1300067700 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f131000bb40 tx=0x7f1310008040 comp rx=0 tx=0).stop 2024-08-17T02:27:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.038+0000 7f1324e00640 1 -- 172.21.15.106:0/2063374648 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13200aa7d0 msgr2=0x7f1320152260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.038+0000 7f1324e00640 1 --2- 172.21.15.106:0/2063374648 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13200aa7d0 0x7f1320152260 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f130c009210 tx=0x7f130c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.038+0000 7f1324e00640 1 -- 172.21.15.106:0/2063374648 shutdown_connections 2024-08-17T02:27:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.038+0000 7f1324e00640 1 --2- 172.21.15.106:0/2063374648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1320158dd0 0x7f1320155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.038+0000 7f1324e00640 1 --2- 172.21.15.106:0/2063374648 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1300065250 0x7f1300067700 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.038+0000 7f1324e00640 1 --2- 172.21.15.106:0/2063374648 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13200aa7d0 0x7f1320152260 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.038+0000 7f1324e00640 1 --2- 172.21.15.106:0/2063374648 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f132006da20 0x7f1320168d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.039+0000 7f1324e00640 1 -- 172.21.15.106:0/2063374648 >> 172.21.15.106:0/2063374648 conn(0x7f13200cb9b0 msgr2=0x7f13200ac710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.039+0000 7f1324e00640 1 -- 172.21.15.106:0/2063374648 shutdown_connections 2024-08-17T02:27:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.039+0000 7f1324e00640 1 -- 172.21.15.106:0/2063374648 wait complete. 2024-08-17T02:27:55.055 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:27:55.055 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:55.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.202+0000 7fe35be00640 1 Processor -- start 2024-08-17T02:27:55.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.202+0000 7fe35be00640 1 -- start start 2024-08-17T02:27:55.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.203+0000 7fe35be00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe35406e790 0x7fe3540aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.203+0000 7fe35be00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3540afc10 con 0x7fe354155180 2024-08-17T02:27:55.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.203+0000 7fe35be00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3540af000 con 0x7fe354155550 2024-08-17T02:27:55.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.203+0000 7fe35be00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3540af2e0 con 0x7fe35406e790 2024-08-17T02:27:55.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.203+0000 7fe359400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe354155180 0x7fe3540ae070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39818/0 (socket says 172.21.15.106:39818) 2024-08-17T02:27:55.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.203+0000 7fe359400640 1 -- 172.21.15.106:0/585750089 learned_addr learned my addr 172.21.15.106:0/585750089 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:55.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.204+0000 7fe359e00640 1 --2- 172.21.15.106:0/585750089 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe35406e790 0x7fe3540aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.204+0000 7fe353e00640 1 -- 172.21.15.106:0/585750089 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729042324 0 0) 0x7fe3540afc10 con 0x7fe354155180 2024-08-17T02:27:55.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.204+0000 7fe353e00640 1 -- 172.21.15.106:0/585750089 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe33c0034e0 con 0x7fe354155180 2024-08-17T02:27:55.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.204+0000 7fe353e00640 1 -- 172.21.15.106:0/585750089 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4020931999 0 0) 0x7fe3540af000 con 0x7fe354155550 2024-08-17T02:27:55.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.204+0000 7fe359e00640 1 -- 172.21.15.106:0/585750089 >> v1:172.21.15.171:6789/0 conn(0x7fe354155550 legacy=0x7fe35406e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.204+0000 7fe359e00640 1 -- 172.21.15.106:0/585750089 >> v1:172.21.15.106:6789/0 conn(0x7fe354155180 legacy=0x7fe3540ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.204+0000 7fe359e00640 1 -- 172.21.15.106:0/585750089 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3540af5c0 con 0x7fe35406e790 2024-08-17T02:27:55.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.205+0000 7fe359e00640 1 --2- 172.21.15.106:0/585750089 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe35406e790 0x7fe3540aea20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe34c00afa0 tx=0x7fe34c00a890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87e099cf35a68bf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:55.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.205+0000 7fe353e00640 1 -- 172.21.15.106:0/585750089 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c00a2e0 con 0x7fe35406e790 2024-08-17T02:27:55.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.205+0000 7fe353e00640 1 -- 172.21.15.106:0/585750089 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34c02e050 con 0x7fe35406e790 2024-08-17T02:27:55.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.205+0000 7fe353e00640 1 -- 172.21.15.106:0/585750089 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c008680 con 0x7fe35406e790 2024-08-17T02:27:55.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.206+0000 7fe35be00640 1 -- 172.21.15.106:0/585750089 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe35406e790 msgr2=0x7fe3540aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.206+0000 7fe35be00640 1 --2- 172.21.15.106:0/585750089 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe35406e790 0x7fe3540aea20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe34c00afa0 tx=0x7fe34c00a890 comp rx=0 tx=0).stop 2024-08-17T02:27:55.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.206+0000 7fe35be00640 1 -- 172.21.15.106:0/585750089 shutdown_connections 2024-08-17T02:27:55.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.206+0000 7fe35be00640 1 --2- 172.21.15.106:0/585750089 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe35406e790 0x7fe3540aea20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.206+0000 7fe35be00640 1 -- 172.21.15.106:0/585750089 >> 172.21.15.106:0/585750089 conn(0x7fe3540cb9b0 msgr2=0x7fe3540cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:55.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.206+0000 7fe35be00640 1 -- 172.21.15.106:0/585750089 shutdown_connections 2024-08-17T02:27:55.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.206+0000 7fe35be00640 1 -- 172.21.15.106:0/585750089 wait complete. 2024-08-17T02:27:55.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.207+0000 7fe35be00640 1 Processor -- start 2024-08-17T02:27:55.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.208+0000 7fe35be00640 1 -- start start 2024-08-17T02:27:55.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.208+0000 7fe35be00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe35406e790 0x7fe354158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.208+0000 7fe35be00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe354155180 0x7fe35414d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.208+0000 7fe35be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe354155550 0x7fe3540a6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.208+0000 7fe35be00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe354156ba0 con 0x7fe354155550 2024-08-17T02:27:55.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.208+0000 7fe35be00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe354155f90 con 0x7fe354155180 2024-08-17T02:27:55.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.208+0000 7fe35be00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe354156270 con 0x7fe35406e790 2024-08-17T02:27:55.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.209+0000 7fe359e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe354155550 0x7fe3540a6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.209+0000 7fe359e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe354155550 0x7fe3540a6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56418/0 (socket says 172.21.15.106:56418) 2024-08-17T02:27:55.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.209+0000 7fe359e00640 1 -- 172.21.15.106:0/4132116079 learned_addr learned my addr 172.21.15.106:0/4132116079 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:55.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.209+0000 7fe358a00640 1 --2- 172.21.15.106:0/4132116079 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe354155180 0x7fe35414d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.209+0000 7fe359400640 1 --2- 172.21.15.106:0/4132116079 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe35406e790 0x7fe354158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.209+0000 7fe359e00640 1 -- 172.21.15.106:0/4132116079 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe35406e790 msgr2=0x7fe354158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.209+0000 7fe359e00640 1 --2- 172.21.15.106:0/4132116079 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe35406e790 0x7fe354158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.209+0000 7fe359e00640 1 -- 172.21.15.106:0/4132116079 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe354155180 msgr2=0x7fe35414d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.209+0000 7fe359e00640 1 --2- 172.21.15.106:0/4132116079 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe354155180 0x7fe35414d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.209+0000 7fe359e00640 1 -- 172.21.15.106:0/4132116079 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe34c00ab30 con 0x7fe354155550 2024-08-17T02:27:55.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.209+0000 7fe359400640 1 --2- 172.21.15.106:0/4132116079 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe35406e790 0x7fe354158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:55.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.209+0000 7fe359e00640 1 --2- 172.21.15.106:0/4132116079 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe354155550 0x7fe3540a6c50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe34c00ab00 tx=0x7fe34c035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:55.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.210+0000 7fe350c00640 1 -- 172.21.15.106:0/4132116079 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c00a2e0 con 0x7fe354155550 2024-08-17T02:27:55.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.210+0000 7fe350c00640 1 -- 172.21.15.106:0/4132116079 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34c032ac0 con 0x7fe354155550 2024-08-17T02:27:55.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.210+0000 7fe350c00640 1 -- 172.21.15.106:0/4132116079 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c032e80 con 0x7fe354155550 2024-08-17T02:27:55.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.210+0000 7fe35be00640 1 -- 172.21.15.106:0/4132116079 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe354156550 con 0x7fe354155550 2024-08-17T02:27:55.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.210+0000 7fe35be00640 1 -- 172.21.15.106:0/4132116079 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe354158ba0 con 0x7fe354155550 2024-08-17T02:27:55.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.211+0000 7fe35be00640 1 -- 172.21.15.106:0/4132116079 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe354156d50 con 0x7fe354155550 2024-08-17T02:27:55.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.212+0000 7fe350c00640 1 -- 172.21.15.106:0/4132116079 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe34c039050 con 0x7fe354155550 2024-08-17T02:27:55.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.212+0000 7fe350c00640 1 --2- 172.21.15.106:0/4132116079 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe334065150 0x7fe334067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.212+0000 7fe350c00640 1 -- 172.21.15.106:0/4132116079 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe34c0a2850 con 0x7fe354155550 2024-08-17T02:27:55.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.213+0000 7fe359400640 1 --2- 172.21.15.106:0/4132116079 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe334065150 0x7fe334067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.213+0000 7fe359400640 1 --2- 172.21.15.106:0/4132116079 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe334065150 0x7fe334067600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe348007670 tx=0x7fe348000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:55.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.216+0000 7fe350c00640 1 -- 172.21.15.106:0/4132116079 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe354156d50 con 0x7fe354155550 2024-08-17T02:27:55.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.387+0000 7fe35be00640 1 -- 172.21.15.106:0/4132116079 --> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe354064db0 con 0x7fe334065150 2024-08-17T02:27:55.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.395+0000 7fe350c00640 1 -- 172.21.15.106:0/4132116079 <== mgr.4107 v2:172.21.15.106:6832/36860 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264709 (secure 0 0 0) 0x7fe354064db0 con 0x7fe334065150 2024-08-17T02:27:55.399 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:27:55.400 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-08-17T02:27:55.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.399+0000 7fe35be00640 1 -- 172.21.15.106:0/4132116079 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe334065150 msgr2=0x7fe334067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.399+0000 7fe35be00640 1 --2- 172.21.15.106:0/4132116079 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe334065150 0x7fe334067600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe348007670 tx=0x7fe348000bc0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.399+0000 7fe35be00640 1 -- 172.21.15.106:0/4132116079 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe354155550 msgr2=0x7fe3540a6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.399+0000 7fe35be00640 1 --2- 172.21.15.106:0/4132116079 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe354155550 0x7fe3540a6c50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe34c00ab00 tx=0x7fe34c035000 comp rx=0 tx=0).stop 2024-08-17T02:27:55.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.399+0000 7fe35be00640 1 -- 172.21.15.106:0/4132116079 shutdown_connections 2024-08-17T02:27:55.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.399+0000 7fe35be00640 1 --2- 172.21.15.106:0/4132116079 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe334065150 0x7fe334067600 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.399+0000 7fe35be00640 1 --2- 172.21.15.106:0/4132116079 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe354155550 0x7fe3540a6c50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.399+0000 7fe35be00640 1 --2- 172.21.15.106:0/4132116079 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe354155180 0x7fe35414d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.399+0000 7fe35be00640 1 --2- 172.21.15.106:0/4132116079 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe35406e790 0x7fe354158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.399+0000 7fe35be00640 1 -- 172.21.15.106:0/4132116079 >> 172.21.15.106:0/4132116079 conn(0x7fe3540cb9b0 msgr2=0x7fe35414f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:55.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.399+0000 7fe35be00640 1 -- 172.21.15.106:0/4132116079 shutdown_connections 2024-08-17T02:27:55.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.399+0000 7fe35be00640 1 -- 172.21.15.106:0/4132116079 wait complete. 2024-08-17T02:27:55.414 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-08-17T02:27:53.876060+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381600,"kb_used_data":2728,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752593120,"statfs":{"total":773094113280,"available":770655354880,"internally_reserved":0,"allocated":2793472,"data_stored":1700340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.609397"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.307275+0000","last_change":"2024-08-17T02:27:51.307275+0000","last_active":"2024-08-17T02:27:51.307275+0000","last_peered":"2024-08-17T02:27:51.307275+0000","last_clean":"2024-08-17T02:27:51.307275+0000","last_became_active":"2024-08-17T02:27:51.306981+0000","last_became_peered":"2024-08-17T02:27:51.306981+0000","last_unstale":"2024-08-17T02:27:51.307275+0000","last_undegraded":"2024-08-17T02:27:51.307275+0000","last_fullsized":"2024-08-17T02:27:51.307275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:34:53.506566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.293426+0000","last_change":"2024-08-17T02:27:51.289931+0000","last_active":"2024-08-17T02:27:51.293426+0000","last_peered":"2024-08-17T02:27:51.293426+0000","last_clean":"2024-08-17T02:27:51.293426+0000","last_became_active":"2024-08-17T02:27:51.289692+0000","last_became_peered":"2024-08-17T02:27:51.289692+0000","last_unstale":"2024-08-17T02:27:51.293426+0000","last_undegraded":"2024-08-17T02:27:51.293426+0000","last_fullsized":"2024-08-17T02:27:51.293426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:04:36.940627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.293123+0000","last_change":"2024-08-17T02:27:51.293123+0000","last_active":"2024-08-17T02:27:51.293123+0000","last_peered":"2024-08-17T02:27:51.293123+0000","last_clean":"2024-08-17T02:27:51.293123+0000","last_became_active":"2024-08-17T02:27:51.290362+0000","last_became_peered":"2024-08-17T02:27:51.290362+0000","last_unstale":"2024-08-17T02:27:51.293123+0000","last_undegraded":"2024-08-17T02:27:51.293123+0000","last_fullsized":"2024-08-17T02:27:51.293123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:31.950047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315815+0000","last_change":"2024-08-17T02:27:51.310784+0000","last_active":"2024-08-17T02:27:51.315815+0000","last_peered":"2024-08-17T02:27:51.315815+0000","last_clean":"2024-08-17T02:27:51.315815+0000","last_became_active":"2024-08-17T02:27:51.310504+0000","last_became_peered":"2024-08-17T02:27:51.310504+0000","last_unstale":"2024-08-17T02:27:51.315815+0000","last_undegraded":"2024-08-17T02:27:51.315815+0000","last_fullsized":"2024-08-17T02:27:51.315815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:34:53.506566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.300548+0000","last_change":"2024-08-17T02:27:51.300548+0000","last_active":"2024-08-17T02:27:51.300548+0000","last_peered":"2024-08-17T02:27:51.300548+0000","last_clean":"2024-08-17T02:27:51.300548+0000","last_became_active":"2024-08-17T02:27:51.298611+0000","last_became_peered":"2024-08-17T02:27:51.298611+0000","last_unstale":"2024-08-17T02:27:51.300548+0000","last_undegraded":"2024-08-17T02:27:51.300548+0000","last_fullsized":"2024-08-17T02:27:51.300548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:12:12.800070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315424+0000","last_change":"2024-08-17T02:27:51.309274+0000","last_active":"2024-08-17T02:27:51.315424+0000","last_peered":"2024-08-17T02:27:51.315424+0000","last_clean":"2024-08-17T02:27:51.315424+0000","last_became_active":"2024-08-17T02:27:51.309017+0000","last_became_peered":"2024-08-17T02:27:51.309017+0000","last_unstale":"2024-08-17T02:27:51.315424+0000","last_undegraded":"2024-08-17T02:27:51.315424+0000","last_fullsized":"2024-08-17T02:27:51.315424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:08.545557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309089+0000","last_change":"2024-08-17T02:27:51.309089+0000","last_active":"2024-08-17T02:27:51.309089+0000","last_peered":"2024-08-17T02:27:51.309089+0000","last_clean":"2024-08-17T02:27:51.309089+0000","last_became_active":"2024-08-17T02:27:51.308817+0000","last_became_peered":"2024-08-17T02:27:51.308817+0000","last_unstale":"2024-08-17T02:27:51.309089+0000","last_undegraded":"2024-08-17T02:27:51.309089+0000","last_fullsized":"2024-08-17T02:27:51.309089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:22:54.682219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.301226+0000","last_change":"2024-08-17T02:27:51.301226+0000","last_active":"2024-08-17T02:27:51.301226+0000","last_peered":"2024-08-17T02:27:51.301226+0000","last_clean":"2024-08-17T02:27:51.301226+0000","last_became_active":"2024-08-17T02:27:51.300976+0000","last_became_peered":"2024-08-17T02:27:51.300976+0000","last_unstale":"2024-08-17T02:27:51.301226+0000","last_undegraded":"2024-08-17T02:27:51.301226+0000","last_fullsized":"2024-08-17T02:27:51.301226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:51:59.475864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.320367+0000","last_change":"2024-08-17T02:27:51.320367+0000","last_active":"2024-08-17T02:27:51.320367+0000","last_peered":"2024-08-17T02:27:51.320367+0000","last_clean":"2024-08-17T02:27:51.320367+0000","last_became_active":"2024-08-17T02:27:51.320044+0000","last_became_peered":"2024-08-17T02:27:51.320044+0000","last_unstale":"2024-08-17T02:27:51.320367+0000","last_undegraded":"2024-08-17T02:27:51.320367+0000","last_fullsized":"2024-08-17T02:27:51.320367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:03:57.699175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.311082+0000","last_change":"2024-08-17T02:27:51.311082+0000","last_active":"2024-08-17T02:27:51.311082+0000","last_peered":"2024-08-17T02:27:51.311082+0000","last_clean":"2024-08-17T02:27:51.311082+0000","last_became_active":"2024-08-17T02:27:51.309886+0000","last_became_peered":"2024-08-17T02:27:51.309886+0000","last_unstale":"2024-08-17T02:27:51.311082+0000","last_undegraded":"2024-08-17T02:27:51.311082+0000","last_fullsized":"2024-08-17T02:27:51.311082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:07.004040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309574+0000","last_change":"2024-08-17T02:27:51.309574+0000","last_active":"2024-08-17T02:27:51.309574+0000","last_peered":"2024-08-17T02:27:51.309574+0000","last_clean":"2024-08-17T02:27:51.309574+0000","last_became_active":"2024-08-17T02:27:51.309291+0000","last_became_peered":"2024-08-17T02:27:51.309291+0000","last_unstale":"2024-08-17T02:27:51.309574+0000","last_undegraded":"2024-08-17T02:27:51.309574+0000","last_fullsized":"2024-08-17T02:27:51.309574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:26.379433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.305009+0000","last_change":"2024-08-17T02:27:51.305009+0000","last_active":"2024-08-17T02:27:51.305009+0000","last_peered":"2024-08-17T02:27:51.305009+0000","last_clean":"2024-08-17T02:27:51.305009+0000","last_became_active":"2024-08-17T02:27:51.303089+0000","last_became_peered":"2024-08-17T02:27:51.303089+0000","last_unstale":"2024-08-17T02:27:51.305009+0000","last_undegraded":"2024-08-17T02:27:51.305009+0000","last_fullsized":"2024-08-17T02:27:51.305009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:52:35.132297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.299987+0000","last_change":"2024-08-17T02:27:51.299987+0000","last_active":"2024-08-17T02:27:51.299987+0000","last_peered":"2024-08-17T02:27:51.299987+0000","last_clean":"2024-08-17T02:27:51.299987+0000","last_became_active":"2024-08-17T02:27:51.299700+0000","last_became_peered":"2024-08-17T02:27:51.299700+0000","last_unstale":"2024-08-17T02:27:51.299987+0000","last_undegraded":"2024-08-17T02:27:51.299987+0000","last_fullsized":"2024-08-17T02:27:51.299987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:23.747098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.287246+0000","last_change":"2024-08-17T02:27:51.287246+0000","last_active":"2024-08-17T02:27:51.287246+0000","last_peered":"2024-08-17T02:27:51.287246+0000","last_clean":"2024-08-17T02:27:51.287246+0000","last_became_active":"2024-08-17T02:27:51.287011+0000","last_became_peered":"2024-08-17T02:27:51.287011+0000","last_unstale":"2024-08-17T02:27:51.287246+0000","last_undegraded":"2024-08-17T02:27:51.287246+0000","last_fullsized":"2024-08-17T02:27:51.287246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:00.021420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.311602+0000","last_change":"2024-08-17T02:27:51.306642+0000","last_active":"2024-08-17T02:27:51.311602+0000","last_peered":"2024-08-17T02:27:51.311602+0000","last_clean":"2024-08-17T02:27:51.311602+0000","last_became_active":"2024-08-17T02:27:51.306324+0000","last_became_peered":"2024-08-17T02:27:51.306324+0000","last_unstale":"2024-08-17T02:27:51.311602+0000","last_undegraded":"2024-08-17T02:27:51.311602+0000","last_fullsized":"2024-08-17T02:27:51.311602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:45:24.383393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.311314+0000","last_change":"2024-08-17T02:27:51.307812+0000","last_active":"2024-08-17T02:27:51.311314+0000","last_peered":"2024-08-17T02:27:51.311314+0000","last_clean":"2024-08-17T02:27:51.311314+0000","last_became_active":"2024-08-17T02:27:51.307000+0000","last_became_peered":"2024-08-17T02:27:51.307000+0000","last_unstale":"2024-08-17T02:27:51.311314+0000","last_undegraded":"2024-08-17T02:27:51.311314+0000","last_fullsized":"2024-08-17T02:27:51.311314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:23.747098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315476+0000","last_change":"2024-08-17T02:27:51.313130+0000","last_active":"2024-08-17T02:27:51.315476+0000","last_peered":"2024-08-17T02:27:51.315476+0000","last_clean":"2024-08-17T02:27:51.315476+0000","last_became_active":"2024-08-17T02:27:51.312875+0000","last_became_peered":"2024-08-17T02:27:51.312875+0000","last_unstale":"2024-08-17T02:27:51.315476+0000","last_undegraded":"2024-08-17T02:27:51.315476+0000","last_fullsized":"2024-08-17T02:27:51.315476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:01.072889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309623+0000","last_change":"2024-08-17T02:27:51.302749+0000","last_active":"2024-08-17T02:27:51.309623+0000","last_peered":"2024-08-17T02:27:51.309623+0000","last_clean":"2024-08-17T02:27:51.309623+0000","last_became_active":"2024-08-17T02:27:51.302531+0000","last_became_peered":"2024-08-17T02:27:51.302531+0000","last_unstale":"2024-08-17T02:27:51.309623+0000","last_undegraded":"2024-08-17T02:27:51.309623+0000","last_fullsized":"2024-08-17T02:27:51.309623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:52:35.132297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.304533+0000","last_change":"2024-08-17T02:27:51.304533+0000","last_active":"2024-08-17T02:27:51.304533+0000","last_peered":"2024-08-17T02:27:51.304533+0000","last_clean":"2024-08-17T02:27:51.304533+0000","last_became_active":"2024-08-17T02:27:51.304274+0000","last_became_peered":"2024-08-17T02:27:51.304274+0000","last_unstale":"2024-08-17T02:27:51.304533+0000","last_undegraded":"2024-08-17T02:27:51.304533+0000","last_fullsized":"2024-08-17T02:27:51.304533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:23.159482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.307321+0000","last_change":"2024-08-17T02:27:51.307321+0000","last_active":"2024-08-17T02:27:51.307321+0000","last_peered":"2024-08-17T02:27:51.307321+0000","last_clean":"2024-08-17T02:27:51.307321+0000","last_became_active":"2024-08-17T02:27:51.306795+0000","last_became_peered":"2024-08-17T02:27:51.306795+0000","last_unstale":"2024-08-17T02:27:51.307321+0000","last_undegraded":"2024-08-17T02:27:51.307321+0000","last_fullsized":"2024-08-17T02:27:51.307321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:04:36.940627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.293229+0000","last_change":"2024-08-17T02:27:51.293229+0000","last_active":"2024-08-17T02:27:51.293229+0000","last_peered":"2024-08-17T02:27:51.293229+0000","last_clean":"2024-08-17T02:27:51.293229+0000","last_became_active":"2024-08-17T02:27:51.292455+0000","last_became_peered":"2024-08-17T02:27:51.292455+0000","last_unstale":"2024-08-17T02:27:51.293229+0000","last_undegraded":"2024-08-17T02:27:51.293229+0000","last_fullsized":"2024-08-17T02:27:51.293229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:04:36.940627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.310379+0000","last_change":"2024-08-17T02:27:51.302786+0000","last_active":"2024-08-17T02:27:51.310379+0000","last_peered":"2024-08-17T02:27:51.310379+0000","last_clean":"2024-08-17T02:27:51.310379+0000","last_became_active":"2024-08-17T02:27:51.302520+0000","last_became_peered":"2024-08-17T02:27:51.302520+0000","last_unstale":"2024-08-17T02:27:51.310379+0000","last_undegraded":"2024-08-17T02:27:51.310379+0000","last_fullsized":"2024-08-17T02:27:51.310379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:22:54.682219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.297406+0000","last_change":"2024-08-17T02:27:51.297406+0000","last_active":"2024-08-17T02:27:51.297406+0000","last_peered":"2024-08-17T02:27:51.297406+0000","last_clean":"2024-08-17T02:27:51.297406+0000","last_became_active":"2024-08-17T02:27:51.291804+0000","last_became_peered":"2024-08-17T02:27:51.291804+0000","last_unstale":"2024-08-17T02:27:51.297406+0000","last_undegraded":"2024-08-17T02:27:51.297406+0000","last_fullsized":"2024-08-17T02:27:51.297406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:22:54.682219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315495+0000","last_change":"2024-08-17T02:27:51.312012+0000","last_active":"2024-08-17T02:27:51.315495+0000","last_peered":"2024-08-17T02:27:51.315495+0000","last_clean":"2024-08-17T02:27:51.315495+0000","last_became_active":"2024-08-17T02:27:51.311735+0000","last_became_peered":"2024-08-17T02:27:51.311735+0000","last_unstale":"2024-08-17T02:27:51.315495+0000","last_undegraded":"2024-08-17T02:27:51.315495+0000","last_fullsized":"2024-08-17T02:27:51.315495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:47:22.647519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.294844+0000","last_change":"2024-08-17T02:27:51.294844+0000","last_active":"2024-08-17T02:27:51.294844+0000","last_peered":"2024-08-17T02:27:51.294844+0000","last_clean":"2024-08-17T02:27:51.294844+0000","last_became_active":"2024-08-17T02:27:51.294546+0000","last_became_peered":"2024-08-17T02:27:51.294546+0000","last_unstale":"2024-08-17T02:27:51.294844+0000","last_undegraded":"2024-08-17T02:27:51.294844+0000","last_fullsized":"2024-08-17T02:27:51.294844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:17:09.418523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.301918+0000","last_change":"2024-08-17T02:27:51.301918+0000","last_active":"2024-08-17T02:27:51.301918+0000","last_peered":"2024-08-17T02:27:51.301918+0000","last_clean":"2024-08-17T02:27:51.301918+0000","last_became_active":"2024-08-17T02:27:51.301672+0000","last_became_peered":"2024-08-17T02:27:51.301672+0000","last_unstale":"2024-08-17T02:27:51.301918+0000","last_undegraded":"2024-08-17T02:27:51.301918+0000","last_fullsized":"2024-08-17T02:27:51.301918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:23.159482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309265+0000","last_change":"2024-08-17T02:27:51.305095+0000","last_active":"2024-08-17T02:27:51.309265+0000","last_peered":"2024-08-17T02:27:51.309265+0000","last_clean":"2024-08-17T02:27:51.309265+0000","last_became_active":"2024-08-17T02:27:51.304895+0000","last_became_peered":"2024-08-17T02:27:51.304895+0000","last_unstale":"2024-08-17T02:27:51.309265+0000","last_undegraded":"2024-08-17T02:27:51.309265+0000","last_fullsized":"2024-08-17T02:27:51.309265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:07.004040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.307625+0000","last_change":"2024-08-17T02:27:51.307625+0000","last_active":"2024-08-17T02:27:51.307625+0000","last_peered":"2024-08-17T02:27:51.307625+0000","last_clean":"2024-08-17T02:27:51.307625+0000","last_became_active":"2024-08-17T02:27:51.307052+0000","last_became_peered":"2024-08-17T02:27:51.307052+0000","last_unstale":"2024-08-17T02:27:51.307625+0000","last_undegraded":"2024-08-17T02:27:51.307625+0000","last_fullsized":"2024-08-17T02:27:51.307625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:08.545557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.305503+0000","last_change":"2024-08-17T02:27:51.305503+0000","last_active":"2024-08-17T02:27:51.305503+0000","last_peered":"2024-08-17T02:27:51.305503+0000","last_clean":"2024-08-17T02:27:51.305503+0000","last_became_active":"2024-08-17T02:27:51.302095+0000","last_became_peered":"2024-08-17T02:27:51.302095+0000","last_unstale":"2024-08-17T02:27:51.305503+0000","last_undegraded":"2024-08-17T02:27:51.305503+0000","last_fullsized":"2024-08-17T02:27:51.305503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:23.747098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315454+0000","last_change":"2024-08-17T02:27:51.309505+0000","last_active":"2024-08-17T02:27:51.315454+0000","last_peered":"2024-08-17T02:27:51.315454+0000","last_clean":"2024-08-17T02:27:51.315454+0000","last_became_active":"2024-08-17T02:27:51.309223+0000","last_became_peered":"2024-08-17T02:27:51.309223+0000","last_unstale":"2024-08-17T02:27:51.315454+0000","last_undegraded":"2024-08-17T02:27:51.315454+0000","last_fullsized":"2024-08-17T02:27:51.315454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:40.951641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309177+0000","last_change":"2024-08-17T02:27:51.302769+0000","last_active":"2024-08-17T02:27:51.309177+0000","last_peered":"2024-08-17T02:27:51.309177+0000","last_clean":"2024-08-17T02:27:51.309177+0000","last_became_active":"2024-08-17T02:27:51.300628+0000","last_became_peered":"2024-08-17T02:27:51.300628+0000","last_unstale":"2024-08-17T02:27:51.309177+0000","last_undegraded":"2024-08-17T02:27:51.309177+0000","last_fullsized":"2024-08-17T02:27:51.309177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:36:40.089843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.298088+0000","last_change":"2024-08-17T02:27:51.298088+0000","last_active":"2024-08-17T02:27:51.298088+0000","last_peered":"2024-08-17T02:27:51.298088+0000","last_clean":"2024-08-17T02:27:51.298088+0000","last_became_active":"2024-08-17T02:27:51.297755+0000","last_became_peered":"2024-08-17T02:27:51.297755+0000","last_unstale":"2024-08-17T02:27:51.298088+0000","last_undegraded":"2024-08-17T02:27:51.298088+0000","last_fullsized":"2024-08-17T02:27:51.298088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:52.916950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.287126+0000","last_change":"2024-08-17T02:27:51.287126+0000","last_active":"2024-08-17T02:27:51.287126+0000","last_peered":"2024-08-17T02:27:51.287126+0000","last_clean":"2024-08-17T02:27:51.287126+0000","last_became_active":"2024-08-17T02:27:51.286839+0000","last_became_peered":"2024-08-17T02:27:51.286839+0000","last_unstale":"2024-08-17T02:27:51.287126+0000","last_undegraded":"2024-08-17T02:27:51.287126+0000","last_fullsized":"2024-08-17T02:27:51.287126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:44.884519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.289382+0000","last_change":"2024-08-17T02:27:50.294440+0000","last_active":"2024-08-17T02:27:51.289382+0000","last_peered":"2024-08-17T02:27:51.289382+0000","last_clean":"2024-08-17T02:27:51.289382+0000","last_became_active":"2024-08-17T02:27:50.294141+0000","last_became_peered":"2024-08-17T02:27:50.294141+0000","last_unstale":"2024-08-17T02:27:51.289382+0000","last_undegraded":"2024-08-17T02:27:51.289382+0000","last_fullsized":"2024-08-17T02:27:51.289382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:30.074784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.295343+0000","last_change":"2024-08-17T02:27:51.295343+0000","last_active":"2024-08-17T02:27:51.295343+0000","last_peered":"2024-08-17T02:27:51.295343+0000","last_clean":"2024-08-17T02:27:51.295343+0000","last_became_active":"2024-08-17T02:27:51.293004+0000","last_became_peered":"2024-08-17T02:27:51.293004+0000","last_unstale":"2024-08-17T02:27:51.295343+0000","last_undegraded":"2024-08-17T02:27:51.295343+0000","last_fullsized":"2024-08-17T02:27:51.295343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:26.379433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.287543+0000","last_change":"2024-08-17T02:27:50.305041+0000","last_active":"2024-08-17T02:27:51.287543+0000","last_peered":"2024-08-17T02:27:51.287543+0000","last_clean":"2024-08-17T02:27:51.287543+0000","last_became_active":"2024-08-17T02:27:50.304359+0000","last_became_peered":"2024-08-17T02:27:50.304359+0000","last_unstale":"2024-08-17T02:27:51.287543+0000","last_undegraded":"2024-08-17T02:27:51.287543+0000","last_fullsized":"2024-08-17T02:27:51.287543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:23.849240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:27:50.306816+0000","last_change":"2024-08-17T02:27:50.304515+0000","last_active":"2024-08-17T02:27:50.306816+0000","last_peered":"2024-08-17T02:27:50.306816+0000","last_clean":"2024-08-17T02:27:50.306816+0000","last_became_active":"2024-08-17T02:27:50.304276+0000","last_became_peered":"2024-08-17T02:27:50.304276+0000","last_unstale":"2024-08-17T02:27:50.306816+0000","last_undegraded":"2024-08-17T02:27:50.306816+0000","last_fullsized":"2024-08-17T02:27:50.306816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:43.423994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.307787+0000","last_change":"2024-08-17T02:27:51.307787+0000","last_active":"2024-08-17T02:27:51.307787+0000","last_peered":"2024-08-17T02:27:51.307787+0000","last_clean":"2024-08-17T02:27:51.307787+0000","last_became_active":"2024-08-17T02:27:51.307539+0000","last_became_peered":"2024-08-17T02:27:51.307539+0000","last_unstale":"2024-08-17T02:27:51.307787+0000","last_undegraded":"2024-08-17T02:27:51.307787+0000","last_fullsized":"2024-08-17T02:27:51.307787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:52.916950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.295176+0000","last_change":"2024-08-17T02:27:50.285283+0000","last_active":"2024-08-17T02:27:51.295176+0000","last_peered":"2024-08-17T02:27:51.295176+0000","last_clean":"2024-08-17T02:27:51.295176+0000","last_became_active":"2024-08-17T02:27:50.284974+0000","last_became_peered":"2024-08-17T02:27:50.284974+0000","last_unstale":"2024-08-17T02:27:51.295176+0000","last_undegraded":"2024-08-17T02:27:51.295176+0000","last_fullsized":"2024-08-17T02:27:51.295176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:43.878005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309325+0000","last_change":"2024-08-17T02:27:51.306133+0000","last_active":"2024-08-17T02:27:51.309325+0000","last_peered":"2024-08-17T02:27:51.309325+0000","last_clean":"2024-08-17T02:27:51.309325+0000","last_became_active":"2024-08-17T02:27:51.305784+0000","last_became_peered":"2024-08-17T02:27:51.305784+0000","last_unstale":"2024-08-17T02:27:51.309325+0000","last_undegraded":"2024-08-17T02:27:51.309325+0000","last_fullsized":"2024-08-17T02:27:51.309325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:23.747098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:27:50.307546+0000","last_change":"2024-08-17T02:27:50.302699+0000","last_active":"2024-08-17T02:27:50.307546+0000","last_peered":"2024-08-17T02:27:50.307546+0000","last_clean":"2024-08-17T02:27:50.307546+0000","last_became_active":"2024-08-17T02:27:50.302324+0000","last_became_peered":"2024-08-17T02:27:50.302324+0000","last_unstale":"2024-08-17T02:27:50.307546+0000","last_undegraded":"2024-08-17T02:27:50.307546+0000","last_fullsized":"2024-08-17T02:27:50.307546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:43.878005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.319524+0000","last_change":"2024-08-17T02:27:51.317627+0000","last_active":"2024-08-17T02:27:51.319524+0000","last_peered":"2024-08-17T02:27:51.319524+0000","last_clean":"2024-08-17T02:27:51.319524+0000","last_became_active":"2024-08-17T02:27:51.317363+0000","last_became_peered":"2024-08-17T02:27:51.317363+0000","last_unstale":"2024-08-17T02:27:51.319524+0000","last_undegraded":"2024-08-17T02:27:51.319524+0000","last_fullsized":"2024-08-17T02:27:51.319524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:12:12.800070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.296163+0000","last_change":"2024-08-17T02:27:50.304899+0000","last_active":"2024-08-17T02:27:51.296163+0000","last_peered":"2024-08-17T02:27:51.296163+0000","last_clean":"2024-08-17T02:27:51.296163+0000","last_became_active":"2024-08-17T02:27:50.303335+0000","last_became_peered":"2024-08-17T02:27:50.303335+0000","last_unstale":"2024-08-17T02:27:51.296163+0000","last_undegraded":"2024-08-17T02:27:51.296163+0000","last_fullsized":"2024-08-17T02:27:51.296163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:23.849240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.311088+0000","last_change":"2024-08-17T02:27:51.311088+0000","last_active":"2024-08-17T02:27:51.311088+0000","last_peered":"2024-08-17T02:27:51.311088+0000","last_clean":"2024-08-17T02:27:51.311088+0000","last_became_active":"2024-08-17T02:27:51.310514+0000","last_became_peered":"2024-08-17T02:27:51.310514+0000","last_unstale":"2024-08-17T02:27:51.311088+0000","last_undegraded":"2024-08-17T02:27:51.311088+0000","last_fullsized":"2024-08-17T02:27:51.311088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:45:24.383393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.318886+0000","last_change":"2024-08-17T02:27:50.295951+0000","last_active":"2024-08-17T02:27:51.318886+0000","last_peered":"2024-08-17T02:27:51.318886+0000","last_clean":"2024-08-17T02:27:51.318886+0000","last_became_active":"2024-08-17T02:27:50.295351+0000","last_became_peered":"2024-08-17T02:27:50.295351+0000","last_unstale":"2024-08-17T02:27:51.318886+0000","last_undegraded":"2024-08-17T02:27:51.318886+0000","last_fullsized":"2024-08-17T02:27:51.318886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:57.534676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.303007+0000","last_change":"2024-08-17T02:27:51.303007+0000","last_active":"2024-08-17T02:27:51.303007+0000","last_peered":"2024-08-17T02:27:51.303007+0000","last_clean":"2024-08-17T02:27:51.303007+0000","last_became_active":"2024-08-17T02:27:51.300357+0000","last_became_peered":"2024-08-17T02:27:51.300357+0000","last_unstale":"2024-08-17T02:27:51.303007+0000","last_undegraded":"2024-08-17T02:27:51.303007+0000","last_fullsized":"2024-08-17T02:27:51.303007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:36:40.089843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315398+0000","last_change":"2024-08-17T02:27:50.304133+0000","last_active":"2024-08-17T02:27:51.315398+0000","last_peered":"2024-08-17T02:27:51.315398+0000","last_clean":"2024-08-17T02:27:51.315398+0000","last_became_active":"2024-08-17T02:27:50.302755+0000","last_became_peered":"2024-08-17T02:27:50.302755+0000","last_unstale":"2024-08-17T02:27:51.315398+0000","last_undegraded":"2024-08-17T02:27:51.315398+0000","last_fullsized":"2024-08-17T02:27:51.315398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:02:06.007638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.310016+0000","last_change":"2024-08-17T02:27:51.310016+0000","last_active":"2024-08-17T02:27:51.310016+0000","last_peered":"2024-08-17T02:27:51.310016+0000","last_clean":"2024-08-17T02:27:51.310016+0000","last_became_active":"2024-08-17T02:27:51.309632+0000","last_became_peered":"2024-08-17T02:27:51.309632+0000","last_unstale":"2024-08-17T02:27:51.310016+0000","last_undegraded":"2024-08-17T02:27:51.310016+0000","last_fullsized":"2024-08-17T02:27:51.310016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:40.951641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.316088+0000","last_change":"2024-08-17T02:27:50.300858+0000","last_active":"2024-08-17T02:27:51.316088+0000","last_peered":"2024-08-17T02:27:51.316088+0000","last_clean":"2024-08-17T02:27:51.316088+0000","last_became_active":"2024-08-17T02:27:50.300575+0000","last_became_peered":"2024-08-17T02:27:50.300575+0000","last_unstale":"2024-08-17T02:27:51.316088+0000","last_undegraded":"2024-08-17T02:27:51.316088+0000","last_fullsized":"2024-08-17T02:27:51.316088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:30.074784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.295142+0000","last_change":"2024-08-17T02:27:51.295142+0000","last_active":"2024-08-17T02:27:51.295142+0000","last_peered":"2024-08-17T02:27:51.295142+0000","last_clean":"2024-08-17T02:27:51.295142+0000","last_became_active":"2024-08-17T02:27:51.294912+0000","last_became_peered":"2024-08-17T02:27:51.294912+0000","last_unstale":"2024-08-17T02:27:51.295142+0000","last_undegraded":"2024-08-17T02:27:51.295142+0000","last_fullsized":"2024-08-17T02:27:51.295142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:23.159482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.293032+0000","last_change":"2024-08-17T02:27:50.298640+0000","last_active":"2024-08-17T02:27:51.293032+0000","last_peered":"2024-08-17T02:27:51.293032+0000","last_clean":"2024-08-17T02:27:51.293032+0000","last_became_active":"2024-08-17T02:27:50.298355+0000","last_became_peered":"2024-08-17T02:27:50.298355+0000","last_unstale":"2024-08-17T02:27:51.293032+0000","last_undegraded":"2024-08-17T02:27:51.293032+0000","last_fullsized":"2024-08-17T02:27:51.293032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:43:01.783598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.318860+0000","last_change":"2024-08-17T02:27:51.318860+0000","last_active":"2024-08-17T02:27:51.318860+0000","last_peered":"2024-08-17T02:27:51.318860+0000","last_clean":"2024-08-17T02:27:51.318860+0000","last_became_active":"2024-08-17T02:27:51.317220+0000","last_became_peered":"2024-08-17T02:27:51.317220+0000","last_unstale":"2024-08-17T02:27:51.318860+0000","last_undegraded":"2024-08-17T02:27:51.318860+0000","last_fullsized":"2024-08-17T02:27:51.318860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:47:22.647519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:27:50.307550+0000","last_change":"2024-08-17T02:27:50.304030+0000","last_active":"2024-08-17T02:27:50.307550+0000","last_peered":"2024-08-17T02:27:50.307550+0000","last_clean":"2024-08-17T02:27:50.307550+0000","last_became_active":"2024-08-17T02:27:50.303575+0000","last_became_peered":"2024-08-17T02:27:50.303575+0000","last_unstale":"2024-08-17T02:27:50.307550+0000","last_undegraded":"2024-08-17T02:27:50.307550+0000","last_fullsized":"2024-08-17T02:27:50.307550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:01.529714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.297859+0000","last_change":"2024-08-17T02:27:51.297859+0000","last_active":"2024-08-17T02:27:51.297859+0000","last_peered":"2024-08-17T02:27:51.297859+0000","last_clean":"2024-08-17T02:27:51.297859+0000","last_became_active":"2024-08-17T02:27:51.297542+0000","last_became_peered":"2024-08-17T02:27:51.297542+0000","last_unstale":"2024-08-17T02:27:51.297859+0000","last_undegraded":"2024-08-17T02:27:51.297859+0000","last_fullsized":"2024-08-17T02:27:51.297859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:17:09.418523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.307003+0000","last_change":"2024-08-17T02:27:50.289491+0000","last_active":"2024-08-17T02:27:51.307003+0000","last_peered":"2024-08-17T02:27:51.307003+0000","last_clean":"2024-08-17T02:27:51.307003+0000","last_became_active":"2024-08-17T02:27:50.287407+0000","last_became_peered":"2024-08-17T02:27:50.287407+0000","last_unstale":"2024-08-17T02:27:51.307003+0000","last_undegraded":"2024-08-17T02:27:51.307003+0000","last_fullsized":"2024-08-17T02:27:51.307003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:02:06.007638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.311648+0000","last_change":"2024-08-17T02:27:51.311648+0000","last_active":"2024-08-17T02:27:51.311648+0000","last_peered":"2024-08-17T02:27:51.311648+0000","last_clean":"2024-08-17T02:27:51.311648+0000","last_became_active":"2024-08-17T02:27:51.311419+0000","last_became_peered":"2024-08-17T02:27:51.311419+0000","last_unstale":"2024-08-17T02:27:51.311648+0000","last_undegraded":"2024-08-17T02:27:51.311648+0000","last_fullsized":"2024-08-17T02:27:51.311648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:56:03.462179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.281711+0000","last_change":"2024-08-17T02:27:50.290855+0000","last_active":"2024-08-17T02:27:51.281711+0000","last_peered":"2024-08-17T02:27:51.281711+0000","last_clean":"2024-08-17T02:27:51.281711+0000","last_became_active":"2024-08-17T02:27:50.289943+0000","last_became_peered":"2024-08-17T02:27:50.289943+0000","last_unstale":"2024-08-17T02:27:51.281711+0000","last_undegraded":"2024-08-17T02:27:51.281711+0000","last_fullsized":"2024-08-17T02:27:51.281711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:52:17.225404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.311333+0000","last_change":"2024-08-17T02:27:51.311333+0000","last_active":"2024-08-17T02:27:51.311333+0000","last_peered":"2024-08-17T02:27:51.311333+0000","last_clean":"2024-08-17T02:27:51.311333+0000","last_became_active":"2024-08-17T02:27:51.311078+0000","last_became_peered":"2024-08-17T02:27:51.311078+0000","last_unstale":"2024-08-17T02:27:51.311333+0000","last_undegraded":"2024-08-17T02:27:51.311333+0000","last_fullsized":"2024-08-17T02:27:51.311333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:01.072889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309026+0000","last_change":"2024-08-17T02:27:50.301645+0000","last_active":"2024-08-17T02:27:51.309026+0000","last_peered":"2024-08-17T02:27:51.309026+0000","last_clean":"2024-08-17T02:27:51.309026+0000","last_became_active":"2024-08-17T02:27:50.301348+0000","last_became_peered":"2024-08-17T02:27:50.301348+0000","last_unstale":"2024-08-17T02:27:51.309026+0000","last_undegraded":"2024-08-17T02:27:51.309026+0000","last_fullsized":"2024-08-17T02:27:51.309026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:43.423994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315762+0000","last_change":"2024-08-17T02:27:51.315762+0000","last_active":"2024-08-17T02:27:51.315762+0000","last_peered":"2024-08-17T02:27:51.315762+0000","last_clean":"2024-08-17T02:27:51.315762+0000","last_became_active":"2024-08-17T02:27:51.315472+0000","last_became_peered":"2024-08-17T02:27:51.315472+0000","last_unstale":"2024-08-17T02:27:51.315762+0000","last_undegraded":"2024-08-17T02:27:51.315762+0000","last_fullsized":"2024-08-17T02:27:51.315762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:59:59.342696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.308888+0000","last_change":"2024-08-17T02:27:50.296190+0000","last_active":"2024-08-17T02:27:51.308888+0000","last_peered":"2024-08-17T02:27:51.308888+0000","last_clean":"2024-08-17T02:27:51.308888+0000","last_became_active":"2024-08-17T02:27:50.295362+0000","last_became_peered":"2024-08-17T02:27:50.295362+0000","last_unstale":"2024-08-17T02:27:51.308888+0000","last_undegraded":"2024-08-17T02:27:51.308888+0000","last_fullsized":"2024-08-17T02:27:51.308888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:23.849240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315799+0000","last_change":"2024-08-17T02:27:51.310706+0000","last_active":"2024-08-17T02:27:51.315799+0000","last_peered":"2024-08-17T02:27:51.315799+0000","last_clean":"2024-08-17T02:27:51.315799+0000","last_became_active":"2024-08-17T02:27:51.310451+0000","last_became_peered":"2024-08-17T02:27:51.310451+0000","last_unstale":"2024-08-17T02:27:51.315799+0000","last_undegraded":"2024-08-17T02:27:51.315799+0000","last_fullsized":"2024-08-17T02:27:51.315799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:59:59.342696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.285945+0000","last_change":"2024-08-17T02:27:50.289792+0000","last_active":"2024-08-17T02:27:51.285945+0000","last_peered":"2024-08-17T02:27:51.285945+0000","last_clean":"2024-08-17T02:27:51.285945+0000","last_became_active":"2024-08-17T02:27:50.288900+0000","last_became_peered":"2024-08-17T02:27:50.288900+0000","last_unstale":"2024-08-17T02:27:51.285945+0000","last_undegraded":"2024-08-17T02:27:51.285945+0000","last_fullsized":"2024-08-17T02:27:51.285945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:01.529714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.303771+0000","last_change":"2024-08-17T02:27:51.303771+0000","last_active":"2024-08-17T02:27:51.303771+0000","last_peered":"2024-08-17T02:27:51.303771+0000","last_clean":"2024-08-17T02:27:51.303771+0000","last_became_active":"2024-08-17T02:27:51.303503+0000","last_became_peered":"2024-08-17T02:27:51.303503+0000","last_unstale":"2024-08-17T02:27:51.303771+0000","last_undegraded":"2024-08-17T02:27:51.303771+0000","last_fullsized":"2024-08-17T02:27:51.303771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:08.545557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":162,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:27:50.293559+0000","last_change":"2024-08-17T02:27:39.552321+0000","last_active":"2024-08-17T02:27:50.293559+0000","last_peered":"2024-08-17T02:27:50.293559+0000","last_clean":"2024-08-17T02:27:50.293559+0000","last_became_active":"2024-08-17T02:27:39.551203+0000","last_became_peered":"2024-08-17T02:27:39.551203+0000","last_unstale":"2024-08-17T02:27:50.293559+0000","last_undegraded":"2024-08-17T02:27:50.293559+0000","last_fullsized":"2024-08-17T02:27:50.293559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.155679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.155679+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.155679+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:02.785032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.292505+0000","last_change":"2024-08-17T02:27:50.289453+0000","last_active":"2024-08-17T02:27:51.292505+0000","last_peered":"2024-08-17T02:27:51.292505+0000","last_clean":"2024-08-17T02:27:51.292505+0000","last_became_active":"2024-08-17T02:27:50.289066+0000","last_became_peered":"2024-08-17T02:27:50.289066+0000","last_unstale":"2024-08-17T02:27:51.292505+0000","last_undegraded":"2024-08-17T02:27:51.292505+0000","last_fullsized":"2024-08-17T02:27:51.292505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:01.529714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.302543+0000","last_change":"2024-08-17T02:27:51.302543+0000","last_active":"2024-08-17T02:27:51.302543+0000","last_peered":"2024-08-17T02:27:51.302543+0000","last_clean":"2024-08-17T02:27:51.302543+0000","last_became_active":"2024-08-17T02:27:51.302282+0000","last_became_peered":"2024-08-17T02:27:51.302282+0000","last_unstale":"2024-08-17T02:27:51.302543+0000","last_undegraded":"2024-08-17T02:27:51.302543+0000","last_fullsized":"2024-08-17T02:27:51.302543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:07.004040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:27:50.308254+0000","last_change":"2024-08-17T02:27:50.305660+0000","last_active":"2024-08-17T02:27:50.308254+0000","last_peered":"2024-08-17T02:27:50.308254+0000","last_clean":"2024-08-17T02:27:50.308254+0000","last_became_active":"2024-08-17T02:27:50.305076+0000","last_became_peered":"2024-08-17T02:27:50.305076+0000","last_unstale":"2024-08-17T02:27:50.308254+0000","last_undegraded":"2024-08-17T02:27:50.308254+0000","last_fullsized":"2024-08-17T02:27:50.308254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:36:39.083329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.291775+0000","last_change":"2024-08-17T02:27:51.291775+0000","last_active":"2024-08-17T02:27:51.291775+0000","last_peered":"2024-08-17T02:27:51.291775+0000","last_clean":"2024-08-17T02:27:51.291775+0000","last_became_active":"2024-08-17T02:27:51.291502+0000","last_became_peered":"2024-08-17T02:27:51.291502+0000","last_unstale":"2024-08-17T02:27:51.291775+0000","last_undegraded":"2024-08-17T02:27:51.291775+0000","last_fullsized":"2024-08-17T02:27:51.291775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:52.916950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.285821+0000","last_change":"2024-08-17T02:27:50.294544+0000","last_active":"2024-08-17T02:27:51.285821+0000","last_peered":"2024-08-17T02:27:51.285821+0000","last_clean":"2024-08-17T02:27:51.285821+0000","last_became_active":"2024-08-17T02:27:50.293620+0000","last_became_peered":"2024-08-17T02:27:50.293620+0000","last_unstale":"2024-08-17T02:27:51.285821+0000","last_undegraded":"2024-08-17T02:27:51.285821+0000","last_fullsized":"2024-08-17T02:27:51.285821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:43:01.783598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.296255+0000","last_change":"2024-08-17T02:27:51.292285+0000","last_active":"2024-08-17T02:27:51.296255+0000","last_peered":"2024-08-17T02:27:51.296255+0000","last_clean":"2024-08-17T02:27:51.296255+0000","last_became_active":"2024-08-17T02:27:51.292028+0000","last_became_peered":"2024-08-17T02:27:51.292028+0000","last_unstale":"2024-08-17T02:27:51.296255+0000","last_undegraded":"2024-08-17T02:27:51.296255+0000","last_fullsized":"2024-08-17T02:27:51.296255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:00.021420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.295539+0000","last_change":"2024-08-17T02:27:50.300081+0000","last_active":"2024-08-17T02:27:51.295539+0000","last_peered":"2024-08-17T02:27:51.295539+0000","last_clean":"2024-08-17T02:27:51.295539+0000","last_became_active":"2024-08-17T02:27:50.299745+0000","last_became_peered":"2024-08-17T02:27:50.299745+0000","last_unstale":"2024-08-17T02:27:51.295539+0000","last_undegraded":"2024-08-17T02:27:51.295539+0000","last_fullsized":"2024-08-17T02:27:51.295539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:57.534676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.291025+0000","last_change":"2024-08-17T02:27:51.291025+0000","last_active":"2024-08-17T02:27:51.291025+0000","last_peered":"2024-08-17T02:27:51.291025+0000","last_clean":"2024-08-17T02:27:51.291025+0000","last_became_active":"2024-08-17T02:27:51.290690+0000","last_became_peered":"2024-08-17T02:27:51.290690+0000","last_unstale":"2024-08-17T02:27:51.291025+0000","last_undegraded":"2024-08-17T02:27:51.291025+0000","last_fullsized":"2024-08-17T02:27:51.291025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:58.541189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.284142+0000","last_change":"2024-08-17T02:27:50.299597+0000","last_active":"2024-08-17T02:27:51.284142+0000","last_peered":"2024-08-17T02:27:51.284142+0000","last_clean":"2024-08-17T02:27:51.284142+0000","last_became_active":"2024-08-17T02:27:50.298486+0000","last_became_peered":"2024-08-17T02:27:50.298486+0000","last_unstale":"2024-08-17T02:27:51.284142+0000","last_undegraded":"2024-08-17T02:27:51.284142+0000","last_fullsized":"2024-08-17T02:27:51.284142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:43:01.783598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315535+0000","last_change":"2024-08-17T02:27:51.311899+0000","last_active":"2024-08-17T02:27:51.315535+0000","last_peered":"2024-08-17T02:27:51.315535+0000","last_clean":"2024-08-17T02:27:51.315535+0000","last_became_active":"2024-08-17T02:27:51.311615+0000","last_became_peered":"2024-08-17T02:27:51.311615+0000","last_unstale":"2024-08-17T02:27:51.315535+0000","last_undegraded":"2024-08-17T02:27:51.315535+0000","last_fullsized":"2024-08-17T02:27:51.315535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:56:03.462179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:27:50.305322+0000","last_change":"2024-08-17T02:27:50.302154+0000","last_active":"2024-08-17T02:27:50.305322+0000","last_peered":"2024-08-17T02:27:50.305322+0000","last_clean":"2024-08-17T02:27:50.305322+0000","last_became_active":"2024-08-17T02:27:50.301832+0000","last_became_peered":"2024-08-17T02:27:50.301832+0000","last_unstale":"2024-08-17T02:27:50.305322+0000","last_undegraded":"2024-08-17T02:27:50.305322+0000","last_fullsized":"2024-08-17T02:27:50.305322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:57.534676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.296467+0000","last_change":"2024-08-17T02:27:51.292360+0000","last_active":"2024-08-17T02:27:51.296467+0000","last_peered":"2024-08-17T02:27:51.296467+0000","last_clean":"2024-08-17T02:27:51.296467+0000","last_became_active":"2024-08-17T02:27:51.292122+0000","last_became_peered":"2024-08-17T02:27:51.292122+0000","last_unstale":"2024-08-17T02:27:51.296467+0000","last_undegraded":"2024-08-17T02:27:51.296467+0000","last_fullsized":"2024-08-17T02:27:51.296467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:52.916950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.284377+0000","last_change":"2024-08-17T02:27:50.302427+0000","last_active":"2024-08-17T02:27:51.284377+0000","last_peered":"2024-08-17T02:27:51.284377+0000","last_clean":"2024-08-17T02:27:51.284377+0000","last_became_active":"2024-08-17T02:27:50.301894+0000","last_became_peered":"2024-08-17T02:27:50.301894+0000","last_unstale":"2024-08-17T02:27:51.284377+0000","last_undegraded":"2024-08-17T02:27:51.284377+0000","last_fullsized":"2024-08-17T02:27:51.284377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:52:34.125784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.300754+0000","last_change":"2024-08-17T02:27:51.300754+0000","last_active":"2024-08-17T02:27:51.300754+0000","last_peered":"2024-08-17T02:27:51.300754+0000","last_clean":"2024-08-17T02:27:51.300754+0000","last_became_active":"2024-08-17T02:27:51.300516+0000","last_became_peered":"2024-08-17T02:27:51.300516+0000","last_unstale":"2024-08-17T02:27:51.300754+0000","last_undegraded":"2024-08-17T02:27:51.300754+0000","last_fullsized":"2024-08-17T02:27:51.300754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:23.159482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.308163+0000","last_change":"2024-08-17T02:27:50.300734+0000","last_active":"2024-08-17T02:27:51.308163+0000","last_peered":"2024-08-17T02:27:51.308163+0000","last_clean":"2024-08-17T02:27:51.308163+0000","last_became_active":"2024-08-17T02:27:50.300458+0000","last_became_peered":"2024-08-17T02:27:50.300458+0000","last_unstale":"2024-08-17T02:27:51.308163+0000","last_undegraded":"2024-08-17T02:27:51.308163+0000","last_fullsized":"2024-08-17T02:27:51.308163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:43:01.783598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.290195+0000","last_change":"2024-08-17T02:27:51.290195+0000","last_active":"2024-08-17T02:27:51.290195+0000","last_peered":"2024-08-17T02:27:51.290195+0000","last_clean":"2024-08-17T02:27:51.290195+0000","last_became_active":"2024-08-17T02:27:51.287748+0000","last_became_peered":"2024-08-17T02:27:51.287748+0000","last_unstale":"2024-08-17T02:27:51.290195+0000","last_undegraded":"2024-08-17T02:27:51.290195+0000","last_fullsized":"2024-08-17T02:27:51.290195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:44.789170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:27:50.305793+0000","last_change":"2024-08-17T02:27:50.302235+0000","last_active":"2024-08-17T02:27:50.305793+0000","last_peered":"2024-08-17T02:27:50.305793+0000","last_clean":"2024-08-17T02:27:50.305793+0000","last_became_active":"2024-08-17T02:27:50.301967+0000","last_became_peered":"2024-08-17T02:27:50.301967+0000","last_unstale":"2024-08-17T02:27:50.305793+0000","last_undegraded":"2024-08-17T02:27:50.305793+0000","last_fullsized":"2024-08-17T02:27:50.305793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:43.878005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.293997+0000","last_change":"2024-08-17T02:27:51.293997+0000","last_active":"2024-08-17T02:27:51.293997+0000","last_peered":"2024-08-17T02:27:51.293997+0000","last_clean":"2024-08-17T02:27:51.293997+0000","last_became_active":"2024-08-17T02:27:51.293661+0000","last_became_peered":"2024-08-17T02:27:51.293661+0000","last_unstale":"2024-08-17T02:27:51.293997+0000","last_undegraded":"2024-08-17T02:27:51.293997+0000","last_fullsized":"2024-08-17T02:27:51.293997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:24.855754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.285393+0000","last_change":"2024-08-17T02:27:50.297434+0000","last_active":"2024-08-17T02:27:51.285393+0000","last_peered":"2024-08-17T02:27:51.285393+0000","last_clean":"2024-08-17T02:27:51.285393+0000","last_became_active":"2024-08-17T02:27:50.297160+0000","last_became_peered":"2024-08-17T02:27:50.297160+0000","last_unstale":"2024-08-17T02:27:51.285393+0000","last_undegraded":"2024-08-17T02:27:51.285393+0000","last_fullsized":"2024-08-17T02:27:51.285393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:43.878005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.294170+0000","last_change":"2024-08-17T02:27:51.294170+0000","last_active":"2024-08-17T02:27:51.294170+0000","last_peered":"2024-08-17T02:27:51.294170+0000","last_clean":"2024-08-17T02:27:51.294170+0000","last_became_active":"2024-08-17T02:27:51.293090+0000","last_became_peered":"2024-08-17T02:27:51.293090+0000","last_unstale":"2024-08-17T02:27:51.294170+0000","last_undegraded":"2024-08-17T02:27:51.294170+0000","last_fullsized":"2024-08-17T02:27:51.294170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:26.379433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.283605+0000","last_change":"2024-08-17T02:27:50.298748+0000","last_active":"2024-08-17T02:27:51.283605+0000","last_peered":"2024-08-17T02:27:51.283605+0000","last_clean":"2024-08-17T02:27:51.283605+0000","last_became_active":"2024-08-17T02:27:50.298203+0000","last_became_peered":"2024-08-17T02:27:50.298203+0000","last_unstale":"2024-08-17T02:27:51.283605+0000","last_undegraded":"2024-08-17T02:27:51.283605+0000","last_fullsized":"2024-08-17T02:27:51.283605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:36:39.083329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.308188+0000","last_change":"2024-08-17T02:27:51.308188+0000","last_active":"2024-08-17T02:27:51.308188+0000","last_peered":"2024-08-17T02:27:51.308188+0000","last_clean":"2024-08-17T02:27:51.308188+0000","last_became_active":"2024-08-17T02:27:51.307669+0000","last_became_peered":"2024-08-17T02:27:51.307669+0000","last_unstale":"2024-08-17T02:27:51.308188+0000","last_undegraded":"2024-08-17T02:27:51.308188+0000","last_fullsized":"2024-08-17T02:27:51.308188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:44.789170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.317161+0000","last_change":"2024-08-17T02:27:50.305833+0000","last_active":"2024-08-17T02:27:51.317161+0000","last_peered":"2024-08-17T02:27:51.317161+0000","last_clean":"2024-08-17T02:27:51.317161+0000","last_became_active":"2024-08-17T02:27:50.304646+0000","last_became_peered":"2024-08-17T02:27:50.304646+0000","last_unstale":"2024-08-17T02:27:51.317161+0000","last_undegraded":"2024-08-17T02:27:51.317161+0000","last_fullsized":"2024-08-17T02:27:51.317161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:39:03.039409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.310592+0000","last_change":"2024-08-17T02:27:51.310592+0000","last_active":"2024-08-17T02:27:51.310592+0000","last_peered":"2024-08-17T02:27:51.310592+0000","last_clean":"2024-08-17T02:27:51.310592+0000","last_became_active":"2024-08-17T02:27:51.310246+0000","last_became_peered":"2024-08-17T02:27:51.310246+0000","last_unstale":"2024-08-17T02:27:51.310592+0000","last_undegraded":"2024-08-17T02:27:51.310592+0000","last_fullsized":"2024-08-17T02:27:51.310592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:23.747098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.316539+0000","last_change":"2024-08-17T02:27:51.315083+0000","last_active":"2024-08-17T02:27:51.316539+0000","last_peered":"2024-08-17T02:27:51.316539+0000","last_clean":"2024-08-17T02:27:51.316539+0000","last_became_active":"2024-08-17T02:27:51.314854+0000","last_became_peered":"2024-08-17T02:27:51.314854+0000","last_unstale":"2024-08-17T02:27:51.316539+0000","last_undegraded":"2024-08-17T02:27:51.316539+0000","last_fullsized":"2024-08-17T02:27:51.316539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:51:59.475864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.302878+0000","last_change":"2024-08-17T02:27:50.303023+0000","last_active":"2024-08-17T02:27:51.302878+0000","last_peered":"2024-08-17T02:27:51.302878+0000","last_clean":"2024-08-17T02:27:51.302878+0000","last_became_active":"2024-08-17T02:27:50.302104+0000","last_became_peered":"2024-08-17T02:27:50.302104+0000","last_unstale":"2024-08-17T02:27:51.302878+0000","last_undegraded":"2024-08-17T02:27:51.302878+0000","last_fullsized":"2024-08-17T02:27:51.302878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:23.849240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.316569+0000","last_change":"2024-08-17T02:27:51.315498+0000","last_active":"2024-08-17T02:27:51.316569+0000","last_peered":"2024-08-17T02:27:51.316569+0000","last_clean":"2024-08-17T02:27:51.316569+0000","last_became_active":"2024-08-17T02:27:51.315126+0000","last_became_peered":"2024-08-17T02:27:51.315126+0000","last_unstale":"2024-08-17T02:27:51.316569+0000","last_undegraded":"2024-08-17T02:27:51.316569+0000","last_fullsized":"2024-08-17T02:27:51.316569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:07.004040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309881+0000","last_change":"2024-08-17T02:27:50.308330+0000","last_active":"2024-08-17T02:27:51.309881+0000","last_peered":"2024-08-17T02:27:51.309881+0000","last_clean":"2024-08-17T02:27:51.309881+0000","last_became_active":"2024-08-17T02:27:50.307213+0000","last_became_peered":"2024-08-17T02:27:50.307213+0000","last_unstale":"2024-08-17T02:27:51.309881+0000","last_undegraded":"2024-08-17T02:27:51.309881+0000","last_fullsized":"2024-08-17T02:27:51.309881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:52:34.125784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.311099+0000","last_change":"2024-08-17T02:27:51.311099+0000","last_active":"2024-08-17T02:27:51.311099+0000","last_peered":"2024-08-17T02:27:51.311099+0000","last_clean":"2024-08-17T02:27:51.311099+0000","last_became_active":"2024-08-17T02:27:51.310841+0000","last_became_peered":"2024-08-17T02:27:51.310841+0000","last_unstale":"2024-08-17T02:27:51.311099+0000","last_undegraded":"2024-08-17T02:27:51.311099+0000","last_fullsized":"2024-08-17T02:27:51.311099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:17:09.418523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.284546+0000","last_change":"2024-08-17T02:27:50.299166+0000","last_active":"2024-08-17T02:27:51.284546+0000","last_peered":"2024-08-17T02:27:51.284546+0000","last_clean":"2024-08-17T02:27:51.284546+0000","last_became_active":"2024-08-17T02:27:50.297610+0000","last_became_peered":"2024-08-17T02:27:50.297610+0000","last_unstale":"2024-08-17T02:27:51.284546+0000","last_undegraded":"2024-08-17T02:27:51.284546+0000","last_fullsized":"2024-08-17T02:27:51.284546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:29.138877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.295869+0000","last_change":"2024-08-17T02:27:51.295869+0000","last_active":"2024-08-17T02:27:51.295869+0000","last_peered":"2024-08-17T02:27:51.295869+0000","last_clean":"2024-08-17T02:27:51.295869+0000","last_became_active":"2024-08-17T02:27:51.295671+0000","last_became_peered":"2024-08-17T02:27:51.295671+0000","last_unstale":"2024-08-17T02:27:51.295869+0000","last_undegraded":"2024-08-17T02:27:51.295869+0000","last_fullsized":"2024-08-17T02:27:51.295869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:04:36.940627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.321409+0000","last_change":"2024-08-17T02:27:50.298314+0000","last_active":"2024-08-17T02:27:51.321409+0000","last_peered":"2024-08-17T02:27:51.321409+0000","last_clean":"2024-08-17T02:27:51.321409+0000","last_became_active":"2024-08-17T02:27:50.298019+0000","last_became_peered":"2024-08-17T02:27:50.298019+0000","last_unstale":"2024-08-17T02:27:51.321409+0000","last_undegraded":"2024-08-17T02:27:51.321409+0000","last_fullsized":"2024-08-17T02:27:51.321409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:29.138877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298132,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073708,"statfs":{"total":96636764160,"available":96331476992,"internally_reserved":0,"allocated":790528,"data_stored":655304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":204800,"data_stored":65918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":196608,"data_stored":64456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":204800,"data_stored":64492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":204800,"data_stored":65918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":192512,"data_stored":64366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.484}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":200704,"data_stored":64526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298140,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073700,"statfs":{"total":96636764160,"available":96331468800,"internally_reserved":0,"allocated":798720,"data_stored":655360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:55.419 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:27:55.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.601+0000 7f23cfa00640 1 Processor -- start 2024-08-17T02:27:55.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.601+0000 7f23cfa00640 1 -- start start 2024-08-17T02:27:55.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.602+0000 7f23cfa00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23c81401b0 0x7f23c80caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.603+0000 7f23cfa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f23c8140580 0x7f23c80b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.603+0000 7f23cfa00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f23c80b1270 0x7f23c80c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.603+0000 7f23cfa00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c80cb450 con 0x7f23c8140580 2024-08-17T02:27:55.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.603+0000 7f23cfa00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c80b16d0 con 0x7f23c80b1270 2024-08-17T02:27:55.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.603+0000 7f23cfa00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c80caa80 con 0x7f23c81401b0 2024-08-17T02:27:55.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.603+0000 7f23bfe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f23c8140580 0x7f23c80b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.603+0000 7f23bfe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f23c8140580 0x7f23c80b0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56432/0 (socket says 172.21.15.106:56432) 2024-08-17T02:27:55.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.603+0000 7f23bfe00640 1 -- 172.21.15.106:0/3932272816 learned_addr learned my addr 172.21.15.106:0/3932272816 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:55.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.603+0000 7f23cd000640 1 --2- 172.21.15.106:0/3932272816 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23c81401b0 0x7f23c80caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.603+0000 7f23cda00640 1 --2- 172.21.15.106:0/3932272816 >> v2:172.21.15.171:3300/0 conn(0x7f23c80b1270 0x7f23c80c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.603+0000 7f23bfe00640 1 -- 172.21.15.106:0/3932272816 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23c81401b0 msgr2=0x7f23c80caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:55.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.603+0000 7f23bfe00640 1 --2- 172.21.15.106:0/3932272816 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23c81401b0 0x7f23c80caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.603+0000 7f23bfe00640 1 -- 172.21.15.106:0/3932272816 >> v2:172.21.15.171:3300/0 conn(0x7f23c80b1270 msgr2=0x7f23c80c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:55.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.603+0000 7f23bfe00640 1 --2- 172.21.15.106:0/3932272816 >> v2:172.21.15.171:3300/0 conn(0x7f23c80b1270 0x7f23c80c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.603+0000 7f23bfe00640 1 -- 172.21.15.106:0/3932272816 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c80c9e70 con 0x7f23c8140580 2024-08-17T02:27:55.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.603+0000 7f23cda00640 1 --2- 172.21.15.106:0/3932272816 >> v2:172.21.15.171:3300/0 conn(0x7f23c80b1270 0x7f23c80c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:55.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.604+0000 7f23bfe00640 1 --2- 172.21.15.106:0/3932272816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23c8140580 0x7f23c80b0d30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f23c80acbc0 tx=0x7f23b00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277d1ee570fb0aa5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:55.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.604+0000 7f23c7e00640 1 -- 172.21.15.106:0/3932272816 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b002ad40 con 0x7f23c8140580 2024-08-17T02:27:55.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.605+0000 7f23c7e00640 1 -- 172.21.15.106:0/3932272816 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b0032440 con 0x7f23c8140580 2024-08-17T02:27:55.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.605+0000 7f23c7e00640 1 -- 172.21.15.106:0/3932272816 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b002aea0 con 0x7f23c8140580 2024-08-17T02:27:55.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.605+0000 7f23cfa00640 1 -- 172.21.15.106:0/3932272816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23c8140580 msgr2=0x7f23c80b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.605+0000 7f23cfa00640 1 --2- 172.21.15.106:0/3932272816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23c8140580 0x7f23c80b0d30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f23c80acbc0 tx=0x7f23b00091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.605+0000 7f23cfa00640 1 -- 172.21.15.106:0/3932272816 shutdown_connections 2024-08-17T02:27:55.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.605+0000 7f23cfa00640 1 --2- 172.21.15.106:0/3932272816 >> v2:172.21.15.171:3300/0 conn(0x7f23c80b1270 0x7f23c80c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.605+0000 7f23cfa00640 1 --2- 172.21.15.106:0/3932272816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23c8140580 0x7f23c80b0d30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.605+0000 7f23cfa00640 1 --2- 172.21.15.106:0/3932272816 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23c81401b0 0x7f23c80caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.605+0000 7f23cfa00640 1 -- 172.21.15.106:0/3932272816 >> 172.21.15.106:0/3932272816 conn(0x7f23c80cb9b0 msgr2=0x7f23c80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:55.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.605+0000 7f23cfa00640 1 -- 172.21.15.106:0/3932272816 shutdown_connections 2024-08-17T02:27:55.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.605+0000 7f23cfa00640 1 -- 172.21.15.106:0/3932272816 wait complete. 2024-08-17T02:27:55.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.607+0000 7f23cfa00640 1 Processor -- start 2024-08-17T02:27:55.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.607+0000 7f23cfa00640 1 -- start start 2024-08-17T02:27:55.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.608+0000 7f23cfa00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23c80b1270 0x7f23c815bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.608+0000 7f23cfa00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23c81401b0 0x7f23c80abd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.608+0000 7f23cfa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23c8140580 0x7f23c815cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.608+0000 7f23cfa00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c80ac6a0 con 0x7f23c8140580 2024-08-17T02:27:55.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.608+0000 7f23cfa00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c80ac3c0 con 0x7f23c81401b0 2024-08-17T02:27:55.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.608+0000 7f23cfa00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c815b3c0 con 0x7f23c80b1270 2024-08-17T02:27:55.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.608+0000 7f23cda00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23c8140580 0x7f23c815cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.608+0000 7f23cda00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23c8140580 0x7f23c815cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56438/0 (socket says 172.21.15.106:56438) 2024-08-17T02:27:55.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.608+0000 7f23cda00640 1 -- 172.21.15.106:0/102237477 learned_addr learned my addr 172.21.15.106:0/102237477 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:55.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.608+0000 7f23cd000640 1 --2- 172.21.15.106:0/102237477 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23c80b1270 0x7f23c815bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.608+0000 7f23bfe00640 1 --2- 172.21.15.106:0/102237477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23c81401b0 0x7f23c80abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.608+0000 7f23cda00640 1 -- 172.21.15.106:0/102237477 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23c80b1270 msgr2=0x7f23c815bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.608+0000 7f23cda00640 1 --2- 172.21.15.106:0/102237477 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23c80b1270 0x7f23c815bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.608+0000 7f23cda00640 1 -- 172.21.15.106:0/102237477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23c81401b0 msgr2=0x7f23c80abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.608+0000 7f23cda00640 1 --2- 172.21.15.106:0/102237477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23c81401b0 0x7f23c80abd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.608+0000 7f23cda00640 1 -- 172.21.15.106:0/102237477 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b0009450 con 0x7f23c8140580 2024-08-17T02:27:55.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.608+0000 7f23cda00640 1 --2- 172.21.15.106:0/102237477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23c8140580 0x7f23c815cce0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009fc0 tx=0x7f23c00099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:55.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.609+0000 7f23c4c00640 1 -- 172.21.15.106:0/102237477 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c000de80 con 0x7f23c8140580 2024-08-17T02:27:55.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.609+0000 7f23c4c00640 1 -- 172.21.15.106:0/102237477 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c000f040 con 0x7f23c8140580 2024-08-17T02:27:55.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.609+0000 7f23c4c00640 1 -- 172.21.15.106:0/102237477 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c0015690 con 0x7f23c8140580 2024-08-17T02:27:55.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.609+0000 7f23cfa00640 1 -- 172.21.15.106:0/102237477 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c815b6a0 con 0x7f23c8140580 2024-08-17T02:27:55.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.609+0000 7f23cfa00640 1 -- 172.21.15.106:0/102237477 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c815d220 con 0x7f23c8140580 2024-08-17T02:27:55.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.610+0000 7f23cfa00640 1 -- 172.21.15.106:0/102237477 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c815b220 con 0x7f23c8140580 2024-08-17T02:27:55.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.611+0000 7f23c4c00640 1 -- 172.21.15.106:0/102237477 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f23c001e3b0 con 0x7f23c8140580 2024-08-17T02:27:55.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.611+0000 7f23c4c00640 1 --2- 172.21.15.106:0/102237477 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f23a4065150 0x7f23a4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:55.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.612+0000 7f23c4c00640 1 -- 172.21.15.106:0/102237477 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f23c0082a20 con 0x7f23c8140580 2024-08-17T02:27:55.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.612+0000 7f23cd000640 1 --2- 172.21.15.106:0/102237477 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f23a4065150 0x7f23a4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:55.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.612+0000 7f23cd000640 1 --2- 172.21.15.106:0/102237477 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f23a4065150 0x7f23a4067600 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f23b8009cb0 tx=0x7f23b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:55.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.615+0000 7f23c4c00640 1 -- 172.21.15.106:0/102237477 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f23c815b220 con 0x7f23c8140580 2024-08-17T02:27:55.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.786+0000 7f23cfa00640 1 -- 172.21.15.106:0/102237477 --> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f23c815b220 con 0x7f23a4065150 2024-08-17T02:27:55.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.793+0000 7f23c4c00640 1 -- 172.21.15.106:0/102237477 <== mgr.4107 v2:172.21.15.106:6832/36860 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264709 (secure 0 0 0) 0x7f23c815b220 con 0x7f23a4065150 2024-08-17T02:27:55.796 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:27:55.798 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-08-17T02:27:55.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.797+0000 7f23cfa00640 1 -- 172.21.15.106:0/102237477 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f23a4065150 msgr2=0x7f23a4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.797+0000 7f23cfa00640 1 --2- 172.21.15.106:0/102237477 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f23a4065150 0x7f23a4067600 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f23b8009cb0 tx=0x7f23b8008040 comp rx=0 tx=0).stop 2024-08-17T02:27:55.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.797+0000 7f23cfa00640 1 -- 172.21.15.106:0/102237477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23c8140580 msgr2=0x7f23c815cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:55.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.797+0000 7f23cfa00640 1 --2- 172.21.15.106:0/102237477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23c8140580 0x7f23c815cce0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009fc0 tx=0x7f23c00099b0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.797+0000 7f23cfa00640 1 -- 172.21.15.106:0/102237477 shutdown_connections 2024-08-17T02:27:55.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.797+0000 7f23cfa00640 1 --2- 172.21.15.106:0/102237477 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f23a4065150 0x7f23a4067600 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.797+0000 7f23cfa00640 1 --2- 172.21.15.106:0/102237477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23c8140580 0x7f23c815cce0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.797+0000 7f23cfa00640 1 --2- 172.21.15.106:0/102237477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23c81401b0 0x7f23c80abd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.797+0000 7f23cfa00640 1 --2- 172.21.15.106:0/102237477 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23c80b1270 0x7f23c815bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:55.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.797+0000 7f23cfa00640 1 -- 172.21.15.106:0/102237477 >> 172.21.15.106:0/102237477 conn(0x7f23c80cb9b0 msgr2=0x7f23c806dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:55.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.797+0000 7f23cfa00640 1 -- 172.21.15.106:0/102237477 shutdown_connections 2024-08-17T02:27:55.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:55.797+0000 7f23cfa00640 1 -- 172.21.15.106:0/102237477 wait complete. 2024-08-17T02:27:55.814 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-08-17T02:27:53.876060+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381600,"kb_used_data":2728,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752593120,"statfs":{"total":773094113280,"available":770655354880,"internally_reserved":0,"allocated":2793472,"data_stored":1700340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.609397"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.307275+0000","last_change":"2024-08-17T02:27:51.307275+0000","last_active":"2024-08-17T02:27:51.307275+0000","last_peered":"2024-08-17T02:27:51.307275+0000","last_clean":"2024-08-17T02:27:51.307275+0000","last_became_active":"2024-08-17T02:27:51.306981+0000","last_became_peered":"2024-08-17T02:27:51.306981+0000","last_unstale":"2024-08-17T02:27:51.307275+0000","last_undegraded":"2024-08-17T02:27:51.307275+0000","last_fullsized":"2024-08-17T02:27:51.307275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:34:53.506566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.293426+0000","last_change":"2024-08-17T02:27:51.289931+0000","last_active":"2024-08-17T02:27:51.293426+0000","last_peered":"2024-08-17T02:27:51.293426+0000","last_clean":"2024-08-17T02:27:51.293426+0000","last_became_active":"2024-08-17T02:27:51.289692+0000","last_became_peered":"2024-08-17T02:27:51.289692+0000","last_unstale":"2024-08-17T02:27:51.293426+0000","last_undegraded":"2024-08-17T02:27:51.293426+0000","last_fullsized":"2024-08-17T02:27:51.293426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:04:36.940627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.293123+0000","last_change":"2024-08-17T02:27:51.293123+0000","last_active":"2024-08-17T02:27:51.293123+0000","last_peered":"2024-08-17T02:27:51.293123+0000","last_clean":"2024-08-17T02:27:51.293123+0000","last_became_active":"2024-08-17T02:27:51.290362+0000","last_became_peered":"2024-08-17T02:27:51.290362+0000","last_unstale":"2024-08-17T02:27:51.293123+0000","last_undegraded":"2024-08-17T02:27:51.293123+0000","last_fullsized":"2024-08-17T02:27:51.293123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:31.950047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315815+0000","last_change":"2024-08-17T02:27:51.310784+0000","last_active":"2024-08-17T02:27:51.315815+0000","last_peered":"2024-08-17T02:27:51.315815+0000","last_clean":"2024-08-17T02:27:51.315815+0000","last_became_active":"2024-08-17T02:27:51.310504+0000","last_became_peered":"2024-08-17T02:27:51.310504+0000","last_unstale":"2024-08-17T02:27:51.315815+0000","last_undegraded":"2024-08-17T02:27:51.315815+0000","last_fullsized":"2024-08-17T02:27:51.315815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:34:53.506566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.300548+0000","last_change":"2024-08-17T02:27:51.300548+0000","last_active":"2024-08-17T02:27:51.300548+0000","last_peered":"2024-08-17T02:27:51.300548+0000","last_clean":"2024-08-17T02:27:51.300548+0000","last_became_active":"2024-08-17T02:27:51.298611+0000","last_became_peered":"2024-08-17T02:27:51.298611+0000","last_unstale":"2024-08-17T02:27:51.300548+0000","last_undegraded":"2024-08-17T02:27:51.300548+0000","last_fullsized":"2024-08-17T02:27:51.300548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:12:12.800070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315424+0000","last_change":"2024-08-17T02:27:51.309274+0000","last_active":"2024-08-17T02:27:51.315424+0000","last_peered":"2024-08-17T02:27:51.315424+0000","last_clean":"2024-08-17T02:27:51.315424+0000","last_became_active":"2024-08-17T02:27:51.309017+0000","last_became_peered":"2024-08-17T02:27:51.309017+0000","last_unstale":"2024-08-17T02:27:51.315424+0000","last_undegraded":"2024-08-17T02:27:51.315424+0000","last_fullsized":"2024-08-17T02:27:51.315424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:08.545557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309089+0000","last_change":"2024-08-17T02:27:51.309089+0000","last_active":"2024-08-17T02:27:51.309089+0000","last_peered":"2024-08-17T02:27:51.309089+0000","last_clean":"2024-08-17T02:27:51.309089+0000","last_became_active":"2024-08-17T02:27:51.308817+0000","last_became_peered":"2024-08-17T02:27:51.308817+0000","last_unstale":"2024-08-17T02:27:51.309089+0000","last_undegraded":"2024-08-17T02:27:51.309089+0000","last_fullsized":"2024-08-17T02:27:51.309089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:22:54.682219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.301226+0000","last_change":"2024-08-17T02:27:51.301226+0000","last_active":"2024-08-17T02:27:51.301226+0000","last_peered":"2024-08-17T02:27:51.301226+0000","last_clean":"2024-08-17T02:27:51.301226+0000","last_became_active":"2024-08-17T02:27:51.300976+0000","last_became_peered":"2024-08-17T02:27:51.300976+0000","last_unstale":"2024-08-17T02:27:51.301226+0000","last_undegraded":"2024-08-17T02:27:51.301226+0000","last_fullsized":"2024-08-17T02:27:51.301226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:51:59.475864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.320367+0000","last_change":"2024-08-17T02:27:51.320367+0000","last_active":"2024-08-17T02:27:51.320367+0000","last_peered":"2024-08-17T02:27:51.320367+0000","last_clean":"2024-08-17T02:27:51.320367+0000","last_became_active":"2024-08-17T02:27:51.320044+0000","last_became_peered":"2024-08-17T02:27:51.320044+0000","last_unstale":"2024-08-17T02:27:51.320367+0000","last_undegraded":"2024-08-17T02:27:51.320367+0000","last_fullsized":"2024-08-17T02:27:51.320367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:03:57.699175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.311082+0000","last_change":"2024-08-17T02:27:51.311082+0000","last_active":"2024-08-17T02:27:51.311082+0000","last_peered":"2024-08-17T02:27:51.311082+0000","last_clean":"2024-08-17T02:27:51.311082+0000","last_became_active":"2024-08-17T02:27:51.309886+0000","last_became_peered":"2024-08-17T02:27:51.309886+0000","last_unstale":"2024-08-17T02:27:51.311082+0000","last_undegraded":"2024-08-17T02:27:51.311082+0000","last_fullsized":"2024-08-17T02:27:51.311082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:07.004040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309574+0000","last_change":"2024-08-17T02:27:51.309574+0000","last_active":"2024-08-17T02:27:51.309574+0000","last_peered":"2024-08-17T02:27:51.309574+0000","last_clean":"2024-08-17T02:27:51.309574+0000","last_became_active":"2024-08-17T02:27:51.309291+0000","last_became_peered":"2024-08-17T02:27:51.309291+0000","last_unstale":"2024-08-17T02:27:51.309574+0000","last_undegraded":"2024-08-17T02:27:51.309574+0000","last_fullsized":"2024-08-17T02:27:51.309574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:26.379433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.305009+0000","last_change":"2024-08-17T02:27:51.305009+0000","last_active":"2024-08-17T02:27:51.305009+0000","last_peered":"2024-08-17T02:27:51.305009+0000","last_clean":"2024-08-17T02:27:51.305009+0000","last_became_active":"2024-08-17T02:27:51.303089+0000","last_became_peered":"2024-08-17T02:27:51.303089+0000","last_unstale":"2024-08-17T02:27:51.305009+0000","last_undegraded":"2024-08-17T02:27:51.305009+0000","last_fullsized":"2024-08-17T02:27:51.305009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:52:35.132297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.299987+0000","last_change":"2024-08-17T02:27:51.299987+0000","last_active":"2024-08-17T02:27:51.299987+0000","last_peered":"2024-08-17T02:27:51.299987+0000","last_clean":"2024-08-17T02:27:51.299987+0000","last_became_active":"2024-08-17T02:27:51.299700+0000","last_became_peered":"2024-08-17T02:27:51.299700+0000","last_unstale":"2024-08-17T02:27:51.299987+0000","last_undegraded":"2024-08-17T02:27:51.299987+0000","last_fullsized":"2024-08-17T02:27:51.299987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:23.747098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.287246+0000","last_change":"2024-08-17T02:27:51.287246+0000","last_active":"2024-08-17T02:27:51.287246+0000","last_peered":"2024-08-17T02:27:51.287246+0000","last_clean":"2024-08-17T02:27:51.287246+0000","last_became_active":"2024-08-17T02:27:51.287011+0000","last_became_peered":"2024-08-17T02:27:51.287011+0000","last_unstale":"2024-08-17T02:27:51.287246+0000","last_undegraded":"2024-08-17T02:27:51.287246+0000","last_fullsized":"2024-08-17T02:27:51.287246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:00.021420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.311602+0000","last_change":"2024-08-17T02:27:51.306642+0000","last_active":"2024-08-17T02:27:51.311602+0000","last_peered":"2024-08-17T02:27:51.311602+0000","last_clean":"2024-08-17T02:27:51.311602+0000","last_became_active":"2024-08-17T02:27:51.306324+0000","last_became_peered":"2024-08-17T02:27:51.306324+0000","last_unstale":"2024-08-17T02:27:51.311602+0000","last_undegraded":"2024-08-17T02:27:51.311602+0000","last_fullsized":"2024-08-17T02:27:51.311602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:45:24.383393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.311314+0000","last_change":"2024-08-17T02:27:51.307812+0000","last_active":"2024-08-17T02:27:51.311314+0000","last_peered":"2024-08-17T02:27:51.311314+0000","last_clean":"2024-08-17T02:27:51.311314+0000","last_became_active":"2024-08-17T02:27:51.307000+0000","last_became_peered":"2024-08-17T02:27:51.307000+0000","last_unstale":"2024-08-17T02:27:51.311314+0000","last_undegraded":"2024-08-17T02:27:51.311314+0000","last_fullsized":"2024-08-17T02:27:51.311314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:23.747098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315476+0000","last_change":"2024-08-17T02:27:51.313130+0000","last_active":"2024-08-17T02:27:51.315476+0000","last_peered":"2024-08-17T02:27:51.315476+0000","last_clean":"2024-08-17T02:27:51.315476+0000","last_became_active":"2024-08-17T02:27:51.312875+0000","last_became_peered":"2024-08-17T02:27:51.312875+0000","last_unstale":"2024-08-17T02:27:51.315476+0000","last_undegraded":"2024-08-17T02:27:51.315476+0000","last_fullsized":"2024-08-17T02:27:51.315476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:01.072889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309623+0000","last_change":"2024-08-17T02:27:51.302749+0000","last_active":"2024-08-17T02:27:51.309623+0000","last_peered":"2024-08-17T02:27:51.309623+0000","last_clean":"2024-08-17T02:27:51.309623+0000","last_became_active":"2024-08-17T02:27:51.302531+0000","last_became_peered":"2024-08-17T02:27:51.302531+0000","last_unstale":"2024-08-17T02:27:51.309623+0000","last_undegraded":"2024-08-17T02:27:51.309623+0000","last_fullsized":"2024-08-17T02:27:51.309623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:52:35.132297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.304533+0000","last_change":"2024-08-17T02:27:51.304533+0000","last_active":"2024-08-17T02:27:51.304533+0000","last_peered":"2024-08-17T02:27:51.304533+0000","last_clean":"2024-08-17T02:27:51.304533+0000","last_became_active":"2024-08-17T02:27:51.304274+0000","last_became_peered":"2024-08-17T02:27:51.304274+0000","last_unstale":"2024-08-17T02:27:51.304533+0000","last_undegraded":"2024-08-17T02:27:51.304533+0000","last_fullsized":"2024-08-17T02:27:51.304533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:23.159482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.307321+0000","last_change":"2024-08-17T02:27:51.307321+0000","last_active":"2024-08-17T02:27:51.307321+0000","last_peered":"2024-08-17T02:27:51.307321+0000","last_clean":"2024-08-17T02:27:51.307321+0000","last_became_active":"2024-08-17T02:27:51.306795+0000","last_became_peered":"2024-08-17T02:27:51.306795+0000","last_unstale":"2024-08-17T02:27:51.307321+0000","last_undegraded":"2024-08-17T02:27:51.307321+0000","last_fullsized":"2024-08-17T02:27:51.307321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:04:36.940627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.293229+0000","last_change":"2024-08-17T02:27:51.293229+0000","last_active":"2024-08-17T02:27:51.293229+0000","last_peered":"2024-08-17T02:27:51.293229+0000","last_clean":"2024-08-17T02:27:51.293229+0000","last_became_active":"2024-08-17T02:27:51.292455+0000","last_became_peered":"2024-08-17T02:27:51.292455+0000","last_unstale":"2024-08-17T02:27:51.293229+0000","last_undegraded":"2024-08-17T02:27:51.293229+0000","last_fullsized":"2024-08-17T02:27:51.293229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:04:36.940627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.310379+0000","last_change":"2024-08-17T02:27:51.302786+0000","last_active":"2024-08-17T02:27:51.310379+0000","last_peered":"2024-08-17T02:27:51.310379+0000","last_clean":"2024-08-17T02:27:51.310379+0000","last_became_active":"2024-08-17T02:27:51.302520+0000","last_became_peered":"2024-08-17T02:27:51.302520+0000","last_unstale":"2024-08-17T02:27:51.310379+0000","last_undegraded":"2024-08-17T02:27:51.310379+0000","last_fullsized":"2024-08-17T02:27:51.310379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:22:54.682219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.297406+0000","last_change":"2024-08-17T02:27:51.297406+0000","last_active":"2024-08-17T02:27:51.297406+0000","last_peered":"2024-08-17T02:27:51.297406+0000","last_clean":"2024-08-17T02:27:51.297406+0000","last_became_active":"2024-08-17T02:27:51.291804+0000","last_became_peered":"2024-08-17T02:27:51.291804+0000","last_unstale":"2024-08-17T02:27:51.297406+0000","last_undegraded":"2024-08-17T02:27:51.297406+0000","last_fullsized":"2024-08-17T02:27:51.297406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:22:54.682219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315495+0000","last_change":"2024-08-17T02:27:51.312012+0000","last_active":"2024-08-17T02:27:51.315495+0000","last_peered":"2024-08-17T02:27:51.315495+0000","last_clean":"2024-08-17T02:27:51.315495+0000","last_became_active":"2024-08-17T02:27:51.311735+0000","last_became_peered":"2024-08-17T02:27:51.311735+0000","last_unstale":"2024-08-17T02:27:51.315495+0000","last_undegraded":"2024-08-17T02:27:51.315495+0000","last_fullsized":"2024-08-17T02:27:51.315495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:47:22.647519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.294844+0000","last_change":"2024-08-17T02:27:51.294844+0000","last_active":"2024-08-17T02:27:51.294844+0000","last_peered":"2024-08-17T02:27:51.294844+0000","last_clean":"2024-08-17T02:27:51.294844+0000","last_became_active":"2024-08-17T02:27:51.294546+0000","last_became_peered":"2024-08-17T02:27:51.294546+0000","last_unstale":"2024-08-17T02:27:51.294844+0000","last_undegraded":"2024-08-17T02:27:51.294844+0000","last_fullsized":"2024-08-17T02:27:51.294844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:17:09.418523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.301918+0000","last_change":"2024-08-17T02:27:51.301918+0000","last_active":"2024-08-17T02:27:51.301918+0000","last_peered":"2024-08-17T02:27:51.301918+0000","last_clean":"2024-08-17T02:27:51.301918+0000","last_became_active":"2024-08-17T02:27:51.301672+0000","last_became_peered":"2024-08-17T02:27:51.301672+0000","last_unstale":"2024-08-17T02:27:51.301918+0000","last_undegraded":"2024-08-17T02:27:51.301918+0000","last_fullsized":"2024-08-17T02:27:51.301918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:23.159482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309265+0000","last_change":"2024-08-17T02:27:51.305095+0000","last_active":"2024-08-17T02:27:51.309265+0000","last_peered":"2024-08-17T02:27:51.309265+0000","last_clean":"2024-08-17T02:27:51.309265+0000","last_became_active":"2024-08-17T02:27:51.304895+0000","last_became_peered":"2024-08-17T02:27:51.304895+0000","last_unstale":"2024-08-17T02:27:51.309265+0000","last_undegraded":"2024-08-17T02:27:51.309265+0000","last_fullsized":"2024-08-17T02:27:51.309265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:07.004040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.307625+0000","last_change":"2024-08-17T02:27:51.307625+0000","last_active":"2024-08-17T02:27:51.307625+0000","last_peered":"2024-08-17T02:27:51.307625+0000","last_clean":"2024-08-17T02:27:51.307625+0000","last_became_active":"2024-08-17T02:27:51.307052+0000","last_became_peered":"2024-08-17T02:27:51.307052+0000","last_unstale":"2024-08-17T02:27:51.307625+0000","last_undegraded":"2024-08-17T02:27:51.307625+0000","last_fullsized":"2024-08-17T02:27:51.307625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:08.545557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.305503+0000","last_change":"2024-08-17T02:27:51.305503+0000","last_active":"2024-08-17T02:27:51.305503+0000","last_peered":"2024-08-17T02:27:51.305503+0000","last_clean":"2024-08-17T02:27:51.305503+0000","last_became_active":"2024-08-17T02:27:51.302095+0000","last_became_peered":"2024-08-17T02:27:51.302095+0000","last_unstale":"2024-08-17T02:27:51.305503+0000","last_undegraded":"2024-08-17T02:27:51.305503+0000","last_fullsized":"2024-08-17T02:27:51.305503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:23.747098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315454+0000","last_change":"2024-08-17T02:27:51.309505+0000","last_active":"2024-08-17T02:27:51.315454+0000","last_peered":"2024-08-17T02:27:51.315454+0000","last_clean":"2024-08-17T02:27:51.315454+0000","last_became_active":"2024-08-17T02:27:51.309223+0000","last_became_peered":"2024-08-17T02:27:51.309223+0000","last_unstale":"2024-08-17T02:27:51.315454+0000","last_undegraded":"2024-08-17T02:27:51.315454+0000","last_fullsized":"2024-08-17T02:27:51.315454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:40.951641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309177+0000","last_change":"2024-08-17T02:27:51.302769+0000","last_active":"2024-08-17T02:27:51.309177+0000","last_peered":"2024-08-17T02:27:51.309177+0000","last_clean":"2024-08-17T02:27:51.309177+0000","last_became_active":"2024-08-17T02:27:51.300628+0000","last_became_peered":"2024-08-17T02:27:51.300628+0000","last_unstale":"2024-08-17T02:27:51.309177+0000","last_undegraded":"2024-08-17T02:27:51.309177+0000","last_fullsized":"2024-08-17T02:27:51.309177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:36:40.089843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.298088+0000","last_change":"2024-08-17T02:27:51.298088+0000","last_active":"2024-08-17T02:27:51.298088+0000","last_peered":"2024-08-17T02:27:51.298088+0000","last_clean":"2024-08-17T02:27:51.298088+0000","last_became_active":"2024-08-17T02:27:51.297755+0000","last_became_peered":"2024-08-17T02:27:51.297755+0000","last_unstale":"2024-08-17T02:27:51.298088+0000","last_undegraded":"2024-08-17T02:27:51.298088+0000","last_fullsized":"2024-08-17T02:27:51.298088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:52.916950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.287126+0000","last_change":"2024-08-17T02:27:51.287126+0000","last_active":"2024-08-17T02:27:51.287126+0000","last_peered":"2024-08-17T02:27:51.287126+0000","last_clean":"2024-08-17T02:27:51.287126+0000","last_became_active":"2024-08-17T02:27:51.286839+0000","last_became_peered":"2024-08-17T02:27:51.286839+0000","last_unstale":"2024-08-17T02:27:51.287126+0000","last_undegraded":"2024-08-17T02:27:51.287126+0000","last_fullsized":"2024-08-17T02:27:51.287126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:44.884519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.289382+0000","last_change":"2024-08-17T02:27:50.294440+0000","last_active":"2024-08-17T02:27:51.289382+0000","last_peered":"2024-08-17T02:27:51.289382+0000","last_clean":"2024-08-17T02:27:51.289382+0000","last_became_active":"2024-08-17T02:27:50.294141+0000","last_became_peered":"2024-08-17T02:27:50.294141+0000","last_unstale":"2024-08-17T02:27:51.289382+0000","last_undegraded":"2024-08-17T02:27:51.289382+0000","last_fullsized":"2024-08-17T02:27:51.289382+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:30.074784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.295343+0000","last_change":"2024-08-17T02:27:51.295343+0000","last_active":"2024-08-17T02:27:51.295343+0000","last_peered":"2024-08-17T02:27:51.295343+0000","last_clean":"2024-08-17T02:27:51.295343+0000","last_became_active":"2024-08-17T02:27:51.293004+0000","last_became_peered":"2024-08-17T02:27:51.293004+0000","last_unstale":"2024-08-17T02:27:51.295343+0000","last_undegraded":"2024-08-17T02:27:51.295343+0000","last_fullsized":"2024-08-17T02:27:51.295343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:26.379433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.287543+0000","last_change":"2024-08-17T02:27:50.305041+0000","last_active":"2024-08-17T02:27:51.287543+0000","last_peered":"2024-08-17T02:27:51.287543+0000","last_clean":"2024-08-17T02:27:51.287543+0000","last_became_active":"2024-08-17T02:27:50.304359+0000","last_became_peered":"2024-08-17T02:27:50.304359+0000","last_unstale":"2024-08-17T02:27:51.287543+0000","last_undegraded":"2024-08-17T02:27:51.287543+0000","last_fullsized":"2024-08-17T02:27:51.287543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:23.849240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:27:50.306816+0000","last_change":"2024-08-17T02:27:50.304515+0000","last_active":"2024-08-17T02:27:50.306816+0000","last_peered":"2024-08-17T02:27:50.306816+0000","last_clean":"2024-08-17T02:27:50.306816+0000","last_became_active":"2024-08-17T02:27:50.304276+0000","last_became_peered":"2024-08-17T02:27:50.304276+0000","last_unstale":"2024-08-17T02:27:50.306816+0000","last_undegraded":"2024-08-17T02:27:50.306816+0000","last_fullsized":"2024-08-17T02:27:50.306816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:43.423994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.307787+0000","last_change":"2024-08-17T02:27:51.307787+0000","last_active":"2024-08-17T02:27:51.307787+0000","last_peered":"2024-08-17T02:27:51.307787+0000","last_clean":"2024-08-17T02:27:51.307787+0000","last_became_active":"2024-08-17T02:27:51.307539+0000","last_became_peered":"2024-08-17T02:27:51.307539+0000","last_unstale":"2024-08-17T02:27:51.307787+0000","last_undegraded":"2024-08-17T02:27:51.307787+0000","last_fullsized":"2024-08-17T02:27:51.307787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:52.916950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.295176+0000","last_change":"2024-08-17T02:27:50.285283+0000","last_active":"2024-08-17T02:27:51.295176+0000","last_peered":"2024-08-17T02:27:51.295176+0000","last_clean":"2024-08-17T02:27:51.295176+0000","last_became_active":"2024-08-17T02:27:50.284974+0000","last_became_peered":"2024-08-17T02:27:50.284974+0000","last_unstale":"2024-08-17T02:27:51.295176+0000","last_undegraded":"2024-08-17T02:27:51.295176+0000","last_fullsized":"2024-08-17T02:27:51.295176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:43.878005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309325+0000","last_change":"2024-08-17T02:27:51.306133+0000","last_active":"2024-08-17T02:27:51.309325+0000","last_peered":"2024-08-17T02:27:51.309325+0000","last_clean":"2024-08-17T02:27:51.309325+0000","last_became_active":"2024-08-17T02:27:51.305784+0000","last_became_peered":"2024-08-17T02:27:51.305784+0000","last_unstale":"2024-08-17T02:27:51.309325+0000","last_undegraded":"2024-08-17T02:27:51.309325+0000","last_fullsized":"2024-08-17T02:27:51.309325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:23.747098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:27:50.307546+0000","last_change":"2024-08-17T02:27:50.302699+0000","last_active":"2024-08-17T02:27:50.307546+0000","last_peered":"2024-08-17T02:27:50.307546+0000","last_clean":"2024-08-17T02:27:50.307546+0000","last_became_active":"2024-08-17T02:27:50.302324+0000","last_became_peered":"2024-08-17T02:27:50.302324+0000","last_unstale":"2024-08-17T02:27:50.307546+0000","last_undegraded":"2024-08-17T02:27:50.307546+0000","last_fullsized":"2024-08-17T02:27:50.307546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:43.878005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.319524+0000","last_change":"2024-08-17T02:27:51.317627+0000","last_active":"2024-08-17T02:27:51.319524+0000","last_peered":"2024-08-17T02:27:51.319524+0000","last_clean":"2024-08-17T02:27:51.319524+0000","last_became_active":"2024-08-17T02:27:51.317363+0000","last_became_peered":"2024-08-17T02:27:51.317363+0000","last_unstale":"2024-08-17T02:27:51.319524+0000","last_undegraded":"2024-08-17T02:27:51.319524+0000","last_fullsized":"2024-08-17T02:27:51.319524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:12:12.800070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.296163+0000","last_change":"2024-08-17T02:27:50.304899+0000","last_active":"2024-08-17T02:27:51.296163+0000","last_peered":"2024-08-17T02:27:51.296163+0000","last_clean":"2024-08-17T02:27:51.296163+0000","last_became_active":"2024-08-17T02:27:50.303335+0000","last_became_peered":"2024-08-17T02:27:50.303335+0000","last_unstale":"2024-08-17T02:27:51.296163+0000","last_undegraded":"2024-08-17T02:27:51.296163+0000","last_fullsized":"2024-08-17T02:27:51.296163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:23.849240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.311088+0000","last_change":"2024-08-17T02:27:51.311088+0000","last_active":"2024-08-17T02:27:51.311088+0000","last_peered":"2024-08-17T02:27:51.311088+0000","last_clean":"2024-08-17T02:27:51.311088+0000","last_became_active":"2024-08-17T02:27:51.310514+0000","last_became_peered":"2024-08-17T02:27:51.310514+0000","last_unstale":"2024-08-17T02:27:51.311088+0000","last_undegraded":"2024-08-17T02:27:51.311088+0000","last_fullsized":"2024-08-17T02:27:51.311088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:45:24.383393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.318886+0000","last_change":"2024-08-17T02:27:50.295951+0000","last_active":"2024-08-17T02:27:51.318886+0000","last_peered":"2024-08-17T02:27:51.318886+0000","last_clean":"2024-08-17T02:27:51.318886+0000","last_became_active":"2024-08-17T02:27:50.295351+0000","last_became_peered":"2024-08-17T02:27:50.295351+0000","last_unstale":"2024-08-17T02:27:51.318886+0000","last_undegraded":"2024-08-17T02:27:51.318886+0000","last_fullsized":"2024-08-17T02:27:51.318886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:57.534676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.303007+0000","last_change":"2024-08-17T02:27:51.303007+0000","last_active":"2024-08-17T02:27:51.303007+0000","last_peered":"2024-08-17T02:27:51.303007+0000","last_clean":"2024-08-17T02:27:51.303007+0000","last_became_active":"2024-08-17T02:27:51.300357+0000","last_became_peered":"2024-08-17T02:27:51.300357+0000","last_unstale":"2024-08-17T02:27:51.303007+0000","last_undegraded":"2024-08-17T02:27:51.303007+0000","last_fullsized":"2024-08-17T02:27:51.303007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:36:40.089843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315398+0000","last_change":"2024-08-17T02:27:50.304133+0000","last_active":"2024-08-17T02:27:51.315398+0000","last_peered":"2024-08-17T02:27:51.315398+0000","last_clean":"2024-08-17T02:27:51.315398+0000","last_became_active":"2024-08-17T02:27:50.302755+0000","last_became_peered":"2024-08-17T02:27:50.302755+0000","last_unstale":"2024-08-17T02:27:51.315398+0000","last_undegraded":"2024-08-17T02:27:51.315398+0000","last_fullsized":"2024-08-17T02:27:51.315398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:02:06.007638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.310016+0000","last_change":"2024-08-17T02:27:51.310016+0000","last_active":"2024-08-17T02:27:51.310016+0000","last_peered":"2024-08-17T02:27:51.310016+0000","last_clean":"2024-08-17T02:27:51.310016+0000","last_became_active":"2024-08-17T02:27:51.309632+0000","last_became_peered":"2024-08-17T02:27:51.309632+0000","last_unstale":"2024-08-17T02:27:51.310016+0000","last_undegraded":"2024-08-17T02:27:51.310016+0000","last_fullsized":"2024-08-17T02:27:51.310016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:40.951641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.316088+0000","last_change":"2024-08-17T02:27:50.300858+0000","last_active":"2024-08-17T02:27:51.316088+0000","last_peered":"2024-08-17T02:27:51.316088+0000","last_clean":"2024-08-17T02:27:51.316088+0000","last_became_active":"2024-08-17T02:27:50.300575+0000","last_became_peered":"2024-08-17T02:27:50.300575+0000","last_unstale":"2024-08-17T02:27:51.316088+0000","last_undegraded":"2024-08-17T02:27:51.316088+0000","last_fullsized":"2024-08-17T02:27:51.316088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:30.074784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.295142+0000","last_change":"2024-08-17T02:27:51.295142+0000","last_active":"2024-08-17T02:27:51.295142+0000","last_peered":"2024-08-17T02:27:51.295142+0000","last_clean":"2024-08-17T02:27:51.295142+0000","last_became_active":"2024-08-17T02:27:51.294912+0000","last_became_peered":"2024-08-17T02:27:51.294912+0000","last_unstale":"2024-08-17T02:27:51.295142+0000","last_undegraded":"2024-08-17T02:27:51.295142+0000","last_fullsized":"2024-08-17T02:27:51.295142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:23.159482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.293032+0000","last_change":"2024-08-17T02:27:50.298640+0000","last_active":"2024-08-17T02:27:51.293032+0000","last_peered":"2024-08-17T02:27:51.293032+0000","last_clean":"2024-08-17T02:27:51.293032+0000","last_became_active":"2024-08-17T02:27:50.298355+0000","last_became_peered":"2024-08-17T02:27:50.298355+0000","last_unstale":"2024-08-17T02:27:51.293032+0000","last_undegraded":"2024-08-17T02:27:51.293032+0000","last_fullsized":"2024-08-17T02:27:51.293032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:43:01.783598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.318860+0000","last_change":"2024-08-17T02:27:51.318860+0000","last_active":"2024-08-17T02:27:51.318860+0000","last_peered":"2024-08-17T02:27:51.318860+0000","last_clean":"2024-08-17T02:27:51.318860+0000","last_became_active":"2024-08-17T02:27:51.317220+0000","last_became_peered":"2024-08-17T02:27:51.317220+0000","last_unstale":"2024-08-17T02:27:51.318860+0000","last_undegraded":"2024-08-17T02:27:51.318860+0000","last_fullsized":"2024-08-17T02:27:51.318860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:47:22.647519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:27:50.307550+0000","last_change":"2024-08-17T02:27:50.304030+0000","last_active":"2024-08-17T02:27:50.307550+0000","last_peered":"2024-08-17T02:27:50.307550+0000","last_clean":"2024-08-17T02:27:50.307550+0000","last_became_active":"2024-08-17T02:27:50.303575+0000","last_became_peered":"2024-08-17T02:27:50.303575+0000","last_unstale":"2024-08-17T02:27:50.307550+0000","last_undegraded":"2024-08-17T02:27:50.307550+0000","last_fullsized":"2024-08-17T02:27:50.307550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:01.529714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.297859+0000","last_change":"2024-08-17T02:27:51.297859+0000","last_active":"2024-08-17T02:27:51.297859+0000","last_peered":"2024-08-17T02:27:51.297859+0000","last_clean":"2024-08-17T02:27:51.297859+0000","last_became_active":"2024-08-17T02:27:51.297542+0000","last_became_peered":"2024-08-17T02:27:51.297542+0000","last_unstale":"2024-08-17T02:27:51.297859+0000","last_undegraded":"2024-08-17T02:27:51.297859+0000","last_fullsized":"2024-08-17T02:27:51.297859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:17:09.418523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.307003+0000","last_change":"2024-08-17T02:27:50.289491+0000","last_active":"2024-08-17T02:27:51.307003+0000","last_peered":"2024-08-17T02:27:51.307003+0000","last_clean":"2024-08-17T02:27:51.307003+0000","last_became_active":"2024-08-17T02:27:50.287407+0000","last_became_peered":"2024-08-17T02:27:50.287407+0000","last_unstale":"2024-08-17T02:27:51.307003+0000","last_undegraded":"2024-08-17T02:27:51.307003+0000","last_fullsized":"2024-08-17T02:27:51.307003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:02:06.007638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.311648+0000","last_change":"2024-08-17T02:27:51.311648+0000","last_active":"2024-08-17T02:27:51.311648+0000","last_peered":"2024-08-17T02:27:51.311648+0000","last_clean":"2024-08-17T02:27:51.311648+0000","last_became_active":"2024-08-17T02:27:51.311419+0000","last_became_peered":"2024-08-17T02:27:51.311419+0000","last_unstale":"2024-08-17T02:27:51.311648+0000","last_undegraded":"2024-08-17T02:27:51.311648+0000","last_fullsized":"2024-08-17T02:27:51.311648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:56:03.462179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.281711+0000","last_change":"2024-08-17T02:27:50.290855+0000","last_active":"2024-08-17T02:27:51.281711+0000","last_peered":"2024-08-17T02:27:51.281711+0000","last_clean":"2024-08-17T02:27:51.281711+0000","last_became_active":"2024-08-17T02:27:50.289943+0000","last_became_peered":"2024-08-17T02:27:50.289943+0000","last_unstale":"2024-08-17T02:27:51.281711+0000","last_undegraded":"2024-08-17T02:27:51.281711+0000","last_fullsized":"2024-08-17T02:27:51.281711+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:52:17.225404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.311333+0000","last_change":"2024-08-17T02:27:51.311333+0000","last_active":"2024-08-17T02:27:51.311333+0000","last_peered":"2024-08-17T02:27:51.311333+0000","last_clean":"2024-08-17T02:27:51.311333+0000","last_became_active":"2024-08-17T02:27:51.311078+0000","last_became_peered":"2024-08-17T02:27:51.311078+0000","last_unstale":"2024-08-17T02:27:51.311333+0000","last_undegraded":"2024-08-17T02:27:51.311333+0000","last_fullsized":"2024-08-17T02:27:51.311333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:01.072889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309026+0000","last_change":"2024-08-17T02:27:50.301645+0000","last_active":"2024-08-17T02:27:51.309026+0000","last_peered":"2024-08-17T02:27:51.309026+0000","last_clean":"2024-08-17T02:27:51.309026+0000","last_became_active":"2024-08-17T02:27:50.301348+0000","last_became_peered":"2024-08-17T02:27:50.301348+0000","last_unstale":"2024-08-17T02:27:51.309026+0000","last_undegraded":"2024-08-17T02:27:51.309026+0000","last_fullsized":"2024-08-17T02:27:51.309026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:43.423994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315762+0000","last_change":"2024-08-17T02:27:51.315762+0000","last_active":"2024-08-17T02:27:51.315762+0000","last_peered":"2024-08-17T02:27:51.315762+0000","last_clean":"2024-08-17T02:27:51.315762+0000","last_became_active":"2024-08-17T02:27:51.315472+0000","last_became_peered":"2024-08-17T02:27:51.315472+0000","last_unstale":"2024-08-17T02:27:51.315762+0000","last_undegraded":"2024-08-17T02:27:51.315762+0000","last_fullsized":"2024-08-17T02:27:51.315762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:59:59.342696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.308888+0000","last_change":"2024-08-17T02:27:50.296190+0000","last_active":"2024-08-17T02:27:51.308888+0000","last_peered":"2024-08-17T02:27:51.308888+0000","last_clean":"2024-08-17T02:27:51.308888+0000","last_became_active":"2024-08-17T02:27:50.295362+0000","last_became_peered":"2024-08-17T02:27:50.295362+0000","last_unstale":"2024-08-17T02:27:51.308888+0000","last_undegraded":"2024-08-17T02:27:51.308888+0000","last_fullsized":"2024-08-17T02:27:51.308888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:23.849240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315799+0000","last_change":"2024-08-17T02:27:51.310706+0000","last_active":"2024-08-17T02:27:51.315799+0000","last_peered":"2024-08-17T02:27:51.315799+0000","last_clean":"2024-08-17T02:27:51.315799+0000","last_became_active":"2024-08-17T02:27:51.310451+0000","last_became_peered":"2024-08-17T02:27:51.310451+0000","last_unstale":"2024-08-17T02:27:51.315799+0000","last_undegraded":"2024-08-17T02:27:51.315799+0000","last_fullsized":"2024-08-17T02:27:51.315799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:59:59.342696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.285945+0000","last_change":"2024-08-17T02:27:50.289792+0000","last_active":"2024-08-17T02:27:51.285945+0000","last_peered":"2024-08-17T02:27:51.285945+0000","last_clean":"2024-08-17T02:27:51.285945+0000","last_became_active":"2024-08-17T02:27:50.288900+0000","last_became_peered":"2024-08-17T02:27:50.288900+0000","last_unstale":"2024-08-17T02:27:51.285945+0000","last_undegraded":"2024-08-17T02:27:51.285945+0000","last_fullsized":"2024-08-17T02:27:51.285945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:01.529714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.303771+0000","last_change":"2024-08-17T02:27:51.303771+0000","last_active":"2024-08-17T02:27:51.303771+0000","last_peered":"2024-08-17T02:27:51.303771+0000","last_clean":"2024-08-17T02:27:51.303771+0000","last_became_active":"2024-08-17T02:27:51.303503+0000","last_became_peered":"2024-08-17T02:27:51.303503+0000","last_unstale":"2024-08-17T02:27:51.303771+0000","last_undegraded":"2024-08-17T02:27:51.303771+0000","last_fullsized":"2024-08-17T02:27:51.303771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:08.545557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":162,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:27:50.293559+0000","last_change":"2024-08-17T02:27:39.552321+0000","last_active":"2024-08-17T02:27:50.293559+0000","last_peered":"2024-08-17T02:27:50.293559+0000","last_clean":"2024-08-17T02:27:50.293559+0000","last_became_active":"2024-08-17T02:27:39.551203+0000","last_became_peered":"2024-08-17T02:27:39.551203+0000","last_unstale":"2024-08-17T02:27:50.293559+0000","last_undegraded":"2024-08-17T02:27:50.293559+0000","last_fullsized":"2024-08-17T02:27:50.293559+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.155679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.155679+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.155679+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:02.785032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.292505+0000","last_change":"2024-08-17T02:27:50.289453+0000","last_active":"2024-08-17T02:27:51.292505+0000","last_peered":"2024-08-17T02:27:51.292505+0000","last_clean":"2024-08-17T02:27:51.292505+0000","last_became_active":"2024-08-17T02:27:50.289066+0000","last_became_peered":"2024-08-17T02:27:50.289066+0000","last_unstale":"2024-08-17T02:27:51.292505+0000","last_undegraded":"2024-08-17T02:27:51.292505+0000","last_fullsized":"2024-08-17T02:27:51.292505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:01.529714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.302543+0000","last_change":"2024-08-17T02:27:51.302543+0000","last_active":"2024-08-17T02:27:51.302543+0000","last_peered":"2024-08-17T02:27:51.302543+0000","last_clean":"2024-08-17T02:27:51.302543+0000","last_became_active":"2024-08-17T02:27:51.302282+0000","last_became_peered":"2024-08-17T02:27:51.302282+0000","last_unstale":"2024-08-17T02:27:51.302543+0000","last_undegraded":"2024-08-17T02:27:51.302543+0000","last_fullsized":"2024-08-17T02:27:51.302543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:07.004040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:27:50.308254+0000","last_change":"2024-08-17T02:27:50.305660+0000","last_active":"2024-08-17T02:27:50.308254+0000","last_peered":"2024-08-17T02:27:50.308254+0000","last_clean":"2024-08-17T02:27:50.308254+0000","last_became_active":"2024-08-17T02:27:50.305076+0000","last_became_peered":"2024-08-17T02:27:50.305076+0000","last_unstale":"2024-08-17T02:27:50.308254+0000","last_undegraded":"2024-08-17T02:27:50.308254+0000","last_fullsized":"2024-08-17T02:27:50.308254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:36:39.083329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.291775+0000","last_change":"2024-08-17T02:27:51.291775+0000","last_active":"2024-08-17T02:27:51.291775+0000","last_peered":"2024-08-17T02:27:51.291775+0000","last_clean":"2024-08-17T02:27:51.291775+0000","last_became_active":"2024-08-17T02:27:51.291502+0000","last_became_peered":"2024-08-17T02:27:51.291502+0000","last_unstale":"2024-08-17T02:27:51.291775+0000","last_undegraded":"2024-08-17T02:27:51.291775+0000","last_fullsized":"2024-08-17T02:27:51.291775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:52.916950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.285821+0000","last_change":"2024-08-17T02:27:50.294544+0000","last_active":"2024-08-17T02:27:51.285821+0000","last_peered":"2024-08-17T02:27:51.285821+0000","last_clean":"2024-08-17T02:27:51.285821+0000","last_became_active":"2024-08-17T02:27:50.293620+0000","last_became_peered":"2024-08-17T02:27:50.293620+0000","last_unstale":"2024-08-17T02:27:51.285821+0000","last_undegraded":"2024-08-17T02:27:51.285821+0000","last_fullsized":"2024-08-17T02:27:51.285821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:43:01.783598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.296255+0000","last_change":"2024-08-17T02:27:51.292285+0000","last_active":"2024-08-17T02:27:51.296255+0000","last_peered":"2024-08-17T02:27:51.296255+0000","last_clean":"2024-08-17T02:27:51.296255+0000","last_became_active":"2024-08-17T02:27:51.292028+0000","last_became_peered":"2024-08-17T02:27:51.292028+0000","last_unstale":"2024-08-17T02:27:51.296255+0000","last_undegraded":"2024-08-17T02:27:51.296255+0000","last_fullsized":"2024-08-17T02:27:51.296255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:00.021420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.295539+0000","last_change":"2024-08-17T02:27:50.300081+0000","last_active":"2024-08-17T02:27:51.295539+0000","last_peered":"2024-08-17T02:27:51.295539+0000","last_clean":"2024-08-17T02:27:51.295539+0000","last_became_active":"2024-08-17T02:27:50.299745+0000","last_became_peered":"2024-08-17T02:27:50.299745+0000","last_unstale":"2024-08-17T02:27:51.295539+0000","last_undegraded":"2024-08-17T02:27:51.295539+0000","last_fullsized":"2024-08-17T02:27:51.295539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:57.534676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.291025+0000","last_change":"2024-08-17T02:27:51.291025+0000","last_active":"2024-08-17T02:27:51.291025+0000","last_peered":"2024-08-17T02:27:51.291025+0000","last_clean":"2024-08-17T02:27:51.291025+0000","last_became_active":"2024-08-17T02:27:51.290690+0000","last_became_peered":"2024-08-17T02:27:51.290690+0000","last_unstale":"2024-08-17T02:27:51.291025+0000","last_undegraded":"2024-08-17T02:27:51.291025+0000","last_fullsized":"2024-08-17T02:27:51.291025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:58.541189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.284142+0000","last_change":"2024-08-17T02:27:50.299597+0000","last_active":"2024-08-17T02:27:51.284142+0000","last_peered":"2024-08-17T02:27:51.284142+0000","last_clean":"2024-08-17T02:27:51.284142+0000","last_became_active":"2024-08-17T02:27:50.298486+0000","last_became_peered":"2024-08-17T02:27:50.298486+0000","last_unstale":"2024-08-17T02:27:51.284142+0000","last_undegraded":"2024-08-17T02:27:51.284142+0000","last_fullsized":"2024-08-17T02:27:51.284142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:43:01.783598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315535+0000","last_change":"2024-08-17T02:27:51.311899+0000","last_active":"2024-08-17T02:27:51.315535+0000","last_peered":"2024-08-17T02:27:51.315535+0000","last_clean":"2024-08-17T02:27:51.315535+0000","last_became_active":"2024-08-17T02:27:51.311615+0000","last_became_peered":"2024-08-17T02:27:51.311615+0000","last_unstale":"2024-08-17T02:27:51.315535+0000","last_undegraded":"2024-08-17T02:27:51.315535+0000","last_fullsized":"2024-08-17T02:27:51.315535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:56:03.462179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:27:50.305322+0000","last_change":"2024-08-17T02:27:50.302154+0000","last_active":"2024-08-17T02:27:50.305322+0000","last_peered":"2024-08-17T02:27:50.305322+0000","last_clean":"2024-08-17T02:27:50.305322+0000","last_became_active":"2024-08-17T02:27:50.301832+0000","last_became_peered":"2024-08-17T02:27:50.301832+0000","last_unstale":"2024-08-17T02:27:50.305322+0000","last_undegraded":"2024-08-17T02:27:50.305322+0000","last_fullsized":"2024-08-17T02:27:50.305322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:57.534676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.296467+0000","last_change":"2024-08-17T02:27:51.292360+0000","last_active":"2024-08-17T02:27:51.296467+0000","last_peered":"2024-08-17T02:27:51.296467+0000","last_clean":"2024-08-17T02:27:51.296467+0000","last_became_active":"2024-08-17T02:27:51.292122+0000","last_became_peered":"2024-08-17T02:27:51.292122+0000","last_unstale":"2024-08-17T02:27:51.296467+0000","last_undegraded":"2024-08-17T02:27:51.296467+0000","last_fullsized":"2024-08-17T02:27:51.296467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:52.916950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.284377+0000","last_change":"2024-08-17T02:27:50.302427+0000","last_active":"2024-08-17T02:27:51.284377+0000","last_peered":"2024-08-17T02:27:51.284377+0000","last_clean":"2024-08-17T02:27:51.284377+0000","last_became_active":"2024-08-17T02:27:50.301894+0000","last_became_peered":"2024-08-17T02:27:50.301894+0000","last_unstale":"2024-08-17T02:27:51.284377+0000","last_undegraded":"2024-08-17T02:27:51.284377+0000","last_fullsized":"2024-08-17T02:27:51.284377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:52:34.125784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.300754+0000","last_change":"2024-08-17T02:27:51.300754+0000","last_active":"2024-08-17T02:27:51.300754+0000","last_peered":"2024-08-17T02:27:51.300754+0000","last_clean":"2024-08-17T02:27:51.300754+0000","last_became_active":"2024-08-17T02:27:51.300516+0000","last_became_peered":"2024-08-17T02:27:51.300516+0000","last_unstale":"2024-08-17T02:27:51.300754+0000","last_undegraded":"2024-08-17T02:27:51.300754+0000","last_fullsized":"2024-08-17T02:27:51.300754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:23.159482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.308163+0000","last_change":"2024-08-17T02:27:50.300734+0000","last_active":"2024-08-17T02:27:51.308163+0000","last_peered":"2024-08-17T02:27:51.308163+0000","last_clean":"2024-08-17T02:27:51.308163+0000","last_became_active":"2024-08-17T02:27:50.300458+0000","last_became_peered":"2024-08-17T02:27:50.300458+0000","last_unstale":"2024-08-17T02:27:51.308163+0000","last_undegraded":"2024-08-17T02:27:51.308163+0000","last_fullsized":"2024-08-17T02:27:51.308163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:43:01.783598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.290195+0000","last_change":"2024-08-17T02:27:51.290195+0000","last_active":"2024-08-17T02:27:51.290195+0000","last_peered":"2024-08-17T02:27:51.290195+0000","last_clean":"2024-08-17T02:27:51.290195+0000","last_became_active":"2024-08-17T02:27:51.287748+0000","last_became_peered":"2024-08-17T02:27:51.287748+0000","last_unstale":"2024-08-17T02:27:51.290195+0000","last_undegraded":"2024-08-17T02:27:51.290195+0000","last_fullsized":"2024-08-17T02:27:51.290195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:44.789170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-08-17T02:27:50.305793+0000","last_change":"2024-08-17T02:27:50.302235+0000","last_active":"2024-08-17T02:27:50.305793+0000","last_peered":"2024-08-17T02:27:50.305793+0000","last_clean":"2024-08-17T02:27:50.305793+0000","last_became_active":"2024-08-17T02:27:50.301967+0000","last_became_peered":"2024-08-17T02:27:50.301967+0000","last_unstale":"2024-08-17T02:27:50.305793+0000","last_undegraded":"2024-08-17T02:27:50.305793+0000","last_fullsized":"2024-08-17T02:27:50.305793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:43.878005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.293997+0000","last_change":"2024-08-17T02:27:51.293997+0000","last_active":"2024-08-17T02:27:51.293997+0000","last_peered":"2024-08-17T02:27:51.293997+0000","last_clean":"2024-08-17T02:27:51.293997+0000","last_became_active":"2024-08-17T02:27:51.293661+0000","last_became_peered":"2024-08-17T02:27:51.293661+0000","last_unstale":"2024-08-17T02:27:51.293997+0000","last_undegraded":"2024-08-17T02:27:51.293997+0000","last_fullsized":"2024-08-17T02:27:51.293997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:24.855754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.285393+0000","last_change":"2024-08-17T02:27:50.297434+0000","last_active":"2024-08-17T02:27:51.285393+0000","last_peered":"2024-08-17T02:27:51.285393+0000","last_clean":"2024-08-17T02:27:51.285393+0000","last_became_active":"2024-08-17T02:27:50.297160+0000","last_became_peered":"2024-08-17T02:27:50.297160+0000","last_unstale":"2024-08-17T02:27:51.285393+0000","last_undegraded":"2024-08-17T02:27:51.285393+0000","last_fullsized":"2024-08-17T02:27:51.285393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:43.878005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.294170+0000","last_change":"2024-08-17T02:27:51.294170+0000","last_active":"2024-08-17T02:27:51.294170+0000","last_peered":"2024-08-17T02:27:51.294170+0000","last_clean":"2024-08-17T02:27:51.294170+0000","last_became_active":"2024-08-17T02:27:51.293090+0000","last_became_peered":"2024-08-17T02:27:51.293090+0000","last_unstale":"2024-08-17T02:27:51.294170+0000","last_undegraded":"2024-08-17T02:27:51.294170+0000","last_fullsized":"2024-08-17T02:27:51.294170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:26.379433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.283605+0000","last_change":"2024-08-17T02:27:50.298748+0000","last_active":"2024-08-17T02:27:51.283605+0000","last_peered":"2024-08-17T02:27:51.283605+0000","last_clean":"2024-08-17T02:27:51.283605+0000","last_became_active":"2024-08-17T02:27:50.298203+0000","last_became_peered":"2024-08-17T02:27:50.298203+0000","last_unstale":"2024-08-17T02:27:51.283605+0000","last_undegraded":"2024-08-17T02:27:51.283605+0000","last_fullsized":"2024-08-17T02:27:51.283605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:36:39.083329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.308188+0000","last_change":"2024-08-17T02:27:51.308188+0000","last_active":"2024-08-17T02:27:51.308188+0000","last_peered":"2024-08-17T02:27:51.308188+0000","last_clean":"2024-08-17T02:27:51.308188+0000","last_became_active":"2024-08-17T02:27:51.307669+0000","last_became_peered":"2024-08-17T02:27:51.307669+0000","last_unstale":"2024-08-17T02:27:51.308188+0000","last_undegraded":"2024-08-17T02:27:51.308188+0000","last_fullsized":"2024-08-17T02:27:51.308188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:44.789170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.317161+0000","last_change":"2024-08-17T02:27:50.305833+0000","last_active":"2024-08-17T02:27:51.317161+0000","last_peered":"2024-08-17T02:27:51.317161+0000","last_clean":"2024-08-17T02:27:51.317161+0000","last_became_active":"2024-08-17T02:27:50.304646+0000","last_became_peered":"2024-08-17T02:27:50.304646+0000","last_unstale":"2024-08-17T02:27:51.317161+0000","last_undegraded":"2024-08-17T02:27:51.317161+0000","last_fullsized":"2024-08-17T02:27:51.317161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:39:03.039409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.310592+0000","last_change":"2024-08-17T02:27:51.310592+0000","last_active":"2024-08-17T02:27:51.310592+0000","last_peered":"2024-08-17T02:27:51.310592+0000","last_clean":"2024-08-17T02:27:51.310592+0000","last_became_active":"2024-08-17T02:27:51.310246+0000","last_became_peered":"2024-08-17T02:27:51.310246+0000","last_unstale":"2024-08-17T02:27:51.310592+0000","last_undegraded":"2024-08-17T02:27:51.310592+0000","last_fullsized":"2024-08-17T02:27:51.310592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:23.747098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.316539+0000","last_change":"2024-08-17T02:27:51.315083+0000","last_active":"2024-08-17T02:27:51.316539+0000","last_peered":"2024-08-17T02:27:51.316539+0000","last_clean":"2024-08-17T02:27:51.316539+0000","last_became_active":"2024-08-17T02:27:51.314854+0000","last_became_peered":"2024-08-17T02:27:51.314854+0000","last_unstale":"2024-08-17T02:27:51.316539+0000","last_undegraded":"2024-08-17T02:27:51.316539+0000","last_fullsized":"2024-08-17T02:27:51.316539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:51:59.475864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.302878+0000","last_change":"2024-08-17T02:27:50.303023+0000","last_active":"2024-08-17T02:27:51.302878+0000","last_peered":"2024-08-17T02:27:51.302878+0000","last_clean":"2024-08-17T02:27:51.302878+0000","last_became_active":"2024-08-17T02:27:50.302104+0000","last_became_peered":"2024-08-17T02:27:50.302104+0000","last_unstale":"2024-08-17T02:27:51.302878+0000","last_undegraded":"2024-08-17T02:27:51.302878+0000","last_fullsized":"2024-08-17T02:27:51.302878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:23.849240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.316569+0000","last_change":"2024-08-17T02:27:51.315498+0000","last_active":"2024-08-17T02:27:51.316569+0000","last_peered":"2024-08-17T02:27:51.316569+0000","last_clean":"2024-08-17T02:27:51.316569+0000","last_became_active":"2024-08-17T02:27:51.315126+0000","last_became_peered":"2024-08-17T02:27:51.315126+0000","last_unstale":"2024-08-17T02:27:51.316569+0000","last_undegraded":"2024-08-17T02:27:51.316569+0000","last_fullsized":"2024-08-17T02:27:51.316569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:07.004040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309881+0000","last_change":"2024-08-17T02:27:50.308330+0000","last_active":"2024-08-17T02:27:51.309881+0000","last_peered":"2024-08-17T02:27:51.309881+0000","last_clean":"2024-08-17T02:27:51.309881+0000","last_became_active":"2024-08-17T02:27:50.307213+0000","last_became_peered":"2024-08-17T02:27:50.307213+0000","last_unstale":"2024-08-17T02:27:51.309881+0000","last_undegraded":"2024-08-17T02:27:51.309881+0000","last_fullsized":"2024-08-17T02:27:51.309881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:52:34.125784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.311099+0000","last_change":"2024-08-17T02:27:51.311099+0000","last_active":"2024-08-17T02:27:51.311099+0000","last_peered":"2024-08-17T02:27:51.311099+0000","last_clean":"2024-08-17T02:27:51.311099+0000","last_became_active":"2024-08-17T02:27:51.310841+0000","last_became_peered":"2024-08-17T02:27:51.310841+0000","last_unstale":"2024-08-17T02:27:51.311099+0000","last_undegraded":"2024-08-17T02:27:51.311099+0000","last_fullsized":"2024-08-17T02:27:51.311099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:17:09.418523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.284546+0000","last_change":"2024-08-17T02:27:50.299166+0000","last_active":"2024-08-17T02:27:51.284546+0000","last_peered":"2024-08-17T02:27:51.284546+0000","last_clean":"2024-08-17T02:27:51.284546+0000","last_became_active":"2024-08-17T02:27:50.297610+0000","last_became_peered":"2024-08-17T02:27:50.297610+0000","last_unstale":"2024-08-17T02:27:51.284546+0000","last_undegraded":"2024-08-17T02:27:51.284546+0000","last_fullsized":"2024-08-17T02:27:51.284546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:29.138877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":8,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.295869+0000","last_change":"2024-08-17T02:27:51.295869+0000","last_active":"2024-08-17T02:27:51.295869+0000","last_peered":"2024-08-17T02:27:51.295869+0000","last_clean":"2024-08-17T02:27:51.295869+0000","last_became_active":"2024-08-17T02:27:51.295671+0000","last_became_peered":"2024-08-17T02:27:51.295671+0000","last_unstale":"2024-08-17T02:27:51.295869+0000","last_undegraded":"2024-08-17T02:27:51.295869+0000","last_fullsized":"2024-08-17T02:27:51.295869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:04:36.940627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.321409+0000","last_change":"2024-08-17T02:27:50.298314+0000","last_active":"2024-08-17T02:27:51.321409+0000","last_peered":"2024-08-17T02:27:51.321409+0000","last_clean":"2024-08-17T02:27:51.321409+0000","last_became_active":"2024-08-17T02:27:50.298019+0000","last_became_peered":"2024-08-17T02:27:50.298019+0000","last_unstale":"2024-08-17T02:27:51.321409+0000","last_undegraded":"2024-08-17T02:27:51.321409+0000","last_fullsized":"2024-08-17T02:27:51.321409+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:29.138877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298132,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073708,"statfs":{"total":96636764160,"available":96331476992,"internally_reserved":0,"allocated":790528,"data_stored":655304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":204800,"data_stored":65918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":196608,"data_stored":64456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":204800,"data_stored":64492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297560,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074280,"statfs":{"total":96636764160,"available":96332062720,"internally_reserved":0,"allocated":204800,"data_stored":65918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297548,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074292,"statfs":{"total":96636764160,"available":96332075008,"internally_reserved":0,"allocated":192512,"data_stored":64366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.484}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":200704,"data_stored":64526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298140,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073700,"statfs":{"total":96636764160,"available":96331468800,"internally_reserved":0,"allocated":798720,"data_stored":655360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:27:55.817 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:27:55.818 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-17T02:27:55.818 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-17T02:27:55.818 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-17T02:27:55.818 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-17T02:27:56.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.001+0000 7f19cb400640 1 Processor -- start 2024-08-17T02:27:56.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.001+0000 7f19cb400640 1 -- start start 2024-08-17T02:27:56.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.002+0000 7f19cb400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f19c4155a20 0x7f19c40adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.002+0000 7f19cb400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19c4155df0 0x7f19c40ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.002+0000 7f19cb400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f19c406d7f0 0x7f19c406dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.002+0000 7f19cb400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c40b0350 con 0x7f19c4155a20 2024-08-17T02:27:56.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.002+0000 7f19cb400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c406e1d0 con 0x7f19c406d7f0 2024-08-17T02:27:56.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.002+0000 7f19cb400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c4156670 con 0x7f19c4155df0 2024-08-17T02:27:56.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.002+0000 7f19c8a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f19c4155a20 0x7f19c40adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.003+0000 7f19c8a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f19c4155a20 0x7f19c40adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56444/0 (socket says 172.21.15.106:56444) 2024-08-17T02:27:56.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.003+0000 7f19c8a00640 1 -- 172.21.15.106:0/1515436077 learned_addr learned my addr 172.21.15.106:0/1515436077 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:56.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.003+0000 7f19c9400640 1 --2- 172.21.15.106:0/1515436077 >> v2:172.21.15.171:3300/0 conn(0x7f19c406d7f0 0x7f19c406dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.003+0000 7f19c3e00640 1 --2- 172.21.15.106:0/1515436077 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19c4155df0 0x7f19c40ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.003+0000 7f19c8a00640 1 -- 172.21.15.106:0/1515436077 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19c4155df0 msgr2=0x7f19c40ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:56.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.003+0000 7f19c8a00640 1 --2- 172.21.15.106:0/1515436077 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19c4155df0 0x7f19c40ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.003+0000 7f19c8a00640 1 -- 172.21.15.106:0/1515436077 >> v2:172.21.15.171:3300/0 conn(0x7f19c406d7f0 msgr2=0x7f19c406dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:56.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.003+0000 7f19c8a00640 1 --2- 172.21.15.106:0/1515436077 >> v2:172.21.15.171:3300/0 conn(0x7f19c406d7f0 0x7f19c406dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.003+0000 7f19c8a00640 1 -- 172.21.15.106:0/1515436077 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c406e5e0 con 0x7f19c4155a20 2024-08-17T02:27:56.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.003+0000 7f19c9400640 1 --2- 172.21.15.106:0/1515436077 >> v2:172.21.15.171:3300/0 conn(0x7f19c406d7f0 0x7f19c406dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:56.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.003+0000 7f19c3e00640 1 --2- 172.21.15.106:0/1515436077 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19c4155df0 0x7f19c40ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:56.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.004+0000 7f19c8a00640 1 --2- 172.21.15.106:0/1515436077 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19c4155a20 0x7f19c40adf10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f19c41565e0 tx=0x7f19b80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cac80268f7265ef server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.004+0000 7f19c3400640 1 -- 172.21.15.106:0/1515436077 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b802add0 con 0x7f19c4155a20 2024-08-17T02:27:56.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.004+0000 7f19c3400640 1 -- 172.21.15.106:0/1515436077 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b8032440 con 0x7f19c4155a20 2024-08-17T02:27:56.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.004+0000 7f19c3400640 1 -- 172.21.15.106:0/1515436077 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b8032820 con 0x7f19c4155a20 2024-08-17T02:27:56.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.005+0000 7f19cb400640 1 -- 172.21.15.106:0/1515436077 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19c4155a20 msgr2=0x7f19c40adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.005+0000 7f19cb400640 1 --2- 172.21.15.106:0/1515436077 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19c4155a20 0x7f19c40adf10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f19c41565e0 tx=0x7f19b80091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.005+0000 7f19cb400640 1 -- 172.21.15.106:0/1515436077 shutdown_connections 2024-08-17T02:27:56.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.005+0000 7f19cb400640 1 --2- 172.21.15.106:0/1515436077 >> v2:172.21.15.171:3300/0 conn(0x7f19c406d7f0 0x7f19c406dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.005+0000 7f19cb400640 1 --2- 172.21.15.106:0/1515436077 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19c4155df0 0x7f19c40ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.005+0000 7f19cb400640 1 --2- 172.21.15.106:0/1515436077 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19c4155a20 0x7f19c40adf10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.005+0000 7f19cb400640 1 -- 172.21.15.106:0/1515436077 >> 172.21.15.106:0/1515436077 conn(0x7f19c40cb9b0 msgr2=0x7f19c40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:56.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.005+0000 7f19cb400640 1 -- 172.21.15.106:0/1515436077 shutdown_connections 2024-08-17T02:27:56.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.005+0000 7f19cb400640 1 -- 172.21.15.106:0/1515436077 wait complete. 2024-08-17T02:27:56.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.006+0000 7f19cb400640 1 Processor -- start 2024-08-17T02:27:56.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.006+0000 7f19cb400640 1 -- start start 2024-08-17T02:27:56.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.007+0000 7f19cb400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19c406d7f0 0x7f19c414d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.007+0000 7f19cb400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19c4155a20 0x7f19c40a7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.007+0000 7f19cb400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19c4155df0 0x7f19c4166e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.007+0000 7f19cb400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c40a59f0 con 0x7f19c4155df0 2024-08-17T02:27:56.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.007+0000 7f19cb400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c41679a0 con 0x7f19c4155a20 2024-08-17T02:27:56.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.007+0000 7f19cb400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c4167c80 con 0x7f19c406d7f0 2024-08-17T02:27:56.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.007+0000 7f19c9400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19c4155df0 0x7f19c4166e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.007+0000 7f19c9400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19c4155df0 0x7f19c4166e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56452/0 (socket says 172.21.15.106:56452) 2024-08-17T02:27:56.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.007+0000 7f19c9400640 1 -- 172.21.15.106:0/3161003293 learned_addr learned my addr 172.21.15.106:0/3161003293 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:56.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.008+0000 7f19c9400640 1 -- 172.21.15.106:0/3161003293 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19c406d7f0 msgr2=0x7f19c414d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.008+0000 7f19c9400640 1 --2- 172.21.15.106:0/3161003293 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19c406d7f0 0x7f19c414d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.008+0000 7f19c9400640 1 -- 172.21.15.106:0/3161003293 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19c4155a20 msgr2=0x7f19c40a7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.008+0000 7f19c9400640 1 --2- 172.21.15.106:0/3161003293 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19c4155a20 0x7f19c40a7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.008+0000 7f19c9400640 1 -- 172.21.15.106:0/3161003293 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b8009450 con 0x7f19c4155df0 2024-08-17T02:27:56.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.008+0000 7f19c9400640 1 --2- 172.21.15.106:0/3161003293 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19c4155df0 0x7f19c4166e90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00cf60 tx=0x7f19bc007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.008+0000 7f19b7e00640 1 -- 172.21.15.106:0/3161003293 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc00ae90 con 0x7f19c4155df0 2024-08-17T02:27:56.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.008+0000 7f19b7e00640 1 -- 172.21.15.106:0/3161003293 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19bc00d650 con 0x7f19c4155df0 2024-08-17T02:27:56.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.008+0000 7f19b7e00640 1 -- 172.21.15.106:0/3161003293 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc00da10 con 0x7f19c4155df0 2024-08-17T02:27:56.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.008+0000 7f19cb400640 1 -- 172.21.15.106:0/3161003293 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c40a5c90 con 0x7f19c4155df0 2024-08-17T02:27:56.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.008+0000 7f19cb400640 1 -- 172.21.15.106:0/3161003293 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c40adfd0 con 0x7f19c4155df0 2024-08-17T02:27:56.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.009+0000 7f19cb400640 1 -- 172.21.15.106:0/3161003293 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c4064db0 con 0x7f19c4155df0 2024-08-17T02:27:56.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.010+0000 7f19b7e00640 1 -- 172.21.15.106:0/3161003293 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f19bc01e3b0 con 0x7f19c4155df0 2024-08-17T02:27:56.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.011+0000 7f19b7e00640 1 --2- 172.21.15.106:0/3161003293 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f19a4065180 0x7f19a4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.012+0000 7f19b7e00640 1 -- 172.21.15.106:0/3161003293 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f19bc082e30 con 0x7f19c4155df0 2024-08-17T02:27:56.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.012+0000 7f19c8a00640 1 --2- 172.21.15.106:0/3161003293 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f19a4065180 0x7f19a4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.012+0000 7f19c8a00640 1 --2- 172.21.15.106:0/3161003293 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f19a4065180 0x7f19a4067630 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f19b8034000 tx=0x7f19b8032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.015+0000 7f19b7e00640 1 -- 172.21.15.106:0/3161003293 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f19bc050e50 con 0x7f19c4155df0 2024-08-17T02:27:56.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.230+0000 7f19cb400640 1 -- 172.21.15.106:0/3161003293 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f19c4156e80 con 0x7f19c4155df0 2024-08-17T02:27:56.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.233+0000 7f19b7e00640 1 -- 172.21.15.106:0/3161003293 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+161031 (secure 0 0 0) 0x7f19bc01a090 con 0x7f19c4155df0 2024-08-17T02:27:56.235 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:27:56.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.236+0000 7f19cb400640 1 -- 172.21.15.106:0/3161003293 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f19a4065180 msgr2=0x7f19a4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.236+0000 7f19cb400640 1 --2- 172.21.15.106:0/3161003293 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f19a4065180 0x7f19a4067630 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f19b8034000 tx=0x7f19b8032000 comp rx=0 tx=0).stop 2024-08-17T02:27:56.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.236+0000 7f19cb400640 1 -- 172.21.15.106:0/3161003293 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19c4155df0 msgr2=0x7f19c4166e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.236+0000 7f19cb400640 1 --2- 172.21.15.106:0/3161003293 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19c4155df0 0x7f19c4166e90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00cf60 tx=0x7f19bc007870 comp rx=0 tx=0).stop 2024-08-17T02:27:56.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.236+0000 7f19cb400640 1 -- 172.21.15.106:0/3161003293 shutdown_connections 2024-08-17T02:27:56.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.236+0000 7f19cb400640 1 --2- 172.21.15.106:0/3161003293 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f19a4065180 0x7f19a4067630 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.236+0000 7f19cb400640 1 --2- 172.21.15.106:0/3161003293 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19c4155df0 0x7f19c4166e90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.236+0000 7f19cb400640 1 --2- 172.21.15.106:0/3161003293 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19c4155a20 0x7f19c40a7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.236+0000 7f19cb400640 1 --2- 172.21.15.106:0/3161003293 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19c406d7f0 0x7f19c414d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.236+0000 7f19cb400640 1 -- 172.21.15.106:0/3161003293 >> 172.21.15.106:0/3161003293 conn(0x7f19c40cb9b0 msgr2=0x7f19c40cb260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:56.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.236+0000 7f19cb400640 1 -- 172.21.15.106:0/3161003293 shutdown_connections 2024-08-17T02:27:56.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.236+0000 7f19cb400640 1 -- 172.21.15.106:0/3161003293 wait complete. 2024-08-17T02:27:56.251 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":36860},{"type":"v1","addr":"172.21.15.106:6833","nonce":36860}]},"active_addr":"172.21.15.106:6833/36860","active_change":"2024-08-17T02:27:29.862110+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4114,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":28605529}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":414564629}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":204829374}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":3658239}]}]} 2024-08-17T02:27:56.254 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-17T02:27:56.254 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-17T02:27:56.255 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:56.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.400+0000 7f23c0800640 1 Processor -- start 2024-08-17T02:27:56.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.400+0000 7f23c0800640 1 -- start start 2024-08-17T02:27:56.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.401+0000 7f23c0800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23b8155a20 0x7f23b80adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.402+0000 7f23c0800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b8156670 con 0x7f23b8155df0 2024-08-17T02:27:56.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.402+0000 7f23c0800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b806e5e0 con 0x7f23b806df00 2024-08-17T02:27:56.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.402+0000 7f23c0800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b80b0350 con 0x7f23b8155a20 2024-08-17T02:27:56.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.402+0000 7f23bd400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f23b8155df0 0x7f23b806d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39834/0 (socket says 172.21.15.106:39834) 2024-08-17T02:27:56.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.402+0000 7f23bd400640 1 -- 172.21.15.106:0/3246537182 learned_addr learned my addr 172.21.15.106:0/3246537182 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:56.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.402+0000 7f23bde00640 1 --2- 172.21.15.106:0/3246537182 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23b8155a20 0x7f23b80adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.402+0000 7f23bca00640 1 -- 172.21.15.106:0/3246537182 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 853885349 0 0) 0x7f23b8156670 con 0x7f23b8155df0 2024-08-17T02:27:56.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.402+0000 7f23bca00640 1 -- 172.21.15.106:0/3246537182 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23a00034e0 con 0x7f23b8155df0 2024-08-17T02:27:56.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.402+0000 7f23bca00640 1 -- 172.21.15.106:0/3246537182 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4046370970 0 0) 0x7f23b806e5e0 con 0x7f23b806df00 2024-08-17T02:27:56.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.402+0000 7f23bca00640 1 -- 172.21.15.106:0/3246537182 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23b8156670 con 0x7f23b806df00 2024-08-17T02:27:56.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.402+0000 7f23bde00640 1 -- 172.21.15.106:0/3246537182 >> v1:172.21.15.171:6789/0 conn(0x7f23b806df00 legacy=0x7f23b8156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.402+0000 7f23bde00640 1 -- 172.21.15.106:0/3246537182 >> v1:172.21.15.106:6789/0 conn(0x7f23b8155df0 legacy=0x7f23b806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.402+0000 7f23bde00640 1 -- 172.21.15.106:0/3246537182 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b806e8c0 con 0x7f23b8155a20 2024-08-17T02:27:56.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.404+0000 7f23bde00640 1 --2- 172.21.15.106:0/3246537182 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23b8155a20 0x7f23b80adf10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f23ac009880 tx=0x7f23ac0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb83a71472918d24 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.404+0000 7f23bca00640 1 -- 172.21.15.106:0/3246537182 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac02ae10 con 0x7f23b8155a20 2024-08-17T02:27:56.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.404+0000 7f23bca00640 1 -- 172.21.15.106:0/3246537182 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ac032440 con 0x7f23b8155a20 2024-08-17T02:27:56.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.404+0000 7f23bca00640 1 -- 172.21.15.106:0/3246537182 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac0327e0 con 0x7f23b8155a20 2024-08-17T02:27:56.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.404+0000 7f23c0800640 1 -- 172.21.15.106:0/3246537182 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23b8155a20 msgr2=0x7f23b80adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.404+0000 7f23c0800640 1 --2- 172.21.15.106:0/3246537182 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23b8155a20 0x7f23b80adf10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f23ac009880 tx=0x7f23ac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.404+0000 7f23c0800640 1 -- 172.21.15.106:0/3246537182 shutdown_connections 2024-08-17T02:27:56.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.404+0000 7f23c0800640 1 --2- 172.21.15.106:0/3246537182 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23b8155a20 0x7f23b80adf10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.404+0000 7f23c0800640 1 -- 172.21.15.106:0/3246537182 >> 172.21.15.106:0/3246537182 conn(0x7f23b80cb9b0 msgr2=0x7f23b80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:56.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.405+0000 7f23c0800640 1 -- 172.21.15.106:0/3246537182 shutdown_connections 2024-08-17T02:27:56.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.405+0000 7f23c0800640 1 -- 172.21.15.106:0/3246537182 wait complete. 2024-08-17T02:27:56.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.406+0000 7f23c0800640 1 Processor -- start 2024-08-17T02:27:56.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.406+0000 7f23c0800640 1 -- start start 2024-08-17T02:27:56.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.407+0000 7f23c0800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23b806df00 0x7f23b8131b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.407+0000 7f23c0800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23b8155a20 0x7f23b814fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.407+0000 7f23c0800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23b8155df0 0x7f23b81343f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.407+0000 7f23c0800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b8151110 con 0x7f23b806df00 2024-08-17T02:27:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.407+0000 7f23c0800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b81502a0 con 0x7f23b8155a20 2024-08-17T02:27:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.407+0000 7f23c0800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b8150500 con 0x7f23b8155df0 2024-08-17T02:27:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.407+0000 7f23bde00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23b806df00 0x7f23b8131b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.407+0000 7f23bde00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23b806df00 0x7f23b8131b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56456/0 (socket says 172.21.15.106:56456) 2024-08-17T02:27:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.407+0000 7f23bde00640 1 -- 172.21.15.106:0/716357757 learned_addr learned my addr 172.21.15.106:0/716357757 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.407+0000 7f23bd400640 1 --2- 172.21.15.106:0/716357757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23b8155a20 0x7f23b814fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.407+0000 7f23be800640 1 --2- 172.21.15.106:0/716357757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23b8155df0 0x7f23b81343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.408+0000 7f23bde00640 1 -- 172.21.15.106:0/716357757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23b8155df0 msgr2=0x7f23b81343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.408+0000 7f23bde00640 1 --2- 172.21.15.106:0/716357757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23b8155df0 0x7f23b81343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.408+0000 7f23bde00640 1 -- 172.21.15.106:0/716357757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23b8155a20 msgr2=0x7f23b814fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.408+0000 7f23bde00640 1 --2- 172.21.15.106:0/716357757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23b8155a20 0x7f23b814fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.408+0000 7f23bde00640 1 -- 172.21.15.106:0/716357757 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac009390 con 0x7f23b806df00 2024-08-17T02:27:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.408+0000 7f23bd400640 1 --2- 172.21.15.106:0/716357757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23b8155a20 0x7f23b814fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:56.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.408+0000 7f23bde00640 1 --2- 172.21.15.106:0/716357757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23b806df00 0x7f23b8131b40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0097d0 tx=0x7f23ac032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.408+0000 7f23b1600640 1 -- 172.21.15.106:0/716357757 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac000c40 con 0x7f23b806df00 2024-08-17T02:27:56.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.408+0000 7f23b1600640 1 -- 172.21.15.106:0/716357757 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ac031a60 con 0x7f23b806df00 2024-08-17T02:27:56.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.408+0000 7f23c0800640 1 -- 172.21.15.106:0/716357757 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b81507e0 con 0x7f23b806df00 2024-08-17T02:27:56.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.408+0000 7f23b1600640 1 -- 172.21.15.106:0/716357757 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac031de0 con 0x7f23b806df00 2024-08-17T02:27:56.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.408+0000 7f23c0800640 1 -- 172.21.15.106:0/716357757 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b8150da0 con 0x7f23b806df00 2024-08-17T02:27:56.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.409+0000 7f23c0800640 1 -- 172.21.15.106:0/716357757 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b8064db0 con 0x7f23b806df00 2024-08-17T02:27:56.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.410+0000 7f23b1600640 1 -- 172.21.15.106:0/716357757 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f23ac039040 con 0x7f23b806df00 2024-08-17T02:27:56.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.411+0000 7f23b1600640 1 --2- 172.21.15.106:0/716357757 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f239c065180 0x7f239c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.411+0000 7f23b1600640 1 -- 172.21.15.106:0/716357757 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f23ac0a2160 con 0x7f23b806df00 2024-08-17T02:27:56.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.411+0000 7f23bd400640 1 --2- 172.21.15.106:0/716357757 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f239c065180 0x7f239c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.412+0000 7f23bd400640 1 --2- 172.21.15.106:0/716357757 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f239c065180 0x7f239c067630 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f23b814f0f0 tx=0x7f23a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.415+0000 7f23b1600640 1 -- 172.21.15.106:0/716357757 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f23ac070180 con 0x7f23b806df00 2024-08-17T02:27:56.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.588+0000 7f23c0800640 1 -- 172.21.15.106:0/716357757 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23b806da90 con 0x7f23b806df00 2024-08-17T02:27:56.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.589+0000 7f23b1600640 1 -- 172.21.15.106:0/716357757 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f23ac0737a0 con 0x7f23b806df00 2024-08-17T02:27:56.590 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:27:56.590 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:27:52.284039+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:48.547438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:49.671073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:56.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.592+0000 7f23c0800640 1 -- 172.21.15.106:0/716357757 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f239c065180 msgr2=0x7f239c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.592+0000 7f23c0800640 1 --2- 172.21.15.106:0/716357757 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f239c065180 0x7f239c067630 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f23b814f0f0 tx=0x7f23a8009040 comp rx=0 tx=0).stop 2024-08-17T02:27:56.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.592+0000 7f23c0800640 1 -- 172.21.15.106:0/716357757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23b806df00 msgr2=0x7f23b8131b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.592+0000 7f23c0800640 1 --2- 172.21.15.106:0/716357757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23b806df00 0x7f23b8131b40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0097d0 tx=0x7f23ac032000 comp rx=0 tx=0).stop 2024-08-17T02:27:56.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.592+0000 7f23c0800640 1 -- 172.21.15.106:0/716357757 shutdown_connections 2024-08-17T02:27:56.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.592+0000 7f23c0800640 1 --2- 172.21.15.106:0/716357757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f23b8155df0 0x7f23b81343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.592+0000 7f23c0800640 1 --2- 172.21.15.106:0/716357757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23b8155a20 0x7f23b814fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.592+0000 7f23c0800640 1 --2- 172.21.15.106:0/716357757 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f239c065180 0x7f239c067630 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.592+0000 7f23c0800640 1 --2- 172.21.15.106:0/716357757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23b806df00 0x7f23b8131b40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.592+0000 7f23c0800640 1 -- 172.21.15.106:0/716357757 >> 172.21.15.106:0/716357757 conn(0x7f23b80cb9b0 msgr2=0x7f23b80687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:56.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.592+0000 7f23c0800640 1 -- 172.21.15.106:0/716357757 shutdown_connections 2024-08-17T02:27:56.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.592+0000 7f23c0800640 1 -- 172.21.15.106:0/716357757 wait complete. 2024-08-17T02:27:56.608 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-17T02:27:56.608 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:27:56.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.755+0000 7f222b200640 1 Processor -- start 2024-08-17T02:27:56.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.755+0000 7f222b200640 1 -- start start 2024-08-17T02:27:56.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.756+0000 7f222b200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22241401b0 0x7f22240caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.756+0000 7f222b200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f22240b1440 0x7f22240c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.756+0000 7f222b200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22240caa80 con 0x7f2224140580 2024-08-17T02:27:56.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.756+0000 7f222b200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22240cb450 con 0x7f22240b1440 2024-08-17T02:27:56.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.756+0000 7f222b200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22240c9e70 con 0x7f22241401b0 2024-08-17T02:27:56.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.757+0000 7f2223e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22241401b0 0x7f22240caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.757+0000 7f2223e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22241401b0 0x7f22240caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:52256/0 (socket says 172.21.15.106:52256) 2024-08-17T02:27:56.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.757+0000 7f2223e00640 1 -- 172.21.15.106:0/2833429951 learned_addr learned my addr 172.21.15.106:0/2833429951 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:56.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.757+0000 7f2229200640 1 --2- 172.21.15.106:0/2833429951 >> v2:172.21.15.171:3300/0 conn(0x7f22240b1440 0x7f22240c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.757+0000 7f2223e00640 1 -- 172.21.15.106:0/2833429951 >> v2:172.21.15.171:3300/0 conn(0x7f22240b1440 msgr2=0x7f22240c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:56.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.757+0000 7f2223e00640 1 --2- 172.21.15.106:0/2833429951 >> v2:172.21.15.171:3300/0 conn(0x7f22240b1440 0x7f22240c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.757+0000 7f2223e00640 1 -- 172.21.15.106:0/2833429951 >> v1:172.21.15.171:6789/0 conn(0x7f2224140580 legacy=0x7f22240b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.757+0000 7f2223e00640 1 -- 172.21.15.106:0/2833429951 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22240ca150 con 0x7f22241401b0 2024-08-17T02:27:56.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.758+0000 7f2223e00640 1 --2- 172.21.15.106:0/2833429951 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22241401b0 0x7f22240caf10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2214009910 tx=0x7f22140091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb3eb5b1d71dfc6c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.758+0000 7f2222a00640 1 -- 172.21.15.106:0/2833429951 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221402adb0 con 0x7f22241401b0 2024-08-17T02:27:56.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.759+0000 7f2222a00640 1 -- 172.21.15.106:0/2833429951 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2214032440 con 0x7f22241401b0 2024-08-17T02:27:56.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.759+0000 7f2222a00640 1 -- 172.21.15.106:0/2833429951 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2214032820 con 0x7f22241401b0 2024-08-17T02:27:56.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.759+0000 7f222b200640 1 -- 172.21.15.106:0/2833429951 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22241401b0 msgr2=0x7f22240caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.759+0000 7f222b200640 1 --2- 172.21.15.106:0/2833429951 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22241401b0 0x7f22240caf10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2214009910 tx=0x7f22140091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.759+0000 7f222b200640 1 -- 172.21.15.106:0/2833429951 shutdown_connections 2024-08-17T02:27:56.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.759+0000 7f222b200640 1 --2- 172.21.15.106:0/2833429951 >> v2:172.21.15.171:3300/0 conn(0x7f22240b1440 0x7f22240c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.759+0000 7f222b200640 1 --2- 172.21.15.106:0/2833429951 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22241401b0 0x7f22240caf10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.759+0000 7f222b200640 1 -- 172.21.15.106:0/2833429951 >> 172.21.15.106:0/2833429951 conn(0x7f22240cb9b0 msgr2=0x7f22240cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:56.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.759+0000 7f222b200640 1 -- 172.21.15.106:0/2833429951 shutdown_connections 2024-08-17T02:27:56.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.759+0000 7f222b200640 1 -- 172.21.15.106:0/2833429951 wait complete. 2024-08-17T02:27:56.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.761+0000 7f222b200640 1 Processor -- start 2024-08-17T02:27:56.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.761+0000 7f222b200640 1 -- start start 2024-08-17T02:27:56.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.762+0000 7f222b200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22240b1440 0x7f22240c17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.762+0000 7f222b200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22241401b0 0x7f22240ac090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.762+0000 7f222b200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2224140580 0x7f222415b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.762+0000 7f222b200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22240abc00 con 0x7f22241401b0 2024-08-17T02:27:56.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.762+0000 7f222b200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22240c1d10 con 0x7f2224140580 2024-08-17T02:27:56.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.762+0000 7f222b200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22240aaff0 con 0x7f22240b1440 2024-08-17T02:27:56.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.762+0000 7f2223400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22241401b0 0x7f22240ac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.762+0000 7f2223e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22240b1440 0x7f22240c17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.762+0000 7f2223400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22241401b0 0x7f22240ac090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56458/0 (socket says 172.21.15.106:56458) 2024-08-17T02:27:56.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.762+0000 7f2223e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22240b1440 0x7f22240c17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:52260/0 (socket says 172.21.15.106:52260) 2024-08-17T02:27:56.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.762+0000 7f2223400640 1 -- 172.21.15.106:0/2151695196 learned_addr learned my addr 172.21.15.106:0/2151695196 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:56.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.762+0000 7f2229200640 1 --2- 172.21.15.106:0/2151695196 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2224140580 0x7f222415b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.762+0000 7f2223400640 1 -- 172.21.15.106:0/2151695196 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22240b1440 msgr2=0x7f22240c17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.762+0000 7f2223400640 1 --2- 172.21.15.106:0/2151695196 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22240b1440 0x7f22240c17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.762+0000 7f2223400640 1 -- 172.21.15.106:0/2151695196 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2224140580 msgr2=0x7f222415b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.762+0000 7f2223400640 1 --2- 172.21.15.106:0/2151695196 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2224140580 0x7f222415b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.762+0000 7f2223400640 1 -- 172.21.15.106:0/2151695196 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2214009450 con 0x7f22241401b0 2024-08-17T02:27:56.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.762+0000 7f2223e00640 1 --2- 172.21.15.106:0/2151695196 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22240b1440 0x7f22240c17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:56.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.763+0000 7f2223400640 1 --2- 172.21.15.106:0/2151695196 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22241401b0 0x7f22240ac090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f221000c560 tx=0x7f2210007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.763+0000 7f221b400640 1 -- 172.21.15.106:0/2151695196 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2210011590 con 0x7f22241401b0 2024-08-17T02:27:56.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.763+0000 7f221b400640 1 -- 172.21.15.106:0/2151695196 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2210011710 con 0x7f22241401b0 2024-08-17T02:27:56.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.763+0000 7f222b200640 1 -- 172.21.15.106:0/2151695196 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22240ab2d0 con 0x7f22241401b0 2024-08-17T02:27:56.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.763+0000 7f221b400640 1 -- 172.21.15.106:0/2151695196 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2210011ad0 con 0x7f22241401b0 2024-08-17T02:27:56.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.763+0000 7f222b200640 1 -- 172.21.15.106:0/2151695196 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22240ab890 con 0x7f22241401b0 2024-08-17T02:27:56.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.764+0000 7f222b200640 1 -- 172.21.15.106:0/2151695196 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22240abdb0 con 0x7f22241401b0 2024-08-17T02:27:56.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.765+0000 7f221b400640 1 -- 172.21.15.106:0/2151695196 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f221001b3b0 con 0x7f22241401b0 2024-08-17T02:27:56.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.766+0000 7f221b400640 1 --2- 172.21.15.106:0/2151695196 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2204065150 0x7f2204067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:56.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.766+0000 7f221b400640 1 -- 172.21.15.106:0/2151695196 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2210081a20 con 0x7f22241401b0 2024-08-17T02:27:56.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.766+0000 7f2223e00640 1 --2- 172.21.15.106:0/2151695196 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2204065150 0x7f2204067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:56.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.767+0000 7f2223e00640 1 --2- 172.21.15.106:0/2151695196 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2204065150 0x7f2204067600 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2214034000 tx=0x7f2214032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:56.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.770+0000 7f221b400640 1 -- 172.21.15.106:0/2151695196 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f22240abdb0 con 0x7f22241401b0 2024-08-17T02:27:56.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.940+0000 7f222b200640 1 -- 172.21.15.106:0/2151695196 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2224064db0 con 0x7f22241401b0 2024-08-17T02:27:56.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.941+0000 7f221b400640 1 -- 172.21.15.106:0/2151695196 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f2210017070 con 0x7f22241401b0 2024-08-17T02:27:56.941 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:27:56.942 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:27:52.284039+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:48.547438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:49.671073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:27:56.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.943+0000 7f222b200640 1 -- 172.21.15.106:0/2151695196 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2204065150 msgr2=0x7f2204067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.943+0000 7f222b200640 1 --2- 172.21.15.106:0/2151695196 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2204065150 0x7f2204067600 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2214034000 tx=0x7f2214032000 comp rx=0 tx=0).stop 2024-08-17T02:27:56.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.943+0000 7f222b200640 1 -- 172.21.15.106:0/2151695196 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22241401b0 msgr2=0x7f22240ac090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:56.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.943+0000 7f222b200640 1 --2- 172.21.15.106:0/2151695196 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22241401b0 0x7f22240ac090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f221000c560 tx=0x7f2210007ef0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.943+0000 7f222b200640 1 -- 172.21.15.106:0/2151695196 shutdown_connections 2024-08-17T02:27:56.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.943+0000 7f222b200640 1 --2- 172.21.15.106:0/2151695196 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2224140580 0x7f222415b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.943+0000 7f222b200640 1 --2- 172.21.15.106:0/2151695196 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2204065150 0x7f2204067600 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.943+0000 7f222b200640 1 --2- 172.21.15.106:0/2151695196 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22241401b0 0x7f22240ac090 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.943+0000 7f222b200640 1 --2- 172.21.15.106:0/2151695196 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22240b1440 0x7f22240c17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:56.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.943+0000 7f222b200640 1 -- 172.21.15.106:0/2151695196 >> 172.21.15.106:0/2151695196 conn(0x7f22240cb9b0 msgr2=0x7f22240afcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:56.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.943+0000 7f222b200640 1 -- 172.21.15.106:0/2151695196 shutdown_connections 2024-08-17T02:27:56.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:56.943+0000 7f222b200640 1 -- 172.21.15.106:0/2151695196 wait complete. 2024-08-17T02:27:56.959 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-17T02:27:56.959 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-17T02:27:56.960 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-17T02:27:56.960 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-17T02:27:56.961 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-17T02:27:56.961 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-17T02:27:56.961 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-17T02:27:56.962 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-17T02:27:57.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.219+0000 7f6963000640 1 Processor -- start 2024-08-17T02:27:57.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.220+0000 7f6963000640 1 -- start start 2024-08-17T02:27:57.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.223+0000 7f6963000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f695404f1d0 0x7f6954005e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.223+0000 7f6963000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6954053840 con 0x7f69540504b0 2024-08-17T02:27:57.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.223+0000 7f6963000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6954053380 con 0x7f69540d86d0 2024-08-17T02:27:57.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.224+0000 7f6963000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69540df740 con 0x7f695404f1d0 2024-08-17T02:27:57.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.224+0000 7f6962600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f695404f1d0 0x7f6954005e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.224+0000 7f6962600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f695404f1d0 0x7f6954005e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56470/0 (socket says 172.21.15.106:56470) 2024-08-17T02:27:57.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.224+0000 7f6962600640 1 -- 172.21.15.106:0/3528723105 learned_addr learned my addr 172.21.15.106:0/3528723105 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:57.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.224+0000 7f6961200640 1 --1- 172.21.15.106:0/3528723105 >> v1:172.21.15.106:6789/0 conn(0x7f69540504b0 0x7f6954053cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39844/0 (socket says 172.21.15.106:39844) 2024-08-17T02:27:57.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.224+0000 7f6962600640 1 -- 172.21.15.106:0/3528723105 >> v1:172.21.15.171:6789/0 conn(0x7f69540d86d0 legacy=0x7f695404fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.224+0000 7f6962600640 1 -- 172.21.15.106:0/3528723105 >> v1:172.21.15.106:6789/0 conn(0x7f69540504b0 legacy=0x7f6954053cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.224+0000 7f6962600640 1 -- 172.21.15.106:0/3528723105 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69540deea0 con 0x7f695404f1d0 2024-08-17T02:27:57.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.226+0000 7f6962600640 1 --2- 172.21.15.106:0/3528723105 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f695404f1d0 0x7f6954005e20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f695c0768d0 tx=0x7f695c06f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81232197ce5a8c4c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.226+0000 7f695be00640 1 -- 172.21.15.106:0/3528723105 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c0aa5e0 con 0x7f695404f1d0 2024-08-17T02:27:57.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.227+0000 7f695be00640 1 -- 172.21.15.106:0/3528723105 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695c0a8050 con 0x7f695404f1d0 2024-08-17T02:27:57.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.227+0000 7f695be00640 1 -- 172.21.15.106:0/3528723105 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c0aa990 con 0x7f695404f1d0 2024-08-17T02:27:57.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.228+0000 7f6963000640 1 -- 172.21.15.106:0/3528723105 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f695404f1d0 msgr2=0x7f6954005e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.228+0000 7f6963000640 1 --2- 172.21.15.106:0/3528723105 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f695404f1d0 0x7f6954005e20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f695c0768d0 tx=0x7f695c06f710 comp rx=0 tx=0).stop 2024-08-17T02:27:57.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.228+0000 7f6963000640 1 -- 172.21.15.106:0/3528723105 shutdown_connections 2024-08-17T02:27:57.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.228+0000 7f6963000640 1 --2- 172.21.15.106:0/3528723105 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f695404f1d0 0x7f6954005e20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.228+0000 7f6963000640 1 -- 172.21.15.106:0/3528723105 >> 172.21.15.106:0/3528723105 conn(0x7f6954051600 msgr2=0x7f6954051a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.229+0000 7f789a400640 1 Processor -- start 2024-08-17T02:27:57.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.229+0000 7f789a400640 1 -- start start 2024-08-17T02:27:57.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.231+0000 7f8e50e00640 1 Processor -- start 2024-08-17T02:27:57.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.231+0000 7f8e50e00640 1 -- start start 2024-08-17T02:27:57.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.229+0000 7f6963000640 1 -- 172.21.15.106:0/3528723105 shutdown_connections 2024-08-17T02:27:57.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.229+0000 7f6963000640 1 -- 172.21.15.106:0/3528723105 wait complete. 2024-08-17T02:27:57.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.231+0000 7f6963000640 1 Processor -- start 2024-08-17T02:27:57.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.231+0000 7f789a400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f78940ada10 0x7f78940b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.231+0000 7f789a400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78940d0ab0 con 0x7f78940b38b0 2024-08-17T02:27:57.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.231+0000 7f789a400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78940b00c0 con 0x7f78940b1120 2024-08-17T02:27:57.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.231+0000 7f789a400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78940b0360 con 0x7f78940ada10 2024-08-17T02:27:57.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.232+0000 7f6963000640 1 -- start start 2024-08-17T02:27:57.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.232+0000 7f7893400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f78940ada10 0x7f78940b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.232+0000 7f7893400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f78940ada10 0x7f78940b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:58070/0 (socket says 172.21.15.106:58070) 2024-08-17T02:27:57.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.232+0000 7f7892a00640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f78940b1120 0x7f78940b31a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:53820/0 (socket says 172.21.15.106:53820) 2024-08-17T02:27:57.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.232+0000 7f7893400640 1 -- 172.21.15.106:0/3143594854 learned_addr learned my addr 172.21.15.106:0/3143594854 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:57.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.233+0000 7f7893400640 1 -- 172.21.15.106:0/3143594854 >> v1:172.21.15.171:6789/0 conn(0x7f78940b1120 legacy=0x7f78940b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.233+0000 7f7892000640 1 -- 172.21.15.106:0/3143594854 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440983309 0 0) 0x7f78940b00c0 con 0x7f78940b1120 2024-08-17T02:27:57.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.233+0000 7f7893400640 1 -- 172.21.15.106:0/3143594854 >> v1:172.21.15.106:6789/0 conn(0x7f78940b38b0 legacy=0x7f78940aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.233+0000 7f8e50e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e4c06d7a0 0x7f8e4c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.234+0000 7f7893400640 1 -- 172.21.15.106:0/3143594854 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78940b0640 con 0x7f78940ada10 2024-08-17T02:27:57.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.234+0000 7f8e50e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8e4c0cc400 0x7f8e4c0ab210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.234+0000 7f6963000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f695404f1d0 0x7f6954101fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.234+0000 7f6963000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69540504b0 0x7f6954035de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.234+0000 7f6963000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69540d86d0 0x7f6954036320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.234+0000 7f6961c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f695404f1d0 0x7f6954101fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.234+0000 7f6961c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f695404f1d0 0x7f6954101fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:52286/0 (socket says 172.21.15.106:52286) 2024-08-17T02:27:57.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.234+0000 7f6961200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69540504b0 0x7f6954035de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.235+0000 7fd221400640 1 Processor -- start 2024-08-17T02:27:57.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.234+0000 7f8e4b400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e4c06d7a0 0x7f8e4c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.234+0000 7f8e4b400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e4c06d7a0 0x7f8e4c06db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:52276/0 (socket says 172.21.15.106:52276) 2024-08-17T02:27:57.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.235+0000 7f8e50e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e4c0adb40 con 0x7f8e4c0adfd0 2024-08-17T02:27:57.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.235+0000 7f8e50e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e4c0abdf0 con 0x7f8e4c0cc400 2024-08-17T02:27:57.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.235+0000 7f8e50e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c0abb10 con 0x7f8e4c06d7a0 2024-08-17T02:27:57.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.234+0000 7f8e4aa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8e4c0cc400 0x7f8e4c0ab210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.235+0000 7f8e4aa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8e4c0cc400 0x7f8e4c0ab210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56484/0 (socket says 172.21.15.106:56484) 2024-08-17T02:27:57.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.235+0000 7f8e4aa00640 1 -- 172.21.15.106:0/2014196637 learned_addr learned my addr 172.21.15.106:0/2014196637 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:57.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.234+0000 7f6961200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69540504b0 0x7f6954035de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:58086/0 (socket says 172.21.15.106:58086) 2024-08-17T02:27:57.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.235+0000 7f6961c00640 1 -- 172.21.15.106:0/288900651 learned_addr learned my addr 172.21.15.106:0/288900651 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:57.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.235+0000 7f6963000640 1 -- 172.21.15.106:0/288900651 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6954039c20 con 0x7f69540d86d0 2024-08-17T02:27:57.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.235+0000 7f6963000640 1 -- 172.21.15.106:0/288900651 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6954038fa0 con 0x7f69540504b0 2024-08-17T02:27:57.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.235+0000 7f6963000640 1 -- 172.21.15.106:0/288900651 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6954039280 con 0x7f695404f1d0 2024-08-17T02:27:57.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.235+0000 7f6962600640 1 --2- 172.21.15.106:0/288900651 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69540d86d0 0x7f6954036320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.236+0000 7f8e4aa00640 1 -- 172.21.15.106:0/2014196637 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e4c06d7a0 msgr2=0x7f8e4c06db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.236+0000 7f8e4aa00640 1 --2- 172.21.15.106:0/2014196637 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e4c06d7a0 0x7f8e4c06db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.236+0000 7f8e4aa00640 1 -- 172.21.15.106:0/2014196637 >> v1:172.21.15.171:6789/0 conn(0x7f8e4c0adfd0 legacy=0x7f8e4c1547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.236+0000 7f8e4aa00640 1 -- 172.21.15.106:0/2014196637 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4c0ad4f0 con 0x7f8e4c0cc400 2024-08-17T02:27:57.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.235+0000 7fd221400640 1 -- start start 2024-08-17T02:27:57.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.236+0000 7f8e4a000640 1 -- 172.21.15.106:0/2014196637 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2553279877 0 0) 0x7f8e4c0adb40 con 0x7f8e4c0adfd0 2024-08-17T02:27:57.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.236+0000 7f8e4b400640 1 --2- 172.21.15.106:0/2014196637 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e4c06d7a0 0x7f8e4c06db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:57.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.236+0000 7f7893400640 1 --2- 172.21.15.106:0/3143594854 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78940ada10 0x7f78940b2c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7884009910 tx=0x7f78840091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13210c8ef0fb239c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.237+0000 7f94d1400640 1 Processor -- start 2024-08-17T02:27:57.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.237+0000 7f7892000640 1 -- 172.21.15.106:0/3143594854 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788402adc0 con 0x7f78940ada10 2024-08-17T02:27:57.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.237+0000 7f7892000640 1 -- 172.21.15.106:0/3143594854 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7884032440 con 0x7f78940ada10 2024-08-17T02:27:57.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.237+0000 7f7892000640 1 -- 172.21.15.106:0/3143594854 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78840327e0 con 0x7f78940ada10 2024-08-17T02:27:57.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.237+0000 7f6961c00640 1 -- 172.21.15.106:0/288900651 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69540504b0 msgr2=0x7f6954035de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.237+0000 7f6961c00640 1 --2- 172.21.15.106:0/288900651 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69540504b0 0x7f6954035de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.237+0000 7f6961c00640 1 -- 172.21.15.106:0/288900651 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69540d86d0 msgr2=0x7f6954036320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.238+0000 7fd221400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd2140e6e70 0x7fd21403a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.238+0000 7fd221400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd214038740 0x7fd214038ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.238+0000 7fd221400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2140390e0 con 0x7fd214006150 2024-08-17T02:27:57.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.238+0000 7fd221400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd214053520 con 0x7fd2140e6e70 2024-08-17T02:27:57.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.238+0000 7fd221400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140e7950 con 0x7fd214038740 2024-08-17T02:27:57.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.238+0000 7f6961c00640 1 --2- 172.21.15.106:0/288900651 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69540d86d0 0x7f6954036320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.238+0000 7f6961c00640 1 -- 172.21.15.106:0/288900651 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c04c200 con 0x7f695404f1d0 2024-08-17T02:27:57.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.238+0000 7f6962600640 1 --2- 172.21.15.106:0/288900651 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69540d86d0 0x7f6954036320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:57.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.238+0000 7f789a400640 1 -- 172.21.15.106:0/3143594854 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78940ada10 msgr2=0x7f78940b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.238+0000 7f789a400640 1 --2- 172.21.15.106:0/3143594854 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78940ada10 0x7f78940b2c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7884009910 tx=0x7f78840091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.239+0000 7f789a400640 1 -- 172.21.15.106:0/3143594854 shutdown_connections 2024-08-17T02:27:57.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.239+0000 7f789a400640 1 --2- 172.21.15.106:0/3143594854 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78940ada10 0x7f78940b2c60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.239+0000 7f789a400640 1 -- 172.21.15.106:0/3143594854 >> 172.21.15.106:0/3143594854 conn(0x7f78940cfdf0 msgr2=0x7f78940d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.238+0000 7f8e4aa00640 1 --2- 172.21.15.106:0/2014196637 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e4c0cc400 0x7f8e4c0ab210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c009940 tx=0x7f8e3c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cdb186914d48141 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.238+0000 7fd219e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd214006150 0x7fd2140e7240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39864/0 (socket says 172.21.15.106:39864) 2024-08-17T02:27:57.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.238+0000 7fd219e00640 1 -- 172.21.15.106:0/1187924831 learned_addr learned my addr 172.21.15.106:0/1187924831 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:57.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.238+0000 7fd21b200640 1 --2- 172.21.15.106:0/1187924831 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd214038740 0x7fd214038ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.237+0000 7f94d1400640 1 -- start start 2024-08-17T02:27:57.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.239+0000 7f789a400640 1 -- 172.21.15.106:0/3143594854 shutdown_connections 2024-08-17T02:27:57.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.239+0000 7f6961c00640 1 --2- 172.21.15.106:0/288900651 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f695404f1d0 0x7f6954101fe0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f695000b5e0 tx=0x7f6950009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.239+0000 7f789a400640 1 -- 172.21.15.106:0/3143594854 wait complete. 2024-08-17T02:27:57.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.239+0000 7f8e4a000640 1 -- 172.21.15.106:0/2014196637 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c031510 con 0x7f8e4c0cc400 2024-08-17T02:27:57.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.239+0000 7f42e0000640 1 Processor -- start 2024-08-17T02:27:57.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.239+0000 7f94d1400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94cc15d830 0x7f94cc06e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.239+0000 7f94d1400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94cc0b1690 con 0x7f94cc15e310 2024-08-17T02:27:57.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.239+0000 7f94d1400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94cc0ae4a0 con 0x7f94cc0b0610 2024-08-17T02:27:57.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.239+0000 7f94d1400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc0b1b20 con 0x7f94cc15d830 2024-08-17T02:27:57.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.240+0000 7f8e4a000640 1 -- 172.21.15.106:0/2014196637 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c02f050 con 0x7f8e4c0cc400 2024-08-17T02:27:57.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.240+0000 7f94c3e00640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f94cc0b0610 0x7f94cc15dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:53830/0 (socket says 172.21.15.106:53830) 2024-08-17T02:27:57.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.240+0000 7f94c3e00640 1 -- 172.21.15.106:0/3595576856 learned_addr learned my addr 172.21.15.106:0/3595576856 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:57.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.238+0000 7fd21a800640 1 --2- 172.21.15.106:0/1187924831 >> v2:172.21.15.171:3300/0 conn(0x7fd2140e6e70 0x7fd21403a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.240+0000 7f94ca800640 1 --2- 172.21.15.106:0/3595576856 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94cc15d830 0x7f94cc06e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.239+0000 7fd21b200640 1 -- 172.21.15.106:0/1187924831 >> v2:172.21.15.171:3300/0 conn(0x7fd2140e6e70 msgr2=0x7fd21403a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.239+0000 7fd21b200640 1 --2- 172.21.15.106:0/1187924831 >> v2:172.21.15.171:3300/0 conn(0x7fd2140e6e70 0x7fd21403a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.239+0000 7fd21b200640 1 -- 172.21.15.106:0/1187924831 >> v1:172.21.15.106:6789/0 conn(0x7fd214006150 legacy=0x7fd2140e7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.239+0000 7fd21b200640 1 -- 172.21.15.106:0/1187924831 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21403aeb0 con 0x7fd214038740 2024-08-17T02:27:57.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.240+0000 7fd21b200640 1 --2- 172.21.15.106:0/1187924831 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd214038740 0x7fd214038ba0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd21c04ca10 tx=0x7fd21c064990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4870a1d3135f10e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.240+0000 7f94c9e00640 1 -- 172.21.15.106:0/3595576856 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 193449193 0 0) 0x7f94cc0ae4a0 con 0x7f94cc0b0610 2024-08-17T02:27:57.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.240+0000 7f94c9e00640 1 -- 172.21.15.106:0/3595576856 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94b00034e0 con 0x7f94cc0b0610 2024-08-17T02:27:57.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.240+0000 7f8e4a000640 1 -- 172.21.15.106:0/2014196637 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c031510 con 0x7f8e4c0cc400 2024-08-17T02:27:57.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.240+0000 7f94ca800640 1 -- 172.21.15.106:0/3595576856 >> v1:172.21.15.171:6789/0 conn(0x7f94cc0b0610 legacy=0x7f94cc15dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.240+0000 7f94ca800640 1 -- 172.21.15.106:0/3595576856 >> v1:172.21.15.106:6789/0 conn(0x7f94cc15e310 legacy=0x7f94cc166e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.241+0000 7fd219400640 1 -- 172.21.15.106:0/1187924831 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c0a65e0 con 0x7fd214038740 2024-08-17T02:27:57.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.241+0000 7fd219400640 1 -- 172.21.15.106:0/1187924831 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21c0a4050 con 0x7fd214038740 2024-08-17T02:27:57.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.241+0000 7fd219400640 1 -- 172.21.15.106:0/1187924831 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c0a6990 con 0x7fd214038740 2024-08-17T02:27:57.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.241+0000 7f789a400640 1 Processor -- start 2024-08-17T02:27:57.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.241+0000 7f94ca800640 1 -- 172.21.15.106:0/3595576856 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94cc15b200 con 0x7f94cc15d830 2024-08-17T02:27:57.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.241+0000 7f789a400640 1 -- start start 2024-08-17T02:27:57.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.239+0000 7f42e0000640 1 -- start start 2024-08-17T02:27:57.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.242+0000 7f6958c00640 1 -- 172.21.15.106:0/288900651 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695000f590 con 0x7f695404f1d0 2024-08-17T02:27:57.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.242+0000 7f6958c00640 1 -- 172.21.15.106:0/288900651 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695000f710 con 0x7f695404f1d0 2024-08-17T02:27:57.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.242+0000 7f6958c00640 1 -- 172.21.15.106:0/288900651 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695000fad0 con 0x7f695404f1d0 2024-08-17T02:27:57.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.241+0000 7f42e0000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f42d8159060 0x7f42d80c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.241+0000 7f42e0000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d80cbf40 con 0x7f42d8159430 2024-08-17T02:27:57.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.241+0000 7f42e0000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d80cb930 con 0x7f42d80c6a30 2024-08-17T02:27:57.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.241+0000 7f42e0000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d80ced10 con 0x7f42d8159060 2024-08-17T02:27:57.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.242+0000 7f94ca800640 1 --2- 172.21.15.106:0/3595576856 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94cc15d830 0x7f94cc06e1b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f94bc009880 tx=0x7f94bc0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b7bf0dabe15c947 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.242+0000 7f8e50e00640 1 -- 172.21.15.106:0/2014196637 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e4c0cc400 msgr2=0x7f8e4c0ab210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.242+0000 7f8e50e00640 1 --2- 172.21.15.106:0/2014196637 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e4c0cc400 0x7f8e4c0ab210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c009940 tx=0x7f8e3c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.242+0000 7fd221400640 1 -- 172.21.15.106:0/1187924831 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd214038740 msgr2=0x7fd214038ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.242+0000 7fd221400640 1 --2- 172.21.15.106:0/1187924831 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd214038740 0x7fd214038ba0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd21c04ca10 tx=0x7fd21c064990 comp rx=0 tx=0).stop 2024-08-17T02:27:57.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.242+0000 7f789a400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78940ada10 0x7f789416e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.242+0000 7f789a400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78940b1120 0x7f7894150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.242+0000 7f789a400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78940b38b0 0x7f7894170ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.242+0000 7f789a400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7894151c80 con 0x7f78940b38b0 2024-08-17T02:27:57.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.242+0000 7f789a400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789416eb20 con 0x7f78940ada10 2024-08-17T02:27:57.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.242+0000 7f789a400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78941535f0 con 0x7f78940b1120 2024-08-17T02:27:57.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.243+0000 7f42dd600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f42d8159060 0x7f42d80c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.243+0000 7f42dd600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f42d8159060 0x7f42d80c6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56504/0 (socket says 172.21.15.106:56504) 2024-08-17T02:27:57.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.243+0000 7f42dd600640 1 -- 172.21.15.106:0/4216781795 learned_addr learned my addr 172.21.15.106:0/4216781795 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:57.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.242+0000 7f6963000640 1 -- 172.21.15.106:0/288900651 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6954039560 con 0x7f695404f1d0 2024-08-17T02:27:57.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.243+0000 7f6963000640 1 -- 172.21.15.106:0/288900651 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6954102520 con 0x7f695404f1d0 2024-08-17T02:27:57.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.243+0000 7f94c9e00640 1 -- 172.21.15.106:0/3595576856 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc02ae20 con 0x7f94cc15d830 2024-08-17T02:27:57.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.243+0000 7f94c9e00640 1 -- 172.21.15.106:0/3595576856 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94bc032440 con 0x7f94cc15d830 2024-08-17T02:27:57.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.243+0000 7f7893400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78940ada10 0x7f789416e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.243+0000 7f7892a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78940b1120 0x7f7894150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.243+0000 7f94c9e00640 1 -- 172.21.15.106:0/3595576856 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc0327e0 con 0x7f94cc15d830 2024-08-17T02:27:57.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.243+0000 7f7893400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78940ada10 0x7f789416e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:58110/0 (socket says 172.21.15.106:58110) 2024-08-17T02:27:57.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.243+0000 7f7893400640 1 -- 172.21.15.106:0/1994677149 learned_addr learned my addr 172.21.15.106:0/1994677149 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:57.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.243+0000 7f7893e00640 1 --2- 172.21.15.106:0/1994677149 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78940b38b0 0x7f7894170ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.244+0000 7f6963000640 1 -- 172.21.15.106:0/288900651 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6954005320 con 0x7f695404f1d0 2024-08-17T02:27:57.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.244+0000 7fd221400640 1 -- 172.21.15.106:0/1187924831 shutdown_connections 2024-08-17T02:27:57.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.244+0000 7fd221400640 1 --2- 172.21.15.106:0/1187924831 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd214038740 0x7fd214038ba0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.244+0000 7fd221400640 1 --2- 172.21.15.106:0/1187924831 >> v2:172.21.15.171:3300/0 conn(0x7fd2140e6e70 0x7fd21403a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.244+0000 7fd221400640 1 -- 172.21.15.106:0/1187924831 >> 172.21.15.106:0/1187924831 conn(0x7fd21400f070 msgr2=0x7fd214058f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.244+0000 7f94d1400640 1 -- 172.21.15.106:0/3595576856 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94cc15d830 msgr2=0x7f94cc06e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.244+0000 7f94d1400640 1 --2- 172.21.15.106:0/3595576856 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94cc15d830 0x7f94cc06e1b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f94bc009880 tx=0x7f94bc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.244+0000 7f7893400640 1 -- 172.21.15.106:0/1994677149 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78940b1120 msgr2=0x7f7894150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.244+0000 7f7893400640 1 --2- 172.21.15.106:0/1994677149 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78940b1120 0x7f7894150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.244+0000 7f7893400640 1 -- 172.21.15.106:0/1994677149 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78940b38b0 msgr2=0x7f7894170ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.244+0000 7f42dd600640 1 -- 172.21.15.106:0/4216781795 >> v1:172.21.15.171:6789/0 conn(0x7f42d80c6a30 legacy=0x7f42d80cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.244+0000 7f42d7e00640 1 -- 172.21.15.106:0/4216781795 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551659553 0 0) 0x7f42d80cb930 con 0x7f42d80c6a30 2024-08-17T02:27:57.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.244+0000 7f8e50e00640 1 -- 172.21.15.106:0/2014196637 shutdown_connections 2024-08-17T02:27:57.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.244+0000 7f42dd600640 1 -- 172.21.15.106:0/4216781795 >> v1:172.21.15.106:6789/0 conn(0x7f42d8159430 legacy=0x7f42d80c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.245+0000 7f7893400640 1 --2- 172.21.15.106:0/1994677149 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78940b38b0 0x7f7894170ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.245+0000 7f7893400640 1 -- 172.21.15.106:0/1994677149 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7884009450 con 0x7f78940ada10 2024-08-17T02:27:57.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.244+0000 7f8e50e00640 1 --2- 172.21.15.106:0/2014196637 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e4c0cc400 0x7f8e4c0ab210 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.244+0000 7f8e50e00640 1 --2- 172.21.15.106:0/2014196637 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e4c06d7a0 0x7f8e4c06db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.244+0000 7f8e50e00640 1 -- 172.21.15.106:0/2014196637 >> 172.21.15.106:0/2014196637 conn(0x7f8e4c067750 msgr2=0x7f8e4c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.245+0000 7f7893e00640 1 --2- 172.21.15.106:0/1994677149 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78940b38b0 0x7f7894170ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:57.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.244+0000 7fd221400640 1 -- 172.21.15.106:0/1187924831 shutdown_connections 2024-08-17T02:27:57.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.245+0000 7fd221400640 1 -- 172.21.15.106:0/1187924831 wait complete. 2024-08-17T02:27:57.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.245+0000 7f42dd600640 1 -- 172.21.15.106:0/4216781795 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d80cbbd0 con 0x7f42d8159060 2024-08-17T02:27:57.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.245+0000 7f94d1400640 1 -- 172.21.15.106:0/3595576856 shutdown_connections 2024-08-17T02:27:57.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.245+0000 7f94d1400640 1 --2- 172.21.15.106:0/3595576856 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94cc15d830 0x7f94cc06e1b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.245+0000 7f94d1400640 1 -- 172.21.15.106:0/3595576856 >> 172.21.15.106:0/3595576856 conn(0x7f94cc0cb9b0 msgr2=0x7f94cc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.245+0000 7f7893400640 1 --2- 172.21.15.106:0/1994677149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78940ada10 0x7f789416e5e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7884035040 tx=0x7f7884032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.245+0000 7f94d1400640 1 -- 172.21.15.106:0/3595576856 shutdown_connections 2024-08-17T02:27:57.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.245+0000 7f94d1400640 1 -- 172.21.15.106:0/3595576856 wait complete. 2024-08-17T02:27:57.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.245+0000 7f788aa00640 1 -- 172.21.15.106:0/1994677149 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7884031a60 con 0x7f78940ada10 2024-08-17T02:27:57.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.246+0000 7f788aa00640 1 -- 172.21.15.106:0/1994677149 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7884031be0 con 0x7f78940ada10 2024-08-17T02:27:57.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.246+0000 7f788aa00640 1 -- 172.21.15.106:0/1994677149 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788403b400 con 0x7f78940ada10 2024-08-17T02:27:57.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.246+0000 7f6958c00640 1 -- 172.21.15.106:0/288900651 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f695001a460 con 0x7f695404f1d0 2024-08-17T02:27:57.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.246+0000 7f789a400640 1 -- 172.21.15.106:0/1994677149 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78941519a0 con 0x7f78940ada10 2024-08-17T02:27:57.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.245+0000 7f8e50e00640 1 -- 172.21.15.106:0/2014196637 shutdown_connections 2024-08-17T02:27:57.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.245+0000 7f8e50e00640 1 -- 172.21.15.106:0/2014196637 wait complete. 2024-08-17T02:27:57.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.247+0000 7f6958c00640 1 --2- 172.21.15.106:0/288900651 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f693c0652a0 0x7f693c067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.247+0000 7f42dd600640 1 --2- 172.21.15.106:0/4216781795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42d8159060 0x7f42d80c6e90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f42c4009910 tx=0x7f42c40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf8ba6a114de6e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.246+0000 7f789a400640 1 -- 172.21.15.106:0/1994677149 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7894153280 con 0x7f78940ada10 2024-08-17T02:27:57.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.247+0000 7f6958c00640 1 -- 172.21.15.106:0/288900651 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6950082b40 con 0x7f695404f1d0 2024-08-17T02:27:57.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.247+0000 7fd221400640 1 Processor -- start 2024-08-17T02:27:57.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.247+0000 7f6958c00640 1 --2- 172.21.15.106:0/288900651 >> [v2:172.21.15.106:6800/37127,v1:172.21.15.106:6802/37127] conn(0x7f693c06d4b0 0x7f693c06f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.247+0000 7f6958c00640 1 -- 172.21.15.106:0/288900651 --> [v2:172.21.15.106:6800/37127,v1:172.21.15.106:6802/37127] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f693c06ff70 con 0x7f693c06d4b0 2024-08-17T02:27:57.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.247+0000 7f6958c00640 1 -- 172.21.15.106:0/288900651 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6950082e70 con 0x7f695404f1d0 2024-08-17T02:27:57.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.247+0000 7f94d1400640 1 Processor -- start 2024-08-17T02:27:57.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.248+0000 7f42d7e00640 1 -- 172.21.15.106:0/4216781795 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c402aca0 con 0x7f42d8159060 2024-08-17T02:27:57.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.248+0000 7f8e50e00640 1 Processor -- start 2024-08-17T02:27:57.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.248+0000 7fb2e8c00640 1 Processor -- start 2024-08-17T02:27:57.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.248+0000 7f42d7e00640 1 -- 172.21.15.106:0/4216781795 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c402ae00 con 0x7f42d8159060 2024-08-17T02:27:57.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.248+0000 7f94d1400640 1 -- start start 2024-08-17T02:27:57.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.248+0000 7f2a7f800640 1 Processor -- start 2024-08-17T02:27:57.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.248+0000 7f8e50e00640 1 -- start start 2024-08-17T02:27:57.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.248+0000 7f2a7f800640 1 -- start start 2024-08-17T02:27:57.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.248+0000 7f6961200640 1 --2- 172.21.15.106:0/288900651 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f693c0652a0 0x7f693c067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.248+0000 7f6962600640 1 --2- 172.21.15.106:0/288900651 >> [v2:172.21.15.106:6800/37127,v1:172.21.15.106:6802/37127] conn(0x7f693c06d4b0 0x7f693c06f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.248+0000 7f789a400640 1 -- 172.21.15.106:0/1994677149 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7894064db0 con 0x7f78940ada10 2024-08-17T02:27:57.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.248+0000 7f42d7e00640 1 -- 172.21.15.106:0/4216781795 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c4032670 con 0x7f42d8159060 2024-08-17T02:27:57.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.248+0000 7fb2e8c00640 1 -- start start 2024-08-17T02:27:57.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.249+0000 7f42e0000640 1 -- 172.21.15.106:0/4216781795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42d8159060 msgr2=0x7f42d80c6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.250+0000 7f42e0000640 1 --2- 172.21.15.106:0/4216781795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42d8159060 0x7f42d80c6e90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f42c4009910 tx=0x7f42c40091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.249+0000 7f94d1400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94cc0b0610 0x7f94cc147c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.249+0000 7f94d1400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94cc15d830 0x7f94cc0a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.249+0000 7f94d1400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94cc15e310 0x7f94cc16dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.249+0000 7f94d1400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc148190 con 0x7f94cc15e310 2024-08-17T02:27:57.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.249+0000 7f94d1400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc159840 con 0x7f94cc15d830 2024-08-17T02:27:57.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.249+0000 7f94d1400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc0a5a10 con 0x7f94cc0b0610 2024-08-17T02:27:57.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.249+0000 7fd221400640 1 -- start start 2024-08-17T02:27:57.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.250+0000 7f2a7f800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2a780ada10 0x7f2a780b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.250+0000 7f2a7f800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2a780b1120 0x7f2a780b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.250+0000 7f42e0000640 1 -- 172.21.15.106:0/4216781795 shutdown_connections 2024-08-17T02:27:57.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.250+0000 7f42e0000640 1 --2- 172.21.15.106:0/4216781795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42d8159060 0x7f42d80c6e90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.250+0000 7f2a7f800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a780d0ab0 con 0x7f2a780b36e0 2024-08-17T02:27:57.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.250+0000 7f2a7f800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a780b00c0 con 0x7f2a780b1120 2024-08-17T02:27:57.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.250+0000 7f2a7f800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a780b0360 con 0x7f2a780ada10 2024-08-17T02:27:57.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.250+0000 7f42e0000640 1 -- 172.21.15.106:0/4216781795 >> 172.21.15.106:0/4216781795 conn(0x7f42d80cfde0 msgr2=0x7f42d80d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.250+0000 7f8e50e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e4c06d7a0 0x7f8e4c165360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.250+0000 7f2a7d800640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f2a780b36e0 0x7f2a780adde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:53846/0 (socket says 172.21.15.106:53846) 2024-08-17T02:27:57.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.250+0000 7f2a7d800640 1 -- 172.21.15.106:0/1926557305 learned_addr learned my addr 172.21.15.106:0/1926557305 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:57.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.249+0000 7f6962600640 1 --2- 172.21.15.106:0/288900651 >> [v2:172.21.15.106:6800/37127,v1:172.21.15.106:6802/37127] conn(0x7f693c06d4b0 0x7f693c06f8c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.250+0000 7f42e0000640 1 -- 172.21.15.106:0/4216781795 shutdown_connections 2024-08-17T02:27:57.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.250+0000 7fd221400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd214006150 0x7fd2140dffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.250+0000 7f2a7ce00640 1 --2- 172.21.15.106:0/1926557305 >> v2:172.21.15.171:3300/0 conn(0x7f2a780ada10 0x7f2a780b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7fd221400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd214038740 0x7fd214051c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.250+0000 7f42e0000640 1 -- 172.21.15.106:0/4216781795 wait complete. 2024-08-17T02:27:57.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7f8e50e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e4c0adfd0 0x7f8e4c0c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.250+0000 7f94c3e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94cc15d830 0x7f94cc0a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.250+0000 7f94ca800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94cc0b0610 0x7f94cc147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.250+0000 7f94ca800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94cc0b0610 0x7f94cc147c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:52308/0 (socket says 172.21.15.106:52308) 2024-08-17T02:27:57.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.250+0000 7f94ca800640 1 -- 172.21.15.106:0/3720436616 learned_addr learned my addr 172.21.15.106:0/3720436616 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:57.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.250+0000 7f94cb200640 1 --2- 172.21.15.106:0/3720436616 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94cc15e310 0x7f94cc16dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7f2a77e00640 1 -- 172.21.15.106:0/1926557305 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 876418899 0 0) 0x7f2a780d0ab0 con 0x7f2a780b36e0 2024-08-17T02:27:57.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7f2a77e00640 1 -- 172.21.15.106:0/1926557305 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a5c0034e0 con 0x7f2a780b36e0 2024-08-17T02:27:57.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7f2a6fe00640 1 --2- 172.21.15.106:0/1926557305 >> v2:172.21.15.106:3300/0 conn(0x7f2a780b1120 0x7f2a780b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7fd221400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2140e6e70 0x7fd21404eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7fd221400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140e04f0 con 0x7fd214006150 2024-08-17T02:27:57.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7f8e4b400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e4c06d7a0 0x7f8e4c165360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7f8e50e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e4c0cc400 0x7f8e4c165cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7f8e4b400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e4c06d7a0 0x7f8e4c165360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56540/0 (socket says 172.21.15.106:56540) 2024-08-17T02:27:57.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7fd21a800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd214006150 0x7fd2140dffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7fd21a800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd214006150 0x7fd2140dffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56552/0 (socket says 172.21.15.106:56552) 2024-08-17T02:27:57.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7fd21a800640 1 -- 172.21.15.106:0/343650550 learned_addr learned my addr 172.21.15.106:0/343650550 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:57.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7f2a77e00640 1 -- 172.21.15.106:0/1926557305 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2637734128 0 0) 0x7f2a5c0034e0 con 0x7f2a780b36e0 2024-08-17T02:27:57.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7f2a77e00640 1 -- 172.21.15.106:0/1926557305 >> v2:172.21.15.171:3300/0 conn(0x7f2a780ada10 msgr2=0x7f2a780b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7f2a77e00640 1 --2- 172.21.15.106:0/1926557305 >> v2:172.21.15.171:3300/0 conn(0x7f2a780ada10 0x7f2a780b2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7f2a77e00640 1 -- 172.21.15.106:0/1926557305 >> v2:172.21.15.106:3300/0 conn(0x7f2a780b1120 msgr2=0x7f2a780b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7f2a77e00640 1 --2- 172.21.15.106:0/1926557305 >> v2:172.21.15.106:3300/0 conn(0x7f2a780b1120 0x7f2a780b31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7f2a77e00640 1 -- 172.21.15.106:0/1926557305 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a780b0640 con 0x7f2a780b36e0 2024-08-17T02:27:57.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7f2a77e00640 1 -- 172.21.15.106:0/1926557305 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7f2a70001470 con 0x7f2a780b36e0 2024-08-17T02:27:57.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7f2a77e00640 1 -- 172.21.15.106:0/1926557305 >> v1:172.21.15.171:6789/0 conn(0x7f2a780b36e0 legacy=0x7f2a780adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7f2a77e00640 1 --2- 172.21.15.106:0/1926557305 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a5c003aa0 0x7f2a5c003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7f2a77e00640 1 --2- 172.21.15.106:0/1926557305 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a5c004780 0x7f2a5c004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7f2a77e00640 1 --2- 172.21.15.106:0/1926557305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a5c005130 0x7f2a5c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7f2a77e00640 1 -- 172.21.15.106:0/1926557305 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a780b00c0 con 0x7f2a5c005130 2024-08-17T02:27:57.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7fb2e8c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2e415d830 0x7fb2e406e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7f2a77e00640 1 -- 172.21.15.106:0/1926557305 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a780b0360 con 0x7f2a5c003aa0 2024-08-17T02:27:57.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7f2a77e00640 1 -- 172.21.15.106:0/1926557305 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c00c0a0 con 0x7f2a5c004780 2024-08-17T02:27:57.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.252+0000 7f6961200640 1 --2- 172.21.15.106:0/288900651 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f693c0652a0 0x7f693c067750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f69540508b0 tx=0x7f6948007c50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.252+0000 7f6958c00640 1 -- 172.21.15.106:0/288900651 <== osd.0 v2:172.21.15.106:6800/37127 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f693c06ff70 con 0x7f693c06d4b0 2024-08-17T02:27:57.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7f8e4b400640 1 -- 172.21.15.106:0/2858097706 learned_addr learned my addr 172.21.15.106:0/2858097706 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:57.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7f8e4aa00640 1 --2- 172.21.15.106:0/2858097706 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e4c0adfd0 0x7f8e4c0c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7f8e4be00640 1 --2- 172.21.15.106:0/2858097706 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e4c0cc400 0x7f8e4c165cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.251+0000 7fd21b200640 1 --2- 172.21.15.106:0/343650550 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2140e6e70 0x7fd21404eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.252+0000 7fd221400640 1 -- 172.21.15.106:0/343650550 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21400a960 con 0x7fd214038740 2024-08-17T02:27:57.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.252+0000 7fd221400640 1 -- 172.21.15.106:0/343650550 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21400c050 con 0x7fd2140e6e70 2024-08-17T02:27:57.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.252+0000 7fb2e8c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb2e415e310 0x7fb2e4166e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.252+0000 7f2a7ce00640 1 --2- 172.21.15.106:0/1926557305 >> v2:172.21.15.171:3300/0 conn(0x7f2a780ada10 0x7f2a780b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:57.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.252+0000 7f8e50e00640 1 -- 172.21.15.106:0/2858097706 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c14e5d0 con 0x7f8e4c06d7a0 2024-08-17T02:27:57.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.252+0000 7f8e50e00640 1 -- 172.21.15.106:0/2858097706 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c0c80e0 con 0x7f8e4c0adfd0 2024-08-17T02:27:57.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.252+0000 7f8e50e00640 1 -- 172.21.15.106:0/2858097706 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c0c83c0 con 0x7f8e4c0cc400 2024-08-17T02:27:57.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.252+0000 7fb2e8c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e40b1690 con 0x7fb2e40b0610 2024-08-17T02:27:57.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.252+0000 7fb2e1400640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fb2e40b0610 0x7fb2e415dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:53850/0 (socket says 172.21.15.106:53850) 2024-08-17T02:27:57.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.252+0000 7fb2e1400640 1 -- 172.21.15.106:0/938634450 learned_addr learned my addr 172.21.15.106:0/938634450 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:57.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.252+0000 7f94ca800640 1 -- 172.21.15.106:0/3720436616 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94cc15d830 msgr2=0x7f94cc0a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.252+0000 7f94ca800640 1 --2- 172.21.15.106:0/3720436616 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94cc15d830 0x7f94cc0a54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.252+0000 7f94ca800640 1 -- 172.21.15.106:0/3720436616 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94cc15e310 msgr2=0x7f94cc16dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.252+0000 7f94ca800640 1 --2- 172.21.15.106:0/3720436616 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94cc15e310 0x7f94cc16dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.252+0000 7f94ca800640 1 -- 172.21.15.106:0/3720436616 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94bc009390 con 0x7f94cc0b0610 2024-08-17T02:27:57.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.252+0000 7f94c3e00640 1 --2- 172.21.15.106:0/3720436616 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94cc15d830 0x7f94cc0a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:57.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.252+0000 7fb2e8c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e40b1b20 con 0x7fb2e415e310 2024-08-17T02:27:57.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.252+0000 7fb2e8c00640 1 -- 172.21.15.106:0/938634450 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e40ae4a0 con 0x7fb2e415d830 2024-08-17T02:27:57.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.252+0000 7f2a7ce00640 1 --2- 172.21.15.106:0/1926557305 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a5c003aa0 0x7f2a5c003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.252+0000 7f2a6fe00640 1 --2- 172.21.15.106:0/1926557305 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a5c004780 0x7f2a5c004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.252+0000 7fb2e0a00640 1 -- 172.21.15.106:0/938634450 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 44145771 0 0) 0x7fb2e40b1690 con 0x7fb2e40b0610 2024-08-17T02:27:57.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.253+0000 7fb2e1e00640 1 --2- 172.21.15.106:0/938634450 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2e415d830 0x7fb2e406e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.252+0000 7fd219e00640 1 --2- 172.21.15.106:0/343650550 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd214038740 0x7fd214051c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.253+0000 7f2a7d800640 1 --2- 172.21.15.106:0/1926557305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a5c005130 0x7f2a5c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.253+0000 7f94ca800640 1 --2- 172.21.15.106:0/3720436616 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94cc0b0610 0x7f94cc147c50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f94bc009880 tx=0x7f94bc032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.253+0000 7f94c2000640 1 -- 172.21.15.106:0/3720436616 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc000d10 con 0x7f94cc0b0610 2024-08-17T02:27:57.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.253+0000 7fb2e2800640 1 --2- 172.21.15.106:0/938634450 >> v2:172.21.15.171:3300/0 conn(0x7fb2e415e310 0x7fb2e4166e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.253+0000 7f2a6fe00640 1 -- 172.21.15.106:0/1926557305 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a5c003aa0 msgr2=0x7f2a5c003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.253+0000 7f2a6fe00640 1 --2- 172.21.15.106:0/1926557305 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a5c003aa0 0x7f2a5c003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.253+0000 7f2a6fe00640 1 -- 172.21.15.106:0/1926557305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a5c005130 msgr2=0x7f2a5c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.253+0000 7f2a6fe00640 1 --2- 172.21.15.106:0/1926557305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a5c005130 0x7f2a5c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.253+0000 7f2a6fe00640 1 -- 172.21.15.106:0/1926557305 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5c0034e0 con 0x7f2a5c004780 2024-08-17T02:27:57.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.253+0000 7f2a7d800640 1 --2- 172.21.15.106:0/1926557305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a5c005130 0x7f2a5c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:57.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.253+0000 7f2a7d800640 1 -- 172.21.15.106:0/1926557305 reap_dead start 2024-08-17T02:27:57.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.253+0000 7f788aa00640 1 -- 172.21.15.106:0/1994677149 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7884043030 con 0x7f78940ada10 2024-08-17T02:27:57.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.254+0000 7f94c2000640 1 -- 172.21.15.106:0/3720436616 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94bc031e00 con 0x7f94cc0b0610 2024-08-17T02:27:57.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.254+0000 7fb2e0a00640 1 -- 172.21.15.106:0/938634450 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2c80034e0 con 0x7fb2e40b0610 2024-08-17T02:27:57.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.254+0000 7f94c2000640 1 -- 172.21.15.106:0/3720436616 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc03d690 con 0x7f94cc0b0610 2024-08-17T02:27:57.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.254+0000 7f94d1400640 1 -- 172.21.15.106:0/3720436616 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94cc159cd0 con 0x7f94cc0b0610 2024-08-17T02:27:57.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.254+0000 7f42e0000640 1 Processor -- start 2024-08-17T02:27:57.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.254+0000 7fb2e2800640 1 -- 172.21.15.106:0/938634450 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2e415d830 msgr2=0x7fb2e406e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.254+0000 7fb2e2800640 1 --2- 172.21.15.106:0/938634450 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2e415d830 0x7fb2e406e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.254+0000 7fb2e2800640 1 -- 172.21.15.106:0/938634450 >> v1:172.21.15.171:6789/0 conn(0x7fb2e40b0610 legacy=0x7fb2e415dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.254+0000 7fb2e2800640 1 -- 172.21.15.106:0/938634450 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e415b200 con 0x7fb2e415e310 2024-08-17T02:27:57.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.254+0000 7f42e0000640 1 -- start start 2024-08-17T02:27:57.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.254+0000 7f94d1400640 1 -- 172.21.15.106:0/3720436616 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94cc158f10 con 0x7f94cc0b0610 2024-08-17T02:27:57.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.253+0000 7f8e4aa00640 1 -- 172.21.15.106:0/2858097706 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e4c0cc400 msgr2=0x7f8e4c165cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.253+0000 7f8e4aa00640 1 --2- 172.21.15.106:0/2858097706 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e4c0cc400 0x7f8e4c165cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.253+0000 7f8e4aa00640 1 -- 172.21.15.106:0/2858097706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e4c06d7a0 msgr2=0x7f8e4c165360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.255+0000 7f788aa00640 1 --2- 172.21.15.106:0/1994677149 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f78740651d0 0x7f7874067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.255+0000 7f8e4aa00640 1 --2- 172.21.15.106:0/2858097706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e4c06d7a0 0x7f8e4c165360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.255+0000 7f8e4aa00640 1 -- 172.21.15.106:0/2858097706 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3800adc0 con 0x7f8e4c0adfd0 2024-08-17T02:27:57.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.253+0000 7fd21a800640 1 -- 172.21.15.106:0/343650550 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2140e6e70 msgr2=0x7fd21404eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.253+0000 7fd21a800640 1 --2- 172.21.15.106:0/343650550 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2140e6e70 0x7fd21404eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.253+0000 7fd21a800640 1 -- 172.21.15.106:0/343650550 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd214038740 msgr2=0x7fd214051c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.253+0000 7fd21a800640 1 --2- 172.21.15.106:0/343650550 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd214038740 0x7fd214051c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.253+0000 7fd21a800640 1 -- 172.21.15.106:0/343650550 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21c065e30 con 0x7fd214006150 2024-08-17T02:27:57.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.255+0000 7f788aa00640 1 -- 172.21.15.106:0/1994677149 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7884041070 con 0x7f78940ada10 2024-08-17T02:27:57.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.255+0000 7f8e4b400640 1 --2- 172.21.15.106:0/2858097706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e4c06d7a0 0x7f8e4c165360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:57.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.255+0000 7f788aa00640 1 --2- 172.21.15.106:0/1994677149 >> [v2:172.21.15.106:6824/37125,v1:172.21.15.106:6825/37125] conn(0x7f787406d3e0 0x7f787406f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.255+0000 7f7892a00640 1 --2- 172.21.15.106:0/1994677149 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f78740651d0 0x7f7874067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.255+0000 7fd21a800640 1 --2- 172.21.15.106:0/343650550 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd214006150 0x7fd2140dffb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00e900 tx=0x7fd20c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.256+0000 7f8e4aa00640 1 --2- 172.21.15.106:0/2858097706 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e4c0adfd0 0x7f8e4c0c78b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c033000 tx=0x7f8e3c037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.256+0000 7f42e0000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f42d80c6a30 0x7f42d8169f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.255+0000 7f2a6fe00640 1 --2- 172.21.15.106:0/1926557305 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a5c004780 0x7f2a5c004bf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2a6000bb00 tx=0x7f2a60008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbb2a2c62af16e9a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.256+0000 7f788aa00640 1 -- 172.21.15.106:0/1994677149 --> [v2:172.21.15.106:6824/37125,v1:172.21.15.106:6825/37125] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f787406fea0 con 0x7f787406d3e0 2024-08-17T02:27:57.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.256+0000 7f788aa00640 1 -- 172.21.15.106:0/1994677149 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78840a7220 con 0x7f78940ada10 2024-08-17T02:27:57.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.256+0000 7f7893e00640 1 --2- 172.21.15.106:0/1994677149 >> [v2:172.21.15.106:6824/37125,v1:172.21.15.106:6825/37125] conn(0x7f787406d3e0 0x7f787406f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.256+0000 7fd212000640 1 -- 172.21.15.106:0/343650550 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c00c8e0 con 0x7fd214006150 2024-08-17T02:27:57.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.256+0000 7fd212000640 1 -- 172.21.15.106:0/343650550 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c00ca40 con 0x7fd214006150 2024-08-17T02:27:57.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.256+0000 7fd212000640 1 -- 172.21.15.106:0/343650550 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c00cde0 con 0x7fd214006150 2024-08-17T02:27:57.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.256+0000 7fd221400640 1 -- 172.21.15.106:0/343650550 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21400a0c0 con 0x7fd214006150 2024-08-17T02:27:57.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.257+0000 7f7893e00640 1 --2- 172.21.15.106:0/1994677149 >> [v2:172.21.15.106:6824/37125,v1:172.21.15.106:6825/37125] conn(0x7f787406d3e0 0x7f787406f7f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.256+0000 7f42e0000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42d8159060 0x7f42d816c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.256+0000 7f42e0000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42d8159430 0x7f42d8099990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.256+0000 7f42e0000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d809c820 con 0x7f42d8159060 2024-08-17T02:27:57.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.256+0000 7f42e0000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d816ce60 con 0x7f42d8159430 2024-08-17T02:27:57.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.256+0000 7f42e0000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d816d130 con 0x7f42d80c6a30 2024-08-17T02:27:57.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.256+0000 7f42de000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42d8159430 0x7f42d8099990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.256+0000 7f42de000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42d8159430 0x7f42d8099990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:58190/0 (socket says 172.21.15.106:58190) 2024-08-17T02:27:57.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.256+0000 7f42de000640 1 -- 172.21.15.106:0/1605116039 learned_addr learned my addr 172.21.15.106:0/1605116039 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:57.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.257+0000 7f42dcc00640 1 --2- 172.21.15.106:0/1605116039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42d8159060 0x7f42d816c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.257+0000 7f42dd600640 1 --2- 172.21.15.106:0/1605116039 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f42d80c6a30 0x7f42d8169f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.256+0000 7f94d1400640 1 -- 172.21.15.106:0/3720436616 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f94cc064db0 con 0x7f94cc0b0610 2024-08-17T02:27:57.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.256+0000 7f2a77e00640 1 -- 172.21.15.106:0/1926557305 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6002ac20 con 0x7f2a5c004780 2024-08-17T02:27:57.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.256+0000 7f2a77e00640 1 -- 172.21.15.106:0/1926557305 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6002e070 con 0x7f2a5c004780 2024-08-17T02:27:57.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.256+0000 7f2a77e00640 1 -- 172.21.15.106:0/1926557305 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a60034400 con 0x7f2a5c004780 2024-08-17T02:27:57.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.257+0000 7f2a7f800640 1 -- 172.21.15.106:0/1926557305 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a5c004780 msgr2=0x7f2a5c004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.257+0000 7f2a7f800640 1 --2- 172.21.15.106:0/1926557305 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a5c004780 0x7f2a5c004bf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2a6000bb00 tx=0x7f2a60008040 comp rx=0 tx=0).stop 2024-08-17T02:27:57.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.258+0000 7f2a7f800640 1 -- 172.21.15.106:0/1926557305 shutdown_connections 2024-08-17T02:27:57.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.257+0000 7f42dcc00640 1 -- 172.21.15.106:0/1605116039 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f42d80c6a30 msgr2=0x7f42d8169f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.258+0000 7f2a7f800640 1 --2- 172.21.15.106:0/1926557305 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a5c004780 0x7f2a5c004bf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.258+0000 7fb2e2800640 1 --2- 172.21.15.106:0/938634450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2e415e310 0x7fb2e4166e50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc009e60 tx=0x7fb2dc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1737ed39d48f9a3c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.258+0000 7f2a7f800640 1 -- 172.21.15.106:0/1926557305 >> 172.21.15.106:0/1926557305 conn(0x7f2a780cfdf0 msgr2=0x7f2a780d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.257+0000 7f42dcc00640 1 --2- 172.21.15.106:0/1605116039 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f42d80c6a30 0x7f42d8169f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.258+0000 7f2a7f800640 1 -- 172.21.15.106:0/1926557305 shutdown_connections 2024-08-17T02:27:57.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.258+0000 7f7892a00640 1 --2- 172.21.15.106:0/1994677149 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f78740651d0 0x7f7874067680 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7894154ae0 tx=0x7f7880007d10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.257+0000 7f42dcc00640 1 -- 172.21.15.106:0/1605116039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42d8159430 msgr2=0x7f42d8099990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.257+0000 7f42dcc00640 1 --2- 172.21.15.106:0/1605116039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42d8159430 0x7f42d8099990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.257+0000 7f42dcc00640 1 -- 172.21.15.106:0/1605116039 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c4009450 con 0x7f42d8159060 2024-08-17T02:27:57.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.258+0000 7fb2e0a00640 1 -- 172.21.15.106:0/938634450 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc007550 con 0x7fb2e415e310 2024-08-17T02:27:57.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.258+0000 7fb2e0a00640 1 -- 172.21.15.106:0/938634450 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2dc02d050 con 0x7fb2e415e310 2024-08-17T02:27:57.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.258+0000 7f2a7f800640 1 -- 172.21.15.106:0/1926557305 wait complete. 2024-08-17T02:27:57.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.259+0000 7f788aa00640 1 -- 172.21.15.106:0/1994677149 <== osd.1 v2:172.21.15.106:6824/37125 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f787406fea0 con 0x7f787406d3e0 2024-08-17T02:27:57.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.259+0000 7f8e42a00640 1 -- 172.21.15.106:0/2858097706 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c0338e0 con 0x7f8e4c0adfd0 2024-08-17T02:27:57.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.259+0000 7f8e42a00640 1 -- 172.21.15.106:0/2858097706 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c033a80 con 0x7f8e4c0adfd0 2024-08-17T02:27:57.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.259+0000 7f8e42a00640 1 -- 172.21.15.106:0/2858097706 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c033e40 con 0x7f8e4c0adfd0 2024-08-17T02:27:57.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.256+0000 7fd221400640 1 -- 172.21.15.106:0/343650550 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd21400a680 con 0x7fd214006150 2024-08-17T02:27:57.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.257+0000 7fd221400640 1 -- 172.21.15.106:0/343650550 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd214005320 con 0x7fd214006150 2024-08-17T02:27:57.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.258+0000 7fb2e0a00640 1 -- 172.21.15.106:0/938634450 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc007920 con 0x7fb2e415e310 2024-08-17T02:27:57.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.259+0000 7f42dcc00640 1 --2- 172.21.15.106:0/1605116039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42d8159060 0x7f42d816c920 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f42d80c6e20 tx=0x7f42cc007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.260+0000 7f8e50e00640 1 -- 172.21.15.106:0/2858097706 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3c009450 con 0x7f8e4c0adfd0 2024-08-17T02:27:57.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.260+0000 7f8e50e00640 1 -- 172.21.15.106:0/2858097706 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4c0c8980 con 0x7f8e4c0adfd0 2024-08-17T02:27:57.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.259+0000 7f94c2000640 1 -- 172.21.15.106:0/3720436616 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f94bc039040 con 0x7f94cc0b0610 2024-08-17T02:27:57.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.260+0000 7f94c2000640 1 --2- 172.21.15.106:0/3720436616 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f94a8065220 0x7f94a80676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.260+0000 7f42d4c00640 1 -- 172.21.15.106:0/1605116039 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc011590 con 0x7f42d8159060 2024-08-17T02:27:57.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.260+0000 7f42d4c00640 1 -- 172.21.15.106:0/1605116039 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42cc0116f0 con 0x7f42d8159060 2024-08-17T02:27:57.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.261+0000 7f2a7f800640 1 Processor -- start 2024-08-17T02:27:57.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.261+0000 7f42e0000640 1 -- 172.21.15.106:0/1605116039 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d816d410 con 0x7f42d8159060 2024-08-17T02:27:57.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.261+0000 7f2a7f800640 1 -- start start 2024-08-17T02:27:57.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.260+0000 7fd212000640 1 -- 172.21.15.106:0/343650550 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd20c038970 con 0x7fd214006150 2024-08-17T02:27:57.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.261+0000 7f8e50e00640 1 -- 172.21.15.106:0/2858097706 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8e4c071050 con 0x7f8e4c0adfd0 2024-08-17T02:27:57.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.261+0000 7fd212000640 1 --2- 172.21.15.106:0/343650550 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd1fc065220 0x7fd1fc0676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.261+0000 7f94c2000640 1 -- 172.21.15.106:0/3720436616 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f94bc0a2e60 con 0x7f94cc0b0610 2024-08-17T02:27:57.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.261+0000 7f94c2000640 1 --2- 172.21.15.106:0/3720436616 >> [v2:172.21.15.171:6800/37334,v1:172.21.15.171:6801/37334] conn(0x7f94a806d2c0 0x7f94a806f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.261+0000 7f94c3e00640 1 --2- 172.21.15.106:0/3720436616 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f94a8065220 0x7f94a80676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.261+0000 7f42d4c00640 1 -- 172.21.15.106:0/1605116039 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc011a90 con 0x7f42d8159060 2024-08-17T02:27:57.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.262+0000 7fd212000640 1 -- 172.21.15.106:0/343650550 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd20c082640 con 0x7fd214006150 2024-08-17T02:27:57.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.262+0000 7fb2e8c00640 1 -- 172.21.15.106:0/938634450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2e415e310 msgr2=0x7fb2e4166e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.262+0000 7fb2e8c00640 1 --2- 172.21.15.106:0/938634450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2e415e310 0x7fb2e4166e50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc009e60 tx=0x7fb2dc009780 comp rx=0 tx=0).stop 2024-08-17T02:27:57.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.262+0000 7fd219e00640 1 --2- 172.21.15.106:0/343650550 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd1fc065220 0x7fd1fc0676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.262+0000 7fd212000640 1 --2- 172.21.15.106:0/343650550 >> [v2:172.21.15.106:6801/37124,v1:172.21.15.106:6803/37124] conn(0x7fd1fc06d430 0x7fd1fc06f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.262+0000 7f94c2000640 1 -- 172.21.15.106:0/3720436616 --> [v2:172.21.15.171:6800/37334,v1:172.21.15.171:6801/37334] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f94a806fd80 con 0x7f94a806d2c0 2024-08-17T02:27:57.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.262+0000 7f94c2000640 1 -- 172.21.15.106:0/3720436616 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94bc0a3230 con 0x7f94cc0b0610 2024-08-17T02:27:57.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.262+0000 7f94cb200640 1 --2- 172.21.15.106:0/3720436616 >> [v2:172.21.15.171:6800/37334,v1:172.21.15.171:6801/37334] conn(0x7f94a806d2c0 0x7f94a806f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.262+0000 7fd212000640 1 -- 172.21.15.106:0/343650550 --> [v2:172.21.15.106:6801/37124,v1:172.21.15.106:6803/37124] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd1fc06fef0 con 0x7fd1fc06d430 2024-08-17T02:27:57.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.262+0000 7fd212000640 1 -- 172.21.15.106:0/343650550 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd20c050870 con 0x7fd214006150 2024-08-17T02:27:57.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.262+0000 7fd21b200640 1 --2- 172.21.15.106:0/343650550 >> [v2:172.21.15.106:6801/37124,v1:172.21.15.106:6803/37124] conn(0x7fd1fc06d430 0x7fd1fc06f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.263+0000 7f2a7f800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a5c004780 0x7f2a7816dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.263+0000 7f42e0000640 1 -- 172.21.15.106:0/1605116039 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d8099ed0 con 0x7f42d8159060 2024-08-17T02:27:57.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.263+0000 7f2a7f800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a7815bed0 0x7f2a781528a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.263+0000 7f2a7f800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a780adde0 0x7f2a780ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.263+0000 7f2a7f800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a780ae790 con 0x7f2a7815bed0 2024-08-17T02:27:57.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.263+0000 7f2a7f800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7816da40 con 0x7f2a5c004780 2024-08-17T02:27:57.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.263+0000 7f2a7f800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7816ce30 con 0x7f2a780adde0 2024-08-17T02:27:57.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.263+0000 7fd21b200640 1 --2- 172.21.15.106:0/343650550 >> [v2:172.21.15.106:6801/37124,v1:172.21.15.106:6803/37124] conn(0x7fd1fc06d430 0x7fd1fc06f840 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.263+0000 7fb2e8c00640 1 -- 172.21.15.106:0/938634450 shutdown_connections 2024-08-17T02:27:57.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.264+0000 7fb2e8c00640 1 --2- 172.21.15.106:0/938634450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2e415e310 0x7fb2e4166e50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.264+0000 7fb2e8c00640 1 --2- 172.21.15.106:0/938634450 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2e415d830 0x7fb2e406e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.264+0000 7fb2e8c00640 1 -- 172.21.15.106:0/938634450 >> 172.21.15.106:0/938634450 conn(0x7fb2e40cb9b0 msgr2=0x7fb2e40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.264+0000 7f2a7d800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a780adde0 0x7f2a780ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.264+0000 7f2a7d800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a780adde0 0x7f2a780ae250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:52356/0 (socket says 172.21.15.106:52356) 2024-08-17T02:27:57.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.264+0000 7f2a7d800640 1 -- 172.21.15.106:0/3469617775 learned_addr learned my addr 172.21.15.106:0/3469617775 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:57.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.263+0000 7f8e42a00640 1 -- 172.21.15.106:0/2858097706 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8e3c03d620 con 0x7f8e4c0adfd0 2024-08-17T02:27:57.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.264+0000 7f94c3e00640 1 --2- 172.21.15.106:0/3720436616 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f94a8065220 0x7f94a80676d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f94cc15abd0 tx=0x7f94b4007cf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.264+0000 7f2a7ce00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a5c004780 0x7f2a7816dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.264+0000 7f2a7d800640 1 -- 172.21.15.106:0/3469617775 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a5c004780 msgr2=0x7f2a7816dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.264+0000 7f94cb200640 1 --2- 172.21.15.106:0/3720436616 >> [v2:172.21.15.171:6800/37334,v1:172.21.15.171:6801/37334] conn(0x7f94a806d2c0 0x7f94a806f6d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.264+0000 7f2a7d800640 1 --2- 172.21.15.106:0/3469617775 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a5c004780 0x7f2a7816dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.264+0000 7f2a7d800640 1 -- 172.21.15.106:0/3469617775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a7815bed0 msgr2=0x7f2a781528a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:27:57.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.264+0000 7f2a7ce00640 1 --2- 172.21.15.106:0/3469617775 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a5c004780 0x7f2a7816dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:57.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.265+0000 7fd219e00640 1 --2- 172.21.15.106:0/343650550 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd1fc065220 0x7fd1fc0676d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd2140581c0 tx=0x7fd208000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.265+0000 7fd212000640 1 -- 172.21.15.106:0/343650550 <== osd.3 v2:172.21.15.106:6801/37124 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fd1fc06fef0 con 0x7fd1fc06d430 2024-08-17T02:27:57.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.265+0000 7f42e0000640 1 -- 172.21.15.106:0/1605116039 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f42d80891e0 con 0x7f42d8159060 2024-08-17T02:27:57.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.265+0000 7f8e42a00640 1 --2- 172.21.15.106:0/2858097706 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8e2c0696b0 0x7f8e2c06bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.265+0000 7f8e42a00640 1 -- 172.21.15.106:0/2858097706 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8e3c0a2970 con 0x7f8e4c0adfd0 2024-08-17T02:27:57.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.265+0000 7f8e42a00640 1 --2- 172.21.15.106:0/2858097706 >> [v2:172.21.15.106:6816/37126,v1:172.21.15.106:6817/37126] conn(0x7f8e2c0718c0 0x7f8e2c073cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.265+0000 7f8e42a00640 1 -- 172.21.15.106:0/2858097706 --> [v2:172.21.15.106:6816/37126,v1:172.21.15.106:6817/37126] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8e2c074380 con 0x7f8e2c0718c0 2024-08-17T02:27:57.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.265+0000 7f94c2000640 1 -- 172.21.15.106:0/3720436616 <== osd.5 v2:172.21.15.171:6800/37334 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f94a806fd80 con 0x7f94a806d2c0 2024-08-17T02:27:57.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.265+0000 7f8e42a00640 1 -- 172.21.15.106:0/2858097706 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e3c0a7220 con 0x7f8e4c0adfd0 2024-08-17T02:27:57.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.265+0000 7fb2e8c00640 1 -- 172.21.15.106:0/938634450 shutdown_connections 2024-08-17T02:27:57.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.266+0000 7fb2e8c00640 1 -- 172.21.15.106:0/938634450 wait complete. 2024-08-17T02:27:57.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.266+0000 7f8e4b400640 1 --2- 172.21.15.106:0/2858097706 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8e2c0696b0 0x7f8e2c06bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.266+0000 7f8e4be00640 1 --2- 172.21.15.106:0/2858097706 >> [v2:172.21.15.106:6816/37126,v1:172.21.15.106:6817/37126] conn(0x7f8e2c0718c0 0x7f8e2c073cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.265+0000 7f2a7d800640 1 --2- 172.21.15.106:0/3469617775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a7815bed0 0x7f2a781528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.265+0000 7f2a7d800640 1 -- 172.21.15.106:0/3469617775 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7816d110 con 0x7f2a780adde0 2024-08-17T02:27:57.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.266+0000 7f2a7d800640 1 --2- 172.21.15.106:0/3469617775 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a780adde0 0x7f2a780ae250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2a78089990 tx=0x7f2a700014e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.268+0000 7fb2e8c00640 1 Processor -- start 2024-08-17T02:27:57.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.267+0000 7f8e4b400640 1 --2- 172.21.15.106:0/2858097706 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8e2c0696b0 0x7f8e2c06bb60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c157010 tx=0x7f8e3800c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.267+0000 7f8e4be00640 1 --2- 172.21.15.106:0/2858097706 >> [v2:172.21.15.106:6816/37126,v1:172.21.15.106:6817/37126] conn(0x7f8e2c0718c0 0x7f8e2c073cd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.268+0000 7f2a74c00640 1 -- 172.21.15.106:0/3469617775 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7000ee70 con 0x7f2a780adde0 2024-08-17T02:27:57.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.269+0000 7f8e42a00640 1 -- 172.21.15.106:0/2858097706 <== osd.2 v2:172.21.15.106:6816/37126 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f8e2c074380 con 0x7f8e2c0718c0 2024-08-17T02:27:57.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.268+0000 7f2a74c00640 1 -- 172.21.15.106:0/3469617775 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a70014430 con 0x7f2a780adde0 2024-08-17T02:27:57.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.268+0000 7f2a7f800640 1 -- 172.21.15.106:0/3469617775 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a7816d3f0 con 0x7f2a780adde0 2024-08-17T02:27:57.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.269+0000 7f2a7f800640 1 -- 172.21.15.106:0/3469617775 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a7816cb20 con 0x7f2a780adde0 2024-08-17T02:27:57.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.269+0000 7f2a74c00640 1 -- 172.21.15.106:0/3469617775 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a700147f0 con 0x7f2a780adde0 2024-08-17T02:27:57.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.268+0000 7f42d4c00640 1 -- 172.21.15.106:0/1605116039 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f42cc01b3b0 con 0x7f42d8159060 2024-08-17T02:27:57.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.271+0000 7f42d4c00640 1 --2- 172.21.15.106:0/1605116039 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f42b8065220 0x7f42b80676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.272+0000 7f2a7f800640 1 -- 172.21.15.106:0/3469617775 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2a50000fd0 con 0x7f2a780adde0 2024-08-17T02:27:57.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.268+0000 7fb2e8c00640 1 -- start start 2024-08-17T02:27:57.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.270+0000 7fb2e8c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2e40b0610 0x7fb2e41617f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.270+0000 7fb2e8c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2e415d830 0x7fb2e4149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.270+0000 7fb2e8c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2e415e310 0x7fb2e4162c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.270+0000 7fb2e8c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e4162020 con 0x7fb2e415d830 2024-08-17T02:27:57.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.270+0000 7fb2e8c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e4170a20 con 0x7fb2e40b0610 2024-08-17T02:27:57.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.270+0000 7fb2e8c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e4170d00 con 0x7fb2e415e310 2024-08-17T02:27:57.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.270+0000 7fb2e1e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2e40b0610 0x7fb2e41617f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.270+0000 7fb2e1e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2e40b0610 0x7fb2e41617f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:58210/0 (socket says 172.21.15.106:58210) 2024-08-17T02:27:57.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.270+0000 7fb2e1e00640 1 -- 172.21.15.106:0/938736613 learned_addr learned my addr 172.21.15.106:0/938736613 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:57.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.271+0000 7fb2e1e00640 1 -- 172.21.15.106:0/938736613 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2e415e310 msgr2=0x7fb2e4162c00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:27:57.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.271+0000 7fb2e1e00640 1 --2- 172.21.15.106:0/938736613 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2e415e310 0x7fb2e4162c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.271+0000 7fb2e1e00640 1 -- 172.21.15.106:0/938736613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2e415d830 msgr2=0x7fb2e4149a40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:27:57.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.271+0000 7fb2e1e00640 1 --2- 172.21.15.106:0/938736613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2e415d830 0x7fb2e4149a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.271+0000 7fb2e1e00640 1 -- 172.21.15.106:0/938736613 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2dc009a20 con 0x7fb2e40b0610 2024-08-17T02:27:57.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.271+0000 7fb2e1e00640 1 --2- 172.21.15.106:0/938736613 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2e40b0610 0x7fb2e41617f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb2d000ea20 tx=0x7fb2d00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.271+0000 7f42d4c00640 1 -- 172.21.15.106:0/1605116039 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f42cc081570 con 0x7f42d8159060 2024-08-17T02:27:57.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.272+0000 7f42dd600640 1 --2- 172.21.15.106:0/1605116039 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f42b8065220 0x7f42b80676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.272+0000 7fb2d9600640 1 -- 172.21.15.106:0/938736613 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d000ca10 con 0x7fb2e40b0610 2024-08-17T02:27:57.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.272+0000 7fb2d9600640 1 -- 172.21.15.106:0/938736613 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d000cb70 con 0x7fb2e40b0610 2024-08-17T02:27:57.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.272+0000 7fb2d9600640 1 -- 172.21.15.106:0/938736613 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0013470 con 0x7fb2e40b0610 2024-08-17T02:27:57.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.272+0000 7f2a74c00640 1 -- 172.21.15.106:0/3469617775 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2a70014ba0 con 0x7f2a780adde0 2024-08-17T02:27:57.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.273+0000 7fb2e8c00640 1 -- 172.21.15.106:0/938736613 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e4170fe0 con 0x7fb2e40b0610 2024-08-17T02:27:57.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.274+0000 7fb2e8c00640 1 -- 172.21.15.106:0/938736613 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e4161d30 con 0x7fb2e40b0610 2024-08-17T02:27:57.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.274+0000 7f2a74c00640 1 --2- 172.21.15.106:0/3469617775 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2a540652a0 0x7f2a54067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.274+0000 7f2a74c00640 1 -- 172.21.15.106:0/3469617775 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2a70081600 con 0x7f2a780adde0 2024-08-17T02:27:57.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.273+0000 7f42d4c00640 1 --2- 172.21.15.106:0/1605116039 >> [v2:172.21.15.171:6816/37336,v1:172.21.15.171:6817/37336] conn(0x7f42b806d430 0x7f42b806f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.274+0000 7f42d4c00640 1 -- 172.21.15.106:0/1605116039 --> [v2:172.21.15.171:6816/37336,v1:172.21.15.171:6817/37336] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f42b806fef0 con 0x7f42b806d430 2024-08-17T02:27:57.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.274+0000 7f2a74c00640 1 --2- 172.21.15.106:0/3469617775 >> [v2:172.21.15.171:6808/37335,v1:172.21.15.171:6809/37335] conn(0x7f2a5406d430 0x7f2a5406f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.274+0000 7f2a7ce00640 1 --2- 172.21.15.106:0/3469617775 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2a540652a0 0x7f2a54067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.274+0000 7f2a74c00640 1 -- 172.21.15.106:0/3469617775 --> [v2:172.21.15.171:6808/37335,v1:172.21.15.171:6809/37335] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2a5406fef0 con 0x7f2a5406d430 2024-08-17T02:27:57.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.274+0000 7f2a74c00640 1 -- 172.21.15.106:0/3469617775 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a7004f6a0 con 0x7f2a780adde0 2024-08-17T02:27:57.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.274+0000 7f42d4c00640 1 -- 172.21.15.106:0/1605116039 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42cc0817b0 con 0x7f42d8159060 2024-08-17T02:27:57.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.275+0000 7f42de000640 1 --2- 172.21.15.106:0/1605116039 >> [v2:172.21.15.171:6816/37336,v1:172.21.15.171:6817/37336] conn(0x7f42b806d430 0x7f42b806f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.275+0000 7f42dd600640 1 --2- 172.21.15.106:0/1605116039 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f42b8065220 0x7f42b80676d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f42c4034000 tx=0x7f42c4032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.275+0000 7f2a6fe00640 1 --2- 172.21.15.106:0/3469617775 >> [v2:172.21.15.171:6808/37335,v1:172.21.15.171:6809/37335] conn(0x7f2a5406d430 0x7f2a5406f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.275+0000 7f2a7ce00640 1 --2- 172.21.15.106:0/3469617775 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2a540652a0 0x7f2a54067750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2a680094d0 tx=0x7f2a68009780 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.276+0000 7fb2e8c00640 1 -- 172.21.15.106:0/938736613 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb2e4064db0 con 0x7fb2e40b0610 2024-08-17T02:27:57.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.276+0000 7f42de000640 1 --2- 172.21.15.106:0/1605116039 >> [v2:172.21.15.171:6816/37336,v1:172.21.15.171:6817/37336] conn(0x7f42b806d430 0x7f42b806f840 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.277+0000 7f6963000640 1 -- 172.21.15.106:0/288900651 --> [v2:172.21.15.106:6800/37127,v1:172.21.15.106:6802/37127] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f69540393c0 con 0x7f693c06d4b0 2024-08-17T02:27:57.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.276+0000 7f2a6fe00640 1 --2- 172.21.15.106:0/3469617775 >> [v2:172.21.15.171:6808/37335,v1:172.21.15.171:6809/37335] conn(0x7f2a5406d430 0x7f2a5406f840 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.277+0000 7f2a74c00640 1 -- 172.21.15.106:0/3469617775 <== osd.7 v2:172.21.15.171:6808/37335 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f2a5406fef0 con 0x7f2a5406d430 2024-08-17T02:27:57.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.277+0000 7f6958c00640 1 -- 172.21.15.106:0/288900651 <== osd.0 v2:172.21.15.106:6800/37127 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f69540393c0 con 0x7f693c06d4b0 2024-08-17T02:27:57.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.277+0000 7f42d4c00640 1 -- 172.21.15.106:0/1605116039 <== osd.4 v2:172.21.15.171:6816/37336 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f42b806fef0 con 0x7f42b806d430 2024-08-17T02:27:57.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.278+0000 7fb2d9600640 1 -- 172.21.15.106:0/938736613 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb2d0013820 con 0x7fb2e40b0610 2024-08-17T02:27:57.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.278+0000 7f6963000640 1 -- 172.21.15.106:0/288900651 >> [v2:172.21.15.106:6800/37127,v1:172.21.15.106:6802/37127] conn(0x7f693c06d4b0 msgr2=0x7f693c06f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.278+0000 7f6963000640 1 --2- 172.21.15.106:0/288900651 >> [v2:172.21.15.106:6800/37127,v1:172.21.15.106:6802/37127] conn(0x7f693c06d4b0 0x7f693c06f8c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.279+0000 7f6963000640 1 -- 172.21.15.106:0/288900651 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f693c0652a0 msgr2=0x7f693c067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.279+0000 7f6963000640 1 --2- 172.21.15.106:0/288900651 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f693c0652a0 0x7f693c067750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f69540508b0 tx=0x7f6948007c50 comp rx=0 tx=0).stop 2024-08-17T02:27:57.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.279+0000 7f6963000640 1 -- 172.21.15.106:0/288900651 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f695404f1d0 msgr2=0x7f6954101fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.279+0000 7f6963000640 1 --2- 172.21.15.106:0/288900651 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f695404f1d0 0x7f6954101fe0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f695000b5e0 tx=0x7f6950009060 comp rx=0 tx=0).stop 2024-08-17T02:27:57.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.279+0000 7f6962600640 1 -- 172.21.15.106:0/288900651 reap_dead start 2024-08-17T02:27:57.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.279+0000 7f6963000640 1 -- 172.21.15.106:0/288900651 shutdown_connections 2024-08-17T02:27:57.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.279+0000 7f6963000640 1 -- 172.21.15.106:0/288900651 >> 172.21.15.106:0/288900651 conn(0x7f6954051600 msgr2=0x7f695404a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.279+0000 7f6963000640 1 -- 172.21.15.106:0/288900651 shutdown_connections 2024-08-17T02:27:57.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.280+0000 7f6963000640 1 -- 172.21.15.106:0/288900651 wait complete. 2024-08-17T02:27:57.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.280+0000 7fb2d9600640 1 --2- 172.21.15.106:0/938736613 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb2c40652a0 0x7fb2c4067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.280+0000 7fb2e1400640 1 --2- 172.21.15.106:0/938736613 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb2c40652a0 0x7fb2c4067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.280+0000 7fb2d9600640 1 -- 172.21.15.106:0/938736613 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb2d0082780 con 0x7fb2e40b0610 2024-08-17T02:27:57.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.280+0000 7fb2d9600640 1 --2- 172.21.15.106:0/938736613 >> [v2:172.21.15.171:6824/37356,v1:172.21.15.171:6825/37356] conn(0x7fb2c406d430 0x7fb2c406f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.281+0000 7fb2d9600640 1 -- 172.21.15.106:0/938736613 --> [v2:172.21.15.171:6824/37356,v1:172.21.15.171:6825/37356] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb2c406fef0 con 0x7fb2c406d430 2024-08-17T02:27:57.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.281+0000 7fb2d9600640 1 -- 172.21.15.106:0/938736613 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2d000eee0 con 0x7fb2e40b0610 2024-08-17T02:27:57.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.281+0000 7fb2e2800640 1 --2- 172.21.15.106:0/938736613 >> [v2:172.21.15.171:6824/37356,v1:172.21.15.171:6825/37356] conn(0x7fb2c406d430 0x7fb2c406f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.282+0000 7fb2e2800640 1 --2- 172.21.15.106:0/938736613 >> [v2:172.21.15.171:6824/37356,v1:172.21.15.171:6825/37356] conn(0x7fb2c406d430 0x7fb2c406f840 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.282+0000 7fb2e1400640 1 --2- 172.21.15.106:0/938736613 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb2c40652a0 0x7fb2c4067750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4005840 tx=0x7fb2d4007940 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.284+0000 7fd221400640 1 -- 172.21.15.106:0/343650550 --> [v2:172.21.15.106:6801/37124,v1:172.21.15.106:6803/37124] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd21400beb0 con 0x7fd1fc06d430 2024-08-17T02:27:57.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.284+0000 7fb2d9600640 1 -- 172.21.15.106:0/938736613 <== osd.6 v2:172.21.15.171:6824/37356 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fb2c406fef0 con 0x7fb2c406d430 2024-08-17T02:27:57.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.285+0000 7fd212000640 1 -- 172.21.15.106:0/343650550 <== osd.3 v2:172.21.15.106:6801/37124 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd21400beb0 con 0x7fd1fc06d430 2024-08-17T02:27:57.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.285+0000 7fd221400640 1 -- 172.21.15.106:0/343650550 >> [v2:172.21.15.106:6801/37124,v1:172.21.15.106:6803/37124] conn(0x7fd1fc06d430 msgr2=0x7fd1fc06f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.285+0000 7fd221400640 1 --2- 172.21.15.106:0/343650550 >> [v2:172.21.15.106:6801/37124,v1:172.21.15.106:6803/37124] conn(0x7fd1fc06d430 0x7fd1fc06f840 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.285+0000 7fd221400640 1 -- 172.21.15.106:0/343650550 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd1fc065220 msgr2=0x7fd1fc0676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.286+0000 7fd221400640 1 --2- 172.21.15.106:0/343650550 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd1fc065220 0x7fd1fc0676d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd2140581c0 tx=0x7fd208000bc0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.286+0000 7fd221400640 1 -- 172.21.15.106:0/343650550 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd214006150 msgr2=0x7fd2140dffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.286+0000 7fd221400640 1 --2- 172.21.15.106:0/343650550 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd214006150 0x7fd2140dffb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00e900 tx=0x7fd20c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.286+0000 7fd21b200640 1 -- 172.21.15.106:0/343650550 reap_dead start 2024-08-17T02:27:57.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.286+0000 7fd221400640 1 -- 172.21.15.106:0/343650550 shutdown_connections 2024-08-17T02:27:57.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.286+0000 7fd221400640 1 -- 172.21.15.106:0/343650550 >> 172.21.15.106:0/343650550 conn(0x7fd21400f070 msgr2=0x7fd214038030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.287+0000 7fd221400640 1 -- 172.21.15.106:0/343650550 shutdown_connections 2024-08-17T02:27:57.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.287+0000 7fd221400640 1 -- 172.21.15.106:0/343650550 wait complete. 2024-08-17T02:27:57.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.295+0000 7f94d1400640 1 -- 172.21.15.106:0/3720436616 --> [v2:172.21.15.171:6800/37334,v1:172.21.15.171:6801/37334] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f94cc06cf70 con 0x7f94a806d2c0 2024-08-17T02:27:57.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.296+0000 7f789a400640 1 -- 172.21.15.106:0/1994677149 --> [v2:172.21.15.106:6824/37125,v1:172.21.15.106:6825/37125] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7894070430 con 0x7f787406d3e0 2024-08-17T02:27:57.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.296+0000 7f788aa00640 1 -- 172.21.15.106:0/1994677149 <== osd.1 v2:172.21.15.106:6824/37125 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7894070430 con 0x7f787406d3e0 2024-08-17T02:27:57.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.297+0000 7f94c2000640 1 -- 172.21.15.106:0/3720436616 <== osd.5 v2:172.21.15.171:6800/37334 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f94cc06cf70 con 0x7f94a806d2c0 2024-08-17T02:27:57.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.297+0000 7f94d1400640 1 -- 172.21.15.106:0/3720436616 >> [v2:172.21.15.171:6800/37334,v1:172.21.15.171:6801/37334] conn(0x7f94a806d2c0 msgr2=0x7f94a806f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.297+0000 7f94d1400640 1 --2- 172.21.15.106:0/3720436616 >> [v2:172.21.15.171:6800/37334,v1:172.21.15.171:6801/37334] conn(0x7f94a806d2c0 0x7f94a806f6d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.297+0000 7f94d1400640 1 -- 172.21.15.106:0/3720436616 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f94a8065220 msgr2=0x7f94a80676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.297+0000 7f94d1400640 1 --2- 172.21.15.106:0/3720436616 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f94a8065220 0x7f94a80676d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f94cc15abd0 tx=0x7f94b4007cf0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.297+0000 7f94d1400640 1 -- 172.21.15.106:0/3720436616 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94cc0b0610 msgr2=0x7f94cc147c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.298+0000 7f94d1400640 1 --2- 172.21.15.106:0/3720436616 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f94cc0b0610 0x7f94cc147c50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f94bc009880 tx=0x7f94bc032000 comp rx=0 tx=0).stop 2024-08-17T02:27:57.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.298+0000 7f94cb200640 1 -- 172.21.15.106:0/3720436616 reap_dead start 2024-08-17T02:27:57.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.298+0000 7f94d1400640 1 -- 172.21.15.106:0/3720436616 shutdown_connections 2024-08-17T02:27:57.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.298+0000 7f94d1400640 1 -- 172.21.15.106:0/3720436616 >> 172.21.15.106:0/3720436616 conn(0x7f94cc0cb9b0 msgr2=0x7f94cc06d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.298+0000 7f8e50e00640 1 -- 172.21.15.106:0/2858097706 --> [v2:172.21.15.106:6816/37126,v1:172.21.15.106:6817/37126] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8e4c0c8500 con 0x7f8e2c0718c0 2024-08-17T02:27:57.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.298+0000 7f789a400640 1 -- 172.21.15.106:0/1994677149 >> [v2:172.21.15.106:6824/37125,v1:172.21.15.106:6825/37125] conn(0x7f787406d3e0 msgr2=0x7f787406f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.298+0000 7f789a400640 1 --2- 172.21.15.106:0/1994677149 >> [v2:172.21.15.106:6824/37125,v1:172.21.15.106:6825/37125] conn(0x7f787406d3e0 0x7f787406f7f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.299+0000 7f8e42a00640 1 -- 172.21.15.106:0/2858097706 <== osd.2 v2:172.21.15.106:6816/37126 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8e4c0c8500 con 0x7f8e2c0718c0 2024-08-17T02:27:57.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.299+0000 7f789a400640 1 -- 172.21.15.106:0/1994677149 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f78740651d0 msgr2=0x7f7874067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.299+0000 7f789a400640 1 --2- 172.21.15.106:0/1994677149 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f78740651d0 0x7f7874067680 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7894154ae0 tx=0x7f7880007d10 comp rx=0 tx=0).stop 2024-08-17T02:27:57.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.299+0000 7f789a400640 1 -- 172.21.15.106:0/1994677149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78940ada10 msgr2=0x7f789416e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.299+0000 7f789a400640 1 --2- 172.21.15.106:0/1994677149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78940ada10 0x7f789416e5e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7884035040 tx=0x7f7884032000 comp rx=0 tx=0).stop 2024-08-17T02:27:57.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.300+0000 7f7893e00640 1 -- 172.21.15.106:0/1994677149 reap_dead start 2024-08-17T02:27:57.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.300+0000 7f789a400640 1 -- 172.21.15.106:0/1994677149 shutdown_connections 2024-08-17T02:27:57.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.300+0000 7f789a400640 1 -- 172.21.15.106:0/1994677149 >> 172.21.15.106:0/1994677149 conn(0x7f78940cfdf0 msgr2=0x7f78940cf530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.300+0000 7f8e50e00640 1 -- 172.21.15.106:0/2858097706 >> [v2:172.21.15.106:6816/37126,v1:172.21.15.106:6817/37126] conn(0x7f8e2c0718c0 msgr2=0x7f8e2c073cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.300+0000 7f789a400640 1 -- 172.21.15.106:0/1994677149 shutdown_connections 2024-08-17T02:27:57.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.300+0000 7f789a400640 1 -- 172.21.15.106:0/1994677149 wait complete. 2024-08-17T02:27:57.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.300+0000 7f8e50e00640 1 --2- 172.21.15.106:0/2858097706 >> [v2:172.21.15.106:6816/37126,v1:172.21.15.106:6817/37126] conn(0x7f8e2c0718c0 0x7f8e2c073cd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.300+0000 7f8e50e00640 1 -- 172.21.15.106:0/2858097706 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8e2c0696b0 msgr2=0x7f8e2c06bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.300+0000 7f8e50e00640 1 --2- 172.21.15.106:0/2858097706 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8e2c0696b0 0x7f8e2c06bb60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c157010 tx=0x7f8e3800c040 comp rx=0 tx=0).stop 2024-08-17T02:27:57.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.300+0000 7f42e0000640 1 -- 172.21.15.106:0/1605116039 --> [v2:172.21.15.171:6816/37336,v1:172.21.15.171:6817/37336] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f42d8063d20 con 0x7f42b806d430 2024-08-17T02:27:57.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.300+0000 7f8e50e00640 1 -- 172.21.15.106:0/2858097706 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e4c0adfd0 msgr2=0x7f8e4c0c78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.300+0000 7f8e50e00640 1 --2- 172.21.15.106:0/2858097706 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e4c0adfd0 0x7f8e4c0c78b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c033000 tx=0x7f8e3c037000 comp rx=0 tx=0).stop 2024-08-17T02:27:57.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.300+0000 7f8e4be00640 1 -- 172.21.15.106:0/2858097706 reap_dead start 2024-08-17T02:27:57.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.301+0000 7f8e50e00640 1 -- 172.21.15.106:0/2858097706 shutdown_connections 2024-08-17T02:27:57.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.301+0000 7f8e50e00640 1 -- 172.21.15.106:0/2858097706 >> 172.21.15.106:0/2858097706 conn(0x7f8e4c067750 msgr2=0x7f8e4c153d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.301+0000 7f8e50e00640 1 -- 172.21.15.106:0/2858097706 shutdown_connections 2024-08-17T02:27:57.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.301+0000 7f94d1400640 1 -- 172.21.15.106:0/3720436616 shutdown_connections 2024-08-17T02:27:57.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.301+0000 7f42d4c00640 1 -- 172.21.15.106:0/1605116039 <== osd.4 v2:172.21.15.171:6816/37336 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f42d8063d20 con 0x7f42b806d430 2024-08-17T02:27:57.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.301+0000 7f8e50e00640 1 -- 172.21.15.106:0/2858097706 wait complete. 2024-08-17T02:27:57.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.301+0000 7f94d1400640 1 -- 172.21.15.106:0/3720436616 wait complete. 2024-08-17T02:27:57.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.302+0000 7f42e0000640 1 -- 172.21.15.106:0/1605116039 >> [v2:172.21.15.171:6816/37336,v1:172.21.15.171:6817/37336] conn(0x7f42b806d430 msgr2=0x7f42b806f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.302+0000 7f42e0000640 1 --2- 172.21.15.106:0/1605116039 >> [v2:172.21.15.171:6816/37336,v1:172.21.15.171:6817/37336] conn(0x7f42b806d430 0x7f42b806f840 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.303+0000 7f42e0000640 1 -- 172.21.15.106:0/1605116039 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f42b8065220 msgr2=0x7f42b80676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.344 INFO:teuthology.orchestra.run.smithi106.stdout:55834574853 2024-08-17T02:27:57.345 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:27:57.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.303+0000 7f42e0000640 1 --2- 172.21.15.106:0/1605116039 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f42b8065220 0x7f42b80676d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f42c4034000 tx=0x7f42c4032000 comp rx=0 tx=0).stop 2024-08-17T02:27:57.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.303+0000 7f42e0000640 1 -- 172.21.15.106:0/1605116039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42d8159060 msgr2=0x7f42d816c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.303+0000 7f42e0000640 1 --2- 172.21.15.106:0/1605116039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42d8159060 0x7f42d816c920 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f42d80c6e20 tx=0x7f42cc007e10 comp rx=0 tx=0).stop 2024-08-17T02:27:57.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.303+0000 7f42de000640 1 -- 172.21.15.106:0/1605116039 reap_dead start 2024-08-17T02:27:57.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.305+0000 7f42e0000640 1 -- 172.21.15.106:0/1605116039 shutdown_connections 2024-08-17T02:27:57.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.305+0000 7f42e0000640 1 -- 172.21.15.106:0/1605116039 >> 172.21.15.106:0/1605116039 conn(0x7f42d80cfde0 msgr2=0x7f42d8068070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.305+0000 7f42e0000640 1 -- 172.21.15.106:0/1605116039 shutdown_connections 2024-08-17T02:27:57.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.306+0000 7f42e0000640 1 -- 172.21.15.106:0/1605116039 wait complete. 2024-08-17T02:27:57.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.308+0000 7fb2e8c00640 1 -- 172.21.15.106:0/938736613 --> [v2:172.21.15.171:6824/37356,v1:172.21.15.171:6825/37356] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb2e4170b60 con 0x7fb2c406d430 2024-08-17T02:27:57.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.308+0000 7fb2d9600640 1 -- 172.21.15.106:0/938736613 <== osd.6 v2:172.21.15.171:6824/37356 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb2e4170b60 con 0x7fb2c406d430 2024-08-17T02:27:57.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.309+0000 7fb2e8c00640 1 -- 172.21.15.106:0/938736613 >> [v2:172.21.15.171:6824/37356,v1:172.21.15.171:6825/37356] conn(0x7fb2c406d430 msgr2=0x7fb2c406f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.309+0000 7fb2e8c00640 1 --2- 172.21.15.106:0/938736613 >> [v2:172.21.15.171:6824/37356,v1:172.21.15.171:6825/37356] conn(0x7fb2c406d430 0x7fb2c406f840 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.309+0000 7fb2e8c00640 1 -- 172.21.15.106:0/938736613 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb2c40652a0 msgr2=0x7fb2c4067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.309+0000 7fb2e8c00640 1 --2- 172.21.15.106:0/938736613 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb2c40652a0 0x7fb2c4067750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4005840 tx=0x7fb2d4007940 comp rx=0 tx=0).stop 2024-08-17T02:27:57.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.309+0000 7fb2e8c00640 1 -- 172.21.15.106:0/938736613 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2e40b0610 msgr2=0x7fb2e41617f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.309+0000 7fb2e8c00640 1 --2- 172.21.15.106:0/938736613 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb2e40b0610 0x7fb2e41617f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb2d000ea20 tx=0x7fb2d00090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.309+0000 7fb2e2800640 1 -- 172.21.15.106:0/938736613 reap_dead start 2024-08-17T02:27:57.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.309+0000 7fb2e8c00640 1 -- 172.21.15.106:0/938736613 shutdown_connections 2024-08-17T02:27:57.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.309+0000 7fb2e8c00640 1 -- 172.21.15.106:0/938736613 >> 172.21.15.106:0/938736613 conn(0x7fb2e40cb9b0 msgr2=0x7fb2e406e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.310+0000 7fb2e8c00640 1 -- 172.21.15.106:0/938736613 shutdown_connections 2024-08-17T02:27:57.348 INFO:teuthology.orchestra.run.smithi106.stdout:55834574854 2024-08-17T02:27:57.349 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:27:57.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.310+0000 7fb2e8c00640 1 -- 172.21.15.106:0/938736613 wait complete. 2024-08-17T02:27:57.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.311+0000 7f2a7f800640 1 -- 172.21.15.106:0/3469617775 --> [v2:172.21.15.171:6808/37335,v1:172.21.15.171:6809/37335] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2a50002ca0 con 0x7f2a5406d430 2024-08-17T02:27:57.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.312+0000 7f2a74c00640 1 -- 172.21.15.106:0/3469617775 <== osd.7 v2:172.21.15.171:6808/37335 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2a50002ca0 con 0x7f2a5406d430 2024-08-17T02:27:57.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.313+0000 7f2a7f800640 1 -- 172.21.15.106:0/3469617775 >> [v2:172.21.15.171:6808/37335,v1:172.21.15.171:6809/37335] conn(0x7f2a5406d430 msgr2=0x7f2a5406f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.313+0000 7f2a7f800640 1 --2- 172.21.15.106:0/3469617775 >> [v2:172.21.15.171:6808/37335,v1:172.21.15.171:6809/37335] conn(0x7f2a5406d430 0x7f2a5406f840 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.313+0000 7f2a7f800640 1 -- 172.21.15.106:0/3469617775 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2a540652a0 msgr2=0x7f2a54067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.313+0000 7f2a7f800640 1 --2- 172.21.15.106:0/3469617775 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2a540652a0 0x7f2a54067750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2a680094d0 tx=0x7f2a68009780 comp rx=0 tx=0).stop 2024-08-17T02:27:57.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.313+0000 7f2a7f800640 1 -- 172.21.15.106:0/3469617775 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a780adde0 msgr2=0x7f2a780ae250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.313+0000 7f2a7f800640 1 --2- 172.21.15.106:0/3469617775 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2a780adde0 0x7f2a780ae250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2a78089990 tx=0x7f2a700014e0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.313+0000 7f2a7d800640 1 -- 172.21.15.106:0/3469617775 reap_dead start 2024-08-17T02:27:57.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.313+0000 7f2a7f800640 1 -- 172.21.15.106:0/3469617775 shutdown_connections 2024-08-17T02:27:57.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.313+0000 7f2a7f800640 1 -- 172.21.15.106:0/3469617775 >> 172.21.15.106:0/3469617775 conn(0x7f2a780cfdf0 msgr2=0x7f2a780b3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.316+0000 7f2a7f800640 1 -- 172.21.15.106:0/3469617775 shutdown_connections 2024-08-17T02:27:57.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.316+0000 7f2a7f800640 1 -- 172.21.15.106:0/3469617775 wait complete. 2024-08-17T02:27:57.352 INFO:teuthology.orchestra.run.smithi106.stdout:55834574854 2024-08-17T02:27:57.352 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:27:57.353 INFO:teuthology.orchestra.run.smithi106.stdout:55834574854 2024-08-17T02:27:57.353 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:27:57.354 INFO:teuthology.orchestra.run.smithi106.stdout:55834574854 2024-08-17T02:27:57.354 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:27:57.355 INFO:teuthology.orchestra.run.smithi106.stdout:55834574854 2024-08-17T02:27:57.355 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:27:57.356 INFO:teuthology.orchestra.run.smithi106.stdout:55834574853 2024-08-17T02:27:57.356 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:27:57.357 INFO:teuthology.orchestra.run.smithi106.stdout:55834574853 2024-08-17T02:27:57.358 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:27:57.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.650+0000 7f4a5a200640 1 Processor -- start 2024-08-17T02:27:57.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.650+0000 7f4a5a200640 1 -- start start 2024-08-17T02:27:57.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.652+0000 7f4a5a200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a4c0504e0 0x7f4a4c005e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.652+0000 7f4a5a200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a4c053870 con 0x7f4a4c0d8700 2024-08-17T02:27:57.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.653+0000 7f4cf1c00640 1 Processor -- start 2024-08-17T02:27:57.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.652+0000 7f4a5a200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a4c0533b0 con 0x7f4a4c04f200 2024-08-17T02:27:57.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.652+0000 7f4a5a200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c0df770 con 0x7f4a4c0504e0 2024-08-17T02:27:57.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.653+0000 7f4cf1c00640 1 -- start start 2024-08-17T02:27:57.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.653+0000 7f4a53e00640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f4a4c04f200 0x7f4a4c053d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:53866/0 (socket says 172.21.15.106:53866) 2024-08-17T02:27:57.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.653+0000 7f4a53e00640 1 -- 172.21.15.106:0/1856177473 learned_addr learned my addr 172.21.15.106:0/1856177473 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:57.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.653+0000 7f4a52000640 1 -- 172.21.15.106:0/1856177473 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1012823399 0 0) 0x7f4a4c0533b0 con 0x7f4a4c04f200 2024-08-17T02:27:57.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.653+0000 7f4a52000640 1 -- 172.21.15.106:0/1856177473 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a3c0034e0 con 0x7f4a4c04f200 2024-08-17T02:27:57.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.654+0000 7f4a52000640 1 -- 172.21.15.106:0/1856177473 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3974383620 0 0) 0x7f4a3c0034e0 con 0x7f4a4c04f200 2024-08-17T02:27:57.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.654+0000 7f4a52000640 1 -- 172.21.15.106:0/1856177473 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a4c0504e0 msgr2=0x7f4a4c005e50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:27:57.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.654+0000 7f4a52000640 1 --2- 172.21.15.106:0/1856177473 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a4c0504e0 0x7f4a4c005e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.654+0000 7f4a52000640 1 -- 172.21.15.106:0/1856177473 >> v1:172.21.15.106:6789/0 conn(0x7f4a4c0d8700 legacy=0x7f4a4c04fdd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:27:57.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.655+0000 7f4a52000640 1 -- 172.21.15.106:0/1856177473 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c0deed0 con 0x7f4a4c04f200 2024-08-17T02:27:57.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.655+0000 7f4cf1c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4ce4039130 0x7f4ce40552e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.655+0000 7f4a52000640 1 -- 172.21.15.106:0/1856177473 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7f4a40001470 con 0x7f4a4c04f200 2024-08-17T02:27:57.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.655+0000 7f4a52000640 1 -- 172.21.15.106:0/1856177473 >> v1:172.21.15.171:6789/0 conn(0x7f4a4c04f200 legacy=0x7f4a4c053d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.655+0000 7f4a52000640 1 --2- 172.21.15.106:0/1856177473 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a3c003a50 0x7f4a3c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.655+0000 7f4a52000640 1 --2- 172.21.15.106:0/1856177473 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a3c004780 0x7f4a3c004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.655+0000 7f4a52000640 1 --2- 172.21.15.106:0/1856177473 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a3c0052b0 0x7f4a3c00cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.655+0000 7f4a52000640 1 -- 172.21.15.106:0/1856177473 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c0df770 con 0x7f4a3c003a50 2024-08-17T02:27:57.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.655+0000 7f4a52000640 1 -- 172.21.15.106:0/1856177473 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c00d380 con 0x7f4a3c0052b0 2024-08-17T02:27:57.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.655+0000 7f4a52000640 1 -- 172.21.15.106:0/1856177473 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c00d540 con 0x7f4a3c004780 2024-08-17T02:27:57.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.656+0000 7f4a52a00640 1 --2- 172.21.15.106:0/1856177473 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a3c004780 0x7f4a3c004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.655+0000 7f4cf1c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ce4039500 0x7f4ce4055820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.655+0000 7f4cf1c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ce40e2610 con 0x7f4ce4051b10 2024-08-17T02:27:57.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.655+0000 7f4cf1c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce4052840 con 0x7f4ce4039130 2024-08-17T02:27:57.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.655+0000 7f4cf1c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce4052b20 con 0x7f4ce4039500 2024-08-17T02:27:57.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.656+0000 7f4cf1200640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f4ce4051b10 0x7f4ce4051f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39896/0 (socket says 172.21.15.106:39896) 2024-08-17T02:27:57.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.656+0000 7f4cf1200640 1 -- 172.21.15.106:0/1364627789 learned_addr learned my addr 172.21.15.106:0/1364627789 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:57.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.656+0000 7fd8b9800640 1 Processor -- start 2024-08-17T02:27:57.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.656+0000 7fd8b9800640 1 -- start start 2024-08-17T02:27:57.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.656+0000 7f4a52a00640 1 -- 172.21.15.106:0/1856177473 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a3c0052b0 msgr2=0x7f4a3c00cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:27:57.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.656+0000 7f4a52a00640 1 --2- 172.21.15.106:0/1856177473 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a3c0052b0 0x7f4a3c00cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.656+0000 7f4a52a00640 1 -- 172.21.15.106:0/1856177473 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a3c003a50 msgr2=0x7f4a3c003e60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:27:57.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.657+0000 7f4ceaa00640 1 -- 172.21.15.106:0/1364627789 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1085543921 0 0) 0x7f4ce40e2610 con 0x7f4ce4051b10 2024-08-17T02:27:57.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.657+0000 7f4a53400640 1 --2- 172.21.15.106:0/1856177473 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a3c003a50 0x7f4a3c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.657+0000 7f4ceaa00640 1 -- 172.21.15.106:0/1364627789 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cd40034e0 con 0x7f4ce4051b10 2024-08-17T02:27:57.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.657+0000 7f4a52a00640 1 --2- 172.21.15.106:0/1856177473 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a3c003a50 0x7f4a3c003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.657+0000 7f4a52a00640 1 -- 172.21.15.106:0/1856177473 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c0deed0 con 0x7f4a3c004780 2024-08-17T02:27:57.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.657+0000 7f4a53400640 1 --2- 172.21.15.106:0/1856177473 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a3c003a50 0x7f4a3c003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:57.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.657+0000 7f4cebe00640 1 --2- 172.21.15.106:0/1364627789 >> v2:172.21.15.106:3300/0 conn(0x7f4ce4039130 0x7f4ce40552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.657+0000 7f4ceb400640 1 --2- 172.21.15.106:0/1364627789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ce4039500 0x7f4ce4055820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.657+0000 7f4ceaa00640 1 -- 172.21.15.106:0/1364627789 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3933892025 0 0) 0x7f4cd40034e0 con 0x7f4ce4051b10 2024-08-17T02:27:57.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.658+0000 7f4ceaa00640 1 -- 172.21.15.106:0/1364627789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ce4039500 msgr2=0x7f4ce4055820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.658+0000 7f4ceaa00640 1 --2- 172.21.15.106:0/1364627789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ce4039500 0x7f4ce4055820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.658+0000 7f4ceaa00640 1 -- 172.21.15.106:0/1364627789 >> v2:172.21.15.106:3300/0 conn(0x7f4ce4039130 msgr2=0x7f4ce40552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.658+0000 7f4ceaa00640 1 --2- 172.21.15.106:0/1364627789 >> v2:172.21.15.106:3300/0 conn(0x7f4ce4039130 0x7f4ce40552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.658+0000 7f4ceaa00640 1 -- 172.21.15.106:0/1364627789 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce4052e00 con 0x7f4ce4051b10 2024-08-17T02:27:57.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.658+0000 7fd8b9800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd8b4159ca0 0x7fd8b40ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.658+0000 7fd8b9800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8b40ca8a0 0x7fd8b40cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.658+0000 7fd8b9800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b40cadc0 con 0x7fd8b40ccad0 2024-08-17T02:27:57.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.658+0000 7fd8b9800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b40cd6e0 con 0x7fd8b4159ca0 2024-08-17T02:27:57.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.658+0000 7fd8b9800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b40ccf70 con 0x7fd8b40ca8a0 2024-08-17T02:27:57.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.659+0000 7fd8b3400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8b40ca8a0 0x7fd8b40cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.659+0000 7fd8b3e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd8b4159ca0 0x7fd8b40ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.659+0000 7fd8b3400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8b40ca8a0 0x7fd8b40cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:52392/0 (socket says 172.21.15.106:52392) 2024-08-17T02:27:57.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.659+0000 7fd8b3400640 1 -- 172.21.15.106:0/2343305087 learned_addr learned my addr 172.21.15.106:0/2343305087 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:57.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.659+0000 7f4ceaa00640 1 -- 172.21.15.106:0/1364627789 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7f4cdc001470 con 0x7f4ce4051b10 2024-08-17T02:27:57.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.659+0000 7f4ceaa00640 1 -- 172.21.15.106:0/1364627789 >> v1:172.21.15.106:6789/0 conn(0x7f4ce4051b10 legacy=0x7f4ce4051f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.659+0000 7f4ceaa00640 1 --2- 172.21.15.106:0/1364627789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ce4039500 0x7f4cd40039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.659+0000 7f4ceaa00640 1 --2- 172.21.15.106:0/1364627789 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cd4004000 0x7f4cd4004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.659+0000 7f4ceaa00640 1 --2- 172.21.15.106:0/1364627789 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4cd4004cc0 0x7f4cd4005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.659+0000 7f4ceaa00640 1 -- 172.21.15.106:0/1364627789 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce4052840 con 0x7f4cd4004cc0 2024-08-17T02:27:57.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.659+0000 7f4ceaa00640 1 -- 172.21.15.106:0/1364627789 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce4052b20 con 0x7f4cd4004000 2024-08-17T02:27:57.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.659+0000 7f4ceaa00640 1 -- 172.21.15.106:0/1364627789 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd400bc40 con 0x7f4ce4039500 2024-08-17T02:27:57.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.659+0000 7f38e3e00640 1 Processor -- start 2024-08-17T02:27:57.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.659+0000 7f4cebe00640 1 --2- 172.21.15.106:0/1364627789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ce4039500 0x7f4cd40039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.659+0000 7f4cf1200640 1 --2- 172.21.15.106:0/1364627789 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4cd4004cc0 0x7f4cd4005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.660+0000 7fd8b3e00640 1 -- 172.21.15.106:0/2343305087 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8b40ca8a0 msgr2=0x7fd8b40cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.660+0000 7fd8b3e00640 1 --2- 172.21.15.106:0/2343305087 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8b40ca8a0 0x7fd8b40cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.660+0000 7fd8b3e00640 1 -- 172.21.15.106:0/2343305087 >> v1:172.21.15.171:6789/0 conn(0x7fd8b40ccad0 legacy=0x7fd8b40cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.660+0000 7f4ceb400640 1 --2- 172.21.15.106:0/1364627789 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cd4004000 0x7f4cd4004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.660+0000 7f38e3e00640 1 -- start start 2024-08-17T02:27:57.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.660+0000 7f4a52a00640 1 --2- 172.21.15.106:0/1856177473 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a3c004780 0x7f4a3c004bf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00dc70 tx=0x7f4a48006ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45eceee7f4bf1563 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.660+0000 7f4ceb400640 1 -- 172.21.15.106:0/1364627789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ce4039500 msgr2=0x7f4cd40039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.660+0000 7f4ceb400640 1 --2- 172.21.15.106:0/1364627789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ce4039500 0x7f4cd40039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.660+0000 7f4ceb400640 1 -- 172.21.15.106:0/1364627789 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4cd4004cc0 msgr2=0x7f4cd4005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.660+0000 7f4ceb400640 1 --2- 172.21.15.106:0/1364627789 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4cd4004cc0 0x7f4cd4005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.660+0000 7f4ceb400640 1 -- 172.21.15.106:0/1364627789 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd40034e0 con 0x7f4cd4004000 2024-08-17T02:27:57.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.660+0000 7f4cf1200640 1 --2- 172.21.15.106:0/1364627789 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4cd4004cc0 0x7f4cd4005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:57.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.661+0000 7f4a52000640 1 -- 172.21.15.106:0/1856177473 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4802cb20 con 0x7f4a3c004780 2024-08-17T02:27:57.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.661+0000 7f4a52000640 1 -- 172.21.15.106:0/1856177473 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4802cc80 con 0x7f4a3c004780 2024-08-17T02:27:57.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.661+0000 7f4a52000640 1 -- 172.21.15.106:0/1856177473 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a480356c0 con 0x7f4a3c004780 2024-08-17T02:27:57.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.662+0000 7f9766200640 1 Processor -- start 2024-08-17T02:27:57.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.662+0000 7f4a5a200640 1 -- 172.21.15.106:0/1856177473 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a3c004780 msgr2=0x7f4a3c004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.662+0000 7f4a5a200640 1 --2- 172.21.15.106:0/1856177473 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a3c004780 0x7f4a3c004bf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00dc70 tx=0x7f4a48006ef0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.662+0000 7f4a53e00640 1 -- 172.21.15.106:0/1856177473 reap_dead start 2024-08-17T02:27:57.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.662+0000 7f9766200640 1 -- start start 2024-08-17T02:27:57.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.662+0000 7f4a5a200640 1 -- 172.21.15.106:0/1856177473 shutdown_connections 2024-08-17T02:27:57.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.662+0000 7f4a5a200640 1 -- 172.21.15.106:0/1856177473 >> 172.21.15.106:0/1856177473 conn(0x7f4a4c051630 msgr2=0x7f4a4c051a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.662+0000 7f4ceb400640 1 --2- 172.21.15.106:0/1364627789 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cd4004000 0x7f4cd4004780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0006fd0 tx=0x7f4ce0008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=548a45023149978a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.662+0000 7f4a5a200640 1 -- 172.21.15.106:0/1856177473 shutdown_connections 2024-08-17T02:27:57.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.662+0000 7f4a5a200640 1 -- 172.21.15.106:0/1856177473 wait complete. 2024-08-17T02:27:57.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.662+0000 7f38e3e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f38dc0e2020 0x7f38dc03aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.662+0000 7f38e3e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38dc03b3f0 0x7f38dc038b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.662+0000 7f38e3e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f38dc039090 0x7f38dc0378a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.662+0000 7f38e3e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38dc007a30 con 0x7f38dc039090 2024-08-17T02:27:57.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.662+0000 7f38e3e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38dc0394f0 con 0x7f38dc0e2020 2024-08-17T02:27:57.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.662+0000 7f38e3e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc006e20 con 0x7f38dc03b3f0 2024-08-17T02:27:57.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.663+0000 7f4ceaa00640 1 -- 172.21.15.106:0/1364627789 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce002a9a0 con 0x7f4cd4004000 2024-08-17T02:27:57.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.663+0000 7f4ceaa00640 1 -- 172.21.15.106:0/1364627789 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce002ab00 con 0x7f4cd4004000 2024-08-17T02:27:57.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.663+0000 7f4ceaa00640 1 -- 172.21.15.106:0/1364627789 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0032440 con 0x7f4cd4004000 2024-08-17T02:27:57.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.663+0000 7fd8b3e00640 1 -- 172.21.15.106:0/2343305087 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b40cb060 con 0x7fd8b4159ca0 2024-08-17T02:27:57.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.663+0000 7f38e2a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f38dc0e2020 0x7f38dc03aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.663+0000 7f38e2000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38dc03b3f0 0x7f38dc038b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.663+0000 7f38e2a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f38dc0e2020 0x7f38dc03aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:58238/0 (socket says 172.21.15.106:58238) 2024-08-17T02:27:57.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.663+0000 7f38e2a00640 1 -- 172.21.15.106:0/2602366995 learned_addr learned my addr 172.21.15.106:0/2602366995 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:57.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.663+0000 7f38e2000640 1 -- 172.21.15.106:0/2602366995 >> v2:172.21.15.171:3300/0 conn(0x7f38dc0e2020 msgr2=0x7f38dc03aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.663+0000 7f38e2000640 1 --2- 172.21.15.106:0/2602366995 >> v2:172.21.15.171:3300/0 conn(0x7f38dc0e2020 0x7f38dc03aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.663+0000 7f38e2000640 1 -- 172.21.15.106:0/2602366995 >> v2:172.21.15.106:3300/0 conn(0x7f38dc039090 msgr2=0x7f38dc0378a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.664+0000 7f38e3400640 1 --2- 172.21.15.106:0/2602366995 >> v2:172.21.15.106:3300/0 conn(0x7f38dc039090 0x7f38dc0378a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.664+0000 7f9766200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f97580e2020 0x7f975803aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.664+0000 7f9766200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9758039260 0x7f97580378a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.664+0000 7f38e2000640 1 --2- 172.21.15.106:0/2602366995 >> v2:172.21.15.106:3300/0 conn(0x7f38dc039090 0x7f38dc0378a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.664+0000 7f38e2000640 1 -- 172.21.15.106:0/2602366995 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38dc007100 con 0x7f38dc03b3f0 2024-08-17T02:27:57.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.664+0000 7f4cf1c00640 1 -- 172.21.15.106:0/1364627789 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cd4004000 msgr2=0x7f4cd4004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.664+0000 7f4cf1c00640 1 --2- 172.21.15.106:0/1364627789 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cd4004000 0x7f4cd4004780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0006fd0 tx=0x7f4ce0008040 comp rx=0 tx=0).stop 2024-08-17T02:27:57.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.664+0000 7f9766200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9758007a30 con 0x7f975803b3f0 2024-08-17T02:27:57.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.664+0000 7f9766200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9758006e20 con 0x7f9758039260 2024-08-17T02:27:57.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.664+0000 7f9766200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9758007100 con 0x7f97580e2020 2024-08-17T02:27:57.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.664+0000 7f31f8200640 1 Processor -- start 2024-08-17T02:27:57.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.664+0000 7f4a5a200640 1 Processor -- start 2024-08-17T02:27:57.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.664+0000 7f31f8200640 1 -- start start 2024-08-17T02:27:57.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.665+0000 7f4a5a200640 1 -- start start 2024-08-17T02:27:57.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.664+0000 7f9764e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f97580e2020 0x7f975803aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.664+0000 7f9764e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f97580e2020 0x7f975803aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:58252/0 (socket says 172.21.15.106:58252) 2024-08-17T02:27:57.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.664+0000 7f9764e00640 1 -- 172.21.15.106:0/97613577 learned_addr learned my addr 172.21.15.106:0/97613577 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:57.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.665+0000 7f9764e00640 1 -- 172.21.15.106:0/97613577 >> v2:172.21.15.106:3300/0 conn(0x7f9758039260 msgr2=0x7f97580378a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.665+0000 7f9764e00640 1 --2- 172.21.15.106:0/97613577 >> v2:172.21.15.106:3300/0 conn(0x7f9758039260 0x7f97580378a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.665+0000 7f9764e00640 1 -- 172.21.15.106:0/97613577 >> v1:172.21.15.106:6789/0 conn(0x7f975803b3f0 legacy=0x7f9758038b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.665+0000 7fd8b3e00640 1 --2- 172.21.15.106:0/2343305087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8b4159ca0 0x7fd8b40ca360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac009e60 tx=0x7fd8ac009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51f009b9045dd51f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.664+0000 7f4cf1200640 1 -- 172.21.15.106:0/1364627789 reap_dead start 2024-08-17T02:27:57.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.665+0000 7f38e2a00640 1 --2- 172.21.15.106:0/2602366995 >> v2:172.21.15.171:3300/0 conn(0x7f38dc0e2020 0x7f38dc03aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:57.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.665+0000 7f38e3400640 1 --2- 172.21.15.106:0/2602366995 >> v2:172.21.15.106:3300/0 conn(0x7f38dc039090 0x7f38dc0378a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:57.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.665+0000 7f38e2000640 1 --2- 172.21.15.106:0/2602366995 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38dc03b3f0 0x7f38dc038b50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f38dc012160 tx=0x7f38d40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d395426b8a259f18 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.665+0000 7fd8b2a00640 1 -- 172.21.15.106:0/2343305087 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac007550 con 0x7fd8b4159ca0 2024-08-17T02:27:57.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.666+0000 7fd8b2a00640 1 -- 172.21.15.106:0/2343305087 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ac02d050 con 0x7fd8b4159ca0 2024-08-17T02:27:57.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.666+0000 7fd8b2a00640 1 -- 172.21.15.106:0/2343305087 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac007920 con 0x7fd8b4159ca0 2024-08-17T02:27:57.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.666+0000 7f4cf1c00640 1 -- 172.21.15.106:0/1364627789 shutdown_connections 2024-08-17T02:27:57.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.666+0000 7f4cf1c00640 1 -- 172.21.15.106:0/1364627789 >> 172.21.15.106:0/1364627789 conn(0x7f4ce4057870 msgr2=0x7f4ce4009ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.665+0000 7f9764e00640 1 -- 172.21.15.106:0/97613577 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97580073e0 con 0x7f97580e2020 2024-08-17T02:27:57.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.666+0000 7f4cf1c00640 1 -- 172.21.15.106:0/1364627789 shutdown_connections 2024-08-17T02:27:57.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.666+0000 7f4a5a200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a3c004780 0x7f4a4c04c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.666+0000 7f4a5a200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a4c03a2f0 0x7f4a4c0f6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.666+0000 7f31f8200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f31f00ada10 0x7f31f00b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.666+0000 7f31f8200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31f00b38b0 0x7f31f00aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.666+0000 7f31f8200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f00d0ab0 con 0x7f31f00b1120 2024-08-17T02:27:57.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.666+0000 7f31f8200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f00b00c0 con 0x7f31f00ada10 2024-08-17T02:27:57.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.666+0000 7f31f8200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f00af330 con 0x7f31f00b38b0 2024-08-17T02:27:57.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.666+0000 7f4a5a200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a4c0d65e0 0x7f4a4c0f2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.667+0000 7fd8b9800640 1 -- 172.21.15.106:0/2343305087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8b4159ca0 msgr2=0x7fd8b40ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.667+0000 7fd8b9800640 1 --2- 172.21.15.106:0/2343305087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8b4159ca0 0x7fd8b40ca360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac009e60 tx=0x7fd8ac009780 comp rx=0 tx=0).stop 2024-08-17T02:27:57.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.667+0000 7f4a53400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a3c004780 0x7f4a4c04c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.667+0000 7f4a5a200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c0dbc60 con 0x7f4a4c03a2f0 2024-08-17T02:27:57.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.667+0000 7f4a5a200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c04cae0 con 0x7f4a3c004780 2024-08-17T02:27:57.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.667+0000 7f4a5a200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c0db6a0 con 0x7f4a4c0d65e0 2024-08-17T02:27:57.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.666+0000 7f4cf1c00640 1 -- 172.21.15.106:0/1364627789 wait complete. 2024-08-17T02:27:57.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.667+0000 7fd8b9800640 1 -- 172.21.15.106:0/2343305087 shutdown_connections 2024-08-17T02:27:57.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.667+0000 7fd8b9800640 1 --2- 172.21.15.106:0/2343305087 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8b40ca8a0 0x7fd8b40cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.667+0000 7f4a53400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a3c004780 0x7f4a4c04c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:58262/0 (socket says 172.21.15.106:58262) 2024-08-17T02:27:57.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.667+0000 7f4a53400640 1 -- 172.21.15.106:0/2632104232 learned_addr learned my addr 172.21.15.106:0/2632104232 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:57.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.667+0000 7fd8b9800640 1 --2- 172.21.15.106:0/2343305087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8b4159ca0 0x7fd8b40ca360 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.667+0000 7fd8b9800640 1 -- 172.21.15.106:0/2343305087 >> 172.21.15.106:0/2343305087 conn(0x7fd8b4098e00 msgr2=0x7fd8b406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.667+0000 7f4a53e00640 1 --2- 172.21.15.106:0/2632104232 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a4c0d65e0 0x7f4a4c0f2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.667+0000 7f4a52a00640 1 --2- 172.21.15.106:0/2632104232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a4c03a2f0 0x7f4a4c0f6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.667+0000 7f31f6200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31f00b38b0 0x7f31f00aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.667+0000 7f31f6200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31f00b38b0 0x7f31f00aedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:52442/0 (socket says 172.21.15.106:52442) 2024-08-17T02:27:57.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.667+0000 7f31f6200640 1 -- 172.21.15.106:0/1784253588 learned_addr learned my addr 172.21.15.106:0/1784253588 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:57.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.667+0000 7fd8b9800640 1 -- 172.21.15.106:0/2343305087 shutdown_connections 2024-08-17T02:27:57.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.667+0000 7fd8b9800640 1 -- 172.21.15.106:0/2343305087 wait complete. 2024-08-17T02:27:57.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.668+0000 7f4a53400640 1 -- 172.21.15.106:0/2632104232 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a4c0d65e0 msgr2=0x7f4a4c0f2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.668+0000 7f4a53400640 1 --2- 172.21.15.106:0/2632104232 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a4c0d65e0 0x7f4a4c0f2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.668+0000 7f4a53400640 1 -- 172.21.15.106:0/2632104232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a4c03a2f0 msgr2=0x7f4a4c0f6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.668+0000 7f4a53400640 1 --2- 172.21.15.106:0/2632104232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a4c03a2f0 0x7f4a4c0f6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.668+0000 7f4a53400640 1 -- 172.21.15.106:0/2632104232 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c0db980 con 0x7f4a3c004780 2024-08-17T02:27:57.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.667+0000 7f31f5800640 1 --2- 172.21.15.106:0/1784253588 >> v2:172.21.15.106:3300/0 conn(0x7f31f00ada10 0x7f31f00b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.667+0000 7f9764e00640 1 --2- 172.21.15.106:0/97613577 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97580e2020 0x7f975803aeb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9758012160 tx=0x7f97540091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bc8dc47d0ccbbc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.668+0000 7f4a52a00640 1 --2- 172.21.15.106:0/2632104232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a4c03a2f0 0x7f4a4c0f6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:57.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.668+0000 7f38e1600640 1 -- 172.21.15.106:0/2602366995 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d402ad40 con 0x7f38dc03b3f0 2024-08-17T02:27:57.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.668+0000 7f975f400640 1 -- 172.21.15.106:0/97613577 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975402ae00 con 0x7f97580e2020 2024-08-17T02:27:57.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.668+0000 7f975f400640 1 -- 172.21.15.106:0/97613577 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9754032440 con 0x7f97580e2020 2024-08-17T02:27:57.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.668+0000 7f975f400640 1 -- 172.21.15.106:0/97613577 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9754032820 con 0x7f97580e2020 2024-08-17T02:27:57.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.668+0000 7f31f6200640 1 -- 172.21.15.106:0/1784253588 >> v2:172.21.15.106:3300/0 conn(0x7f31f00ada10 msgr2=0x7f31f00b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.668+0000 7f31f6200640 1 --2- 172.21.15.106:0/1784253588 >> v2:172.21.15.106:3300/0 conn(0x7f31f00ada10 0x7f31f00b2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.668+0000 7f31f6200640 1 -- 172.21.15.106:0/1784253588 >> v1:172.21.15.106:6789/0 conn(0x7f31f00b1120 legacy=0x7f31f00b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.668+0000 7f31f6200640 1 -- 172.21.15.106:0/1784253588 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f00b0360 con 0x7f31f00b38b0 2024-08-17T02:27:57.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.668+0000 7f4a53400640 1 --2- 172.21.15.106:0/2632104232 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a3c004780 0x7f4a4c04c5a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4a54065d00 tx=0x7f4a54069040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.668+0000 7f38e1600640 1 -- 172.21.15.106:0/2602366995 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d4032440 con 0x7f38dc03b3f0 2024-08-17T02:27:57.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.668+0000 7f38e1600640 1 -- 172.21.15.106:0/2602366995 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d402aea0 con 0x7f38dc03b3f0 2024-08-17T02:27:57.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.669+0000 7f4a46a00640 1 -- 172.21.15.106:0/2632104232 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5406f230 con 0x7f4a3c004780 2024-08-17T02:27:57.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.669+0000 7f4a46a00640 1 -- 172.21.15.106:0/2632104232 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5406f3f0 con 0x7f4a3c004780 2024-08-17T02:27:57.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.669+0000 7f4a46a00640 1 -- 172.21.15.106:0/2632104232 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5406d950 con 0x7f4a3c004780 2024-08-17T02:27:57.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.669+0000 7f4cf1c00640 1 Processor -- start 2024-08-17T02:27:57.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.669+0000 7f4a5a200640 1 -- 172.21.15.106:0/2632104232 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a4c0f6730 con 0x7f4a3c004780 2024-08-17T02:27:57.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.669+0000 7f9766200640 1 -- 172.21.15.106:0/97613577 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97580e2020 msgr2=0x7f975803aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.669+0000 7f9766200640 1 --2- 172.21.15.106:0/97613577 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97580e2020 0x7f975803aeb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9758012160 tx=0x7f97540091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.669+0000 7f4a5a200640 1 -- 172.21.15.106:0/2632104232 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a4c0f7470 con 0x7f4a3c004780 2024-08-17T02:27:57.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.669+0000 7f4cf1c00640 1 -- start start 2024-08-17T02:27:57.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.670+0000 7f38e3e00640 1 -- 172.21.15.106:0/2602366995 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38dc03b3f0 msgr2=0x7f38dc038b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.670+0000 7f31f6200640 1 --2- 172.21.15.106:0/1784253588 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31f00b38b0 0x7f31f00aedf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f31e0009910 tx=0x7f31e00091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b2c90eae90beb85 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.670+0000 7f38e3e00640 1 --2- 172.21.15.106:0/2602366995 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38dc03b3f0 0x7f38dc038b50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f38dc012160 tx=0x7f38d40090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.671+0000 7f38e3e00640 1 -- 172.21.15.106:0/2602366995 shutdown_connections 2024-08-17T02:27:57.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.670+0000 7f9766200640 1 -- 172.21.15.106:0/97613577 shutdown_connections 2024-08-17T02:27:57.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.671+0000 7f38e3e00640 1 --2- 172.21.15.106:0/2602366995 >> v2:172.21.15.106:3300/0 conn(0x7f38dc039090 0x7f38dc0378a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.671+0000 7f38e3e00640 1 --2- 172.21.15.106:0/2602366995 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38dc03b3f0 0x7f38dc038b50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.671+0000 7f38e3e00640 1 --2- 172.21.15.106:0/2602366995 >> v2:172.21.15.171:3300/0 conn(0x7f38dc0e2020 0x7f38dc03aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.671+0000 7f38e3e00640 1 -- 172.21.15.106:0/2602366995 >> 172.21.15.106:0/2602366995 conn(0x7f38dc00f050 msgr2=0x7f38dc058f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.670+0000 7f9766200640 1 --2- 172.21.15.106:0/97613577 >> v2:172.21.15.106:3300/0 conn(0x7f9758039260 0x7f97580378a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.670+0000 7f9766200640 1 --2- 172.21.15.106:0/97613577 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97580e2020 0x7f975803aeb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.670+0000 7f9766200640 1 -- 172.21.15.106:0/97613577 >> 172.21.15.106:0/97613577 conn(0x7f975800f050 msgr2=0x7f9758058f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.671+0000 7f9766200640 1 -- 172.21.15.106:0/97613577 shutdown_connections 2024-08-17T02:27:57.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.671+0000 7f7b2b200640 1 Processor -- start 2024-08-17T02:27:57.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.671+0000 7f9766200640 1 -- 172.21.15.106:0/97613577 wait complete. 2024-08-17T02:27:57.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.671+0000 7fd8b9800640 1 Processor -- start 2024-08-17T02:27:57.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.671+0000 7f38e3e00640 1 -- 172.21.15.106:0/2602366995 shutdown_connections 2024-08-17T02:27:57.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.672+0000 7f38e3e00640 1 -- 172.21.15.106:0/2602366995 wait complete. 2024-08-17T02:27:57.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.671+0000 7f7b2b200640 1 -- start start 2024-08-17T02:27:57.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.671+0000 7fd8b9800640 1 -- start start 2024-08-17T02:27:57.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.671+0000 7f31efe00640 1 -- 172.21.15.106:0/1784253588 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e002ae40 con 0x7f31f00b38b0 2024-08-17T02:27:57.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.671+0000 7f31efe00640 1 -- 172.21.15.106:0/1784253588 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e0032440 con 0x7f31f00b38b0 2024-08-17T02:27:57.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.671+0000 7f31efe00640 1 -- 172.21.15.106:0/1784253588 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0032820 con 0x7f31f00b38b0 2024-08-17T02:27:57.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.672+0000 7f31f8200640 1 -- 172.21.15.106:0/1784253588 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31f00b38b0 msgr2=0x7f31f00aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.672+0000 7f31f8200640 1 --2- 172.21.15.106:0/1784253588 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31f00b38b0 0x7f31f00aedf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f31e0009910 tx=0x7f31e00091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.671+0000 7f4a5a200640 1 -- 172.21.15.106:0/2632104232 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a4c0f6590 con 0x7f4a3c004780 2024-08-17T02:27:57.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.673+0000 7f4a46a00640 1 -- 172.21.15.106:0/2632104232 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4a5406dd80 con 0x7f4a3c004780 2024-08-17T02:27:57.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.673+0000 7fd8b9800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8b40ca8a0 0x7fd8b40b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.673+0000 7fd8b9800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8b40ccad0 0x7fd8b409c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.673+0000 7fd8b9800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8b4159ca0 0x7fd8b40999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.673+0000 7f4cf1c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cd4004000 0x7f4ce4008d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.673+0000 7f4cf1c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ce4009270 0x7f4ce40e4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.673+0000 7f4cf1c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ce40dd2d0 0x7f4ce40ce350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.673+0000 7f4cf1c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce40dce40 con 0x7f4ce4009270 2024-08-17T02:27:57.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.673+0000 7f4cf1c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce40e4e50 con 0x7f4ce40dd2d0 2024-08-17T02:27:57.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.673+0000 7f4cf1c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce40dc510 con 0x7f4cd4004000 2024-08-17T02:27:57.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.673+0000 7f31f8200640 1 -- 172.21.15.106:0/1784253588 shutdown_connections 2024-08-17T02:27:57.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.673+0000 7f31f8200640 1 --2- 172.21.15.106:0/1784253588 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31f00b38b0 0x7f31f00aedf0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.673+0000 7f31f8200640 1 --2- 172.21.15.106:0/1784253588 >> v2:172.21.15.106:3300/0 conn(0x7f31f00ada10 0x7f31f00b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.673+0000 7f31f8200640 1 -- 172.21.15.106:0/1784253588 >> 172.21.15.106:0/1784253588 conn(0x7f31f00cfdf0 msgr2=0x7f31f00d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.673+0000 7f9766200640 1 Processor -- start 2024-08-17T02:27:57.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.673+0000 7f4cf1200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ce40dd2d0 0x7f4ce40ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.673+0000 7fd8b9800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b409cde0 con 0x7fd8b40ca8a0 2024-08-17T02:27:57.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.673+0000 7f9766200640 1 -- start start 2024-08-17T02:27:57.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.673+0000 7fd8b9800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b40b49b0 con 0x7fd8b40ccad0 2024-08-17T02:27:57.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.674+0000 7fd8b9800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b40b4c90 con 0x7fd8b4159ca0 2024-08-17T02:27:57.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.673+0000 7f4cf1200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ce40dd2d0 0x7f4ce40ce350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:58272/0 (socket says 172.21.15.106:58272) 2024-08-17T02:27:57.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.674+0000 7f31f8200640 1 -- 172.21.15.106:0/1784253588 shutdown_connections 2024-08-17T02:27:57.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.674+0000 7f38e3e00640 1 Processor -- start 2024-08-17T02:27:57.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.673+0000 7f4cf1200640 1 -- 172.21.15.106:0/4116350033 learned_addr learned my addr 172.21.15.106:0/4116350033 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:57.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.675+0000 7f4a46a00640 1 --2- 172.21.15.106:0/2632104232 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4a340652a0 0x7f4a34067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.675+0000 7f4cf1200640 1 -- 172.21.15.106:0/4116350033 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cd4004000 msgr2=0x7f4ce4008d30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-17T02:27:57.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.674+0000 7f38e3e00640 1 -- start start 2024-08-17T02:27:57.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.674+0000 7fd8b3e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8b40ca8a0 0x7fd8b40b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.674+0000 7fd8b3e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8b40ca8a0 0x7fd8b40b4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56632/0 (socket says 172.21.15.106:56632) 2024-08-17T02:27:57.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.674+0000 7fd8b3e00640 1 -- 172.21.15.106:0/1471930091 learned_addr learned my addr 172.21.15.106:0/1471930091 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:57.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.674+0000 7fd8b3400640 1 --2- 172.21.15.106:0/1471930091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8b40ccad0 0x7fd8b409c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.674+0000 7fd8b8e00640 1 --2- 172.21.15.106:0/1471930091 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8b4159ca0 0x7fd8b40999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.675+0000 7fd8b3e00640 1 -- 172.21.15.106:0/1471930091 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8b4159ca0 msgr2=0x7fd8b40999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.675+0000 7fd8b3e00640 1 --2- 172.21.15.106:0/1471930091 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8b4159ca0 0x7fd8b40999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.675+0000 7fd8b3e00640 1 -- 172.21.15.106:0/1471930091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8b40ccad0 msgr2=0x7fd8b409c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.674+0000 7f7b2b200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b240b1120 0x7f7b240aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.674+0000 7f7b2b200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7b240b3370 0x7f7b240b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.674+0000 7f7b2b200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b240d0ab0 con 0x7f7b240ada10 2024-08-17T02:27:57.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.674+0000 7f7b2b200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b240b00c0 con 0x7f7b240b3370 2024-08-17T02:27:57.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.674+0000 7f7b2b200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b240af330 con 0x7f7b240b1120 2024-08-17T02:27:57.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.674+0000 7f7b23400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b240b1120 0x7f7b240aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.675+0000 7f7b29200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7b240b3370 0x7f7b240b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.675+0000 7f7b23e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7b240ada10 0x7f7b240b2c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39922/0 (socket says 172.21.15.106:39922) 2024-08-17T02:27:57.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.675+0000 7f7b23e00640 1 -- 172.21.15.106:0/2127486520 learned_addr learned my addr 172.21.15.106:0/2127486520 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:57.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.675+0000 7f4a46a00640 1 -- 172.21.15.106:0/2632104232 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4a5408b070 con 0x7f4a3c004780 2024-08-17T02:27:57.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.676+0000 7f4a52a00640 1 --2- 172.21.15.106:0/2632104232 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4a340652a0 0x7f4a34067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.675+0000 7f4cebe00640 1 --2- 172.21.15.106:0/4116350033 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cd4004000 0x7f4ce4008d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.675+0000 7f4cf1200640 1 --2- 172.21.15.106:0/4116350033 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cd4004000 0x7f4ce4008d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.675+0000 7f4cf1200640 1 -- 172.21.15.106:0/4116350033 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ce4009270 msgr2=0x7f4ce40e4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.676+0000 7f4ceb400640 1 --2- 172.21.15.106:0/4116350033 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ce4009270 0x7f4ce40e4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.676+0000 7f4cf1200640 1 --2- 172.21.15.106:0/4116350033 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ce4009270 0x7f4ce40e4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.676+0000 7f4cf1200640 1 -- 172.21.15.106:0/4116350033 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce40dc7f0 con 0x7f4ce40dd2d0 2024-08-17T02:27:57.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.676+0000 7f4ceb400640 1 --2- 172.21.15.106:0/4116350033 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ce4009270 0x7f4ce40e4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:57.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.676+0000 7f4cebe00640 1 --2- 172.21.15.106:0/4116350033 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cd4004000 0x7f4ce4008d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:57.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.676+0000 7f4cf1200640 1 --2- 172.21.15.106:0/4116350033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ce40dd2d0 0x7f4ce40ce350 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4051ee0 tx=0x7f4ce40533c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.676+0000 7f38e3e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38dc039090 0x7f38dc005dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.676+0000 7f38e3e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38dc03b3f0 0x7f38dc0f2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.676+0000 7f38e3e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38dc0e2020 0x7f38dc0e4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.676+0000 7f38e3e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc051330 con 0x7f38dc03b3f0 2024-08-17T02:27:57.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.676+0000 7f38e3e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc051610 con 0x7f38dc0e2020 2024-08-17T02:27:57.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.676+0000 7f38e3e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc0518f0 con 0x7f38dc039090 2024-08-17T02:27:57.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.676+0000 7f38e2a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38dc039090 0x7f38dc005dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.676+0000 7f38e2a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38dc039090 0x7f38dc005dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:52496/0 (socket says 172.21.15.106:52496) 2024-08-17T02:27:57.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.676+0000 7f38e2a00640 1 -- 172.21.15.106:0/3038768565 learned_addr learned my addr 172.21.15.106:0/3038768565 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:57.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.675+0000 7f9766200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9758039260 0x7f97580fa860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.675+0000 7f9766200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f975803b3f0 0x7f97580503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.675+0000 7f9766200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97580e2020 0x7f975804eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.675+0000 7f9766200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9758051770 con 0x7f975803b3f0 2024-08-17T02:27:57.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.675+0000 7f9766200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97580e3860 con 0x7f97580e2020 2024-08-17T02:27:57.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.675+0000 7f9766200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9758050bf0 con 0x7f9758039260 2024-08-17T02:27:57.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.676+0000 7f9765800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97580e2020 0x7f975804eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.676+0000 7f9764e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9758039260 0x7f97580fa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.676+0000 7f9765800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97580e2020 0x7f975804eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:58316/0 (socket says 172.21.15.106:58316) 2024-08-17T02:27:57.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.676+0000 7f9765800640 1 -- 172.21.15.106:0/1548808544 learned_addr learned my addr 172.21.15.106:0/1548808544 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:57.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.676+0000 7fd8b3e00640 1 --2- 172.21.15.106:0/1471930091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8b40ccad0 0x7fd8b409c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.676+0000 7fd8b3e00640 1 -- 172.21.15.106:0/1471930091 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ac009a20 con 0x7fd8b40ca8a0 2024-08-17T02:27:57.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.676+0000 7fd8b3400640 1 --2- 172.21.15.106:0/1471930091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8b40ccad0 0x7fd8b409c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:57.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.674+0000 7f31f8200640 1 -- 172.21.15.106:0/1784253588 wait complete. 2024-08-17T02:27:57.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.676+0000 7f31f8200640 1 Processor -- start 2024-08-17T02:27:57.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.676+0000 7f31f8200640 1 -- start start 2024-08-17T02:27:57.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.675+0000 7f7b23400640 1 -- 172.21.15.106:0/2127486520 >> v2:172.21.15.171:3300/0 conn(0x7f7b240b3370 msgr2=0x7f7b240b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.675+0000 7f7b23400640 1 --2- 172.21.15.106:0/2127486520 >> v2:172.21.15.171:3300/0 conn(0x7f7b240b3370 0x7f7b240b37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.675+0000 7f7b23400640 1 -- 172.21.15.106:0/2127486520 >> v1:172.21.15.106:6789/0 conn(0x7f7b240ada10 legacy=0x7f7b240b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.675+0000 7f7b23400640 1 -- 172.21.15.106:0/2127486520 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b240b0360 con 0x7f7b240b1120 2024-08-17T02:27:57.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.677+0000 7f38e3400640 1 --2- 172.21.15.106:0/3038768565 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38dc0e2020 0x7f38dc0e4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.677+0000 7f975fe00640 1 --2- 172.21.15.106:0/1548808544 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f975803b3f0 0x7f97580503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.677+0000 7f38e2000640 1 --2- 172.21.15.106:0/3038768565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38dc03b3f0 0x7f38dc0f2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.677+0000 7f7b23400640 1 --2- 172.21.15.106:0/2127486520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b240b1120 0x7f7b240aedf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7b10009850 tx=0x7f7b100090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=867b1f3760928062 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.677+0000 7f9764e00640 1 -- 172.21.15.106:0/1548808544 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97580e2020 msgr2=0x7f975804eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.677+0000 7f9764e00640 1 --2- 172.21.15.106:0/1548808544 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97580e2020 0x7f975804eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.677+0000 7f9764e00640 1 -- 172.21.15.106:0/1548808544 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f975803b3f0 msgr2=0x7f97580503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.677+0000 7f9764e00640 1 --2- 172.21.15.106:0/1548808544 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f975803b3f0 0x7f97580503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.677+0000 7f9764e00640 1 -- 172.21.15.106:0/1548808544 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9754009450 con 0x7f9758039260 2024-08-17T02:27:57.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.677+0000 7fd8b3e00640 1 --2- 172.21.15.106:0/1471930091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8b40ca8a0 0x7fd8b40b4310 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac0099f0 tx=0x7fd8ac037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.677+0000 7f31f8200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31f00ada10 0x7f31f009d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.677+0000 7f38e2a00640 1 -- 172.21.15.106:0/3038768565 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38dc0e2020 msgr2=0x7f38dc0e4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.677+0000 7f38e2a00640 1 --2- 172.21.15.106:0/3038768565 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38dc0e2020 0x7f38dc0e4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.677+0000 7f38e2a00640 1 -- 172.21.15.106:0/3038768565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38dc03b3f0 msgr2=0x7f38dc0f2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.677+0000 7f31f8200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31f00b1120 0x7f31f00cee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.678+0000 7f31f8200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31f00b38b0 0x7f31f0157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.678+0000 7f31f8200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f0099e30 con 0x7f31f00b38b0 2024-08-17T02:27:57.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.678+0000 7f31f8200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f009c8c0 con 0x7f31f00ada10 2024-08-17T02:27:57.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.678+0000 7f31f8200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f0169cd0 con 0x7f31f00b1120 2024-08-17T02:27:57.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.677+0000 7f38e2a00640 1 --2- 172.21.15.106:0/3038768565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38dc03b3f0 0x7f38dc0f2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.677+0000 7f38e2a00640 1 -- 172.21.15.106:0/3038768565 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d0009450 con 0x7f38dc039090 2024-08-17T02:27:57.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.678+0000 7f38e2000640 1 --2- 172.21.15.106:0/3038768565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38dc03b3f0 0x7f38dc0f2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:57.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.678+0000 7f7b22a00640 1 -- 172.21.15.106:0/2127486520 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1002ae40 con 0x7f7b240b1120 2024-08-17T02:27:57.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.678+0000 7f7b22a00640 1 -- 172.21.15.106:0/2127486520 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b10032440 con 0x7f7b240b1120 2024-08-17T02:27:57.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.678+0000 7f4a77e00640 1 Processor -- start 2024-08-17T02:27:57.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.678+0000 7f31f4e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31f00b1120 0x7f31f00cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.678+0000 7f31f6200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31f00b38b0 0x7f31f0157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.678+0000 7f31f4e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31f00b1120 0x7f31f00cee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:52510/0 (socket says 172.21.15.106:52510) 2024-08-17T02:27:57.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.678+0000 7f31f4e00640 1 -- 172.21.15.106:0/2086426631 learned_addr learned my addr 172.21.15.106:0/2086426631 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:57.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.678+0000 7f31f5800640 1 --2- 172.21.15.106:0/2086426631 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31f00ada10 0x7f31f009d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.678+0000 7fd8ab400640 1 -- 172.21.15.106:0/1471930091 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac031ac0 con 0x7fd8b40ca8a0 2024-08-17T02:27:57.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.678+0000 7fd8ab400640 1 -- 172.21.15.106:0/1471930091 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ac031c20 con 0x7fd8b40ca8a0 2024-08-17T02:27:57.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.678+0000 7fd8ab400640 1 -- 172.21.15.106:0/1471930091 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac03c420 con 0x7fd8b40ca8a0 2024-08-17T02:27:57.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.678+0000 7f4a77e00640 1 -- start start 2024-08-17T02:27:57.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.678+0000 7fd8b9800640 1 -- 172.21.15.106:0/1471930091 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b40b4f70 con 0x7fd8b40ca8a0 2024-08-17T02:27:57.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.678+0000 7f9764e00640 1 --2- 172.21.15.106:0/1548808544 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9758039260 0x7f97580fa860 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9754031000 tx=0x7f9754032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.678+0000 7fd8b9800640 1 -- 172.21.15.106:0/1471930091 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b40c4190 con 0x7fd8b40ca8a0 2024-08-17T02:27:57.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.679+0000 7f31f6200640 1 -- 172.21.15.106:0/2086426631 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31f00b1120 msgr2=0x7f31f00cee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.679+0000 7f9753e00640 1 -- 172.21.15.106:0/1548808544 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9754031900 con 0x7f9758039260 2024-08-17T02:27:57.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.679+0000 7f4a52a00640 1 --2- 172.21.15.106:0/2632104232 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4a340652a0 0x7f4a34067750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4a48034000 tx=0x7f4a48032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.679+0000 7f9753e00640 1 -- 172.21.15.106:0/1548808544 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9754031a60 con 0x7f9758039260 2024-08-17T02:27:57.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.679+0000 7f9766200640 1 -- 172.21.15.106:0/1548808544 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9758050ed0 con 0x7f9758039260 2024-08-17T02:27:57.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.679+0000 7f9753e00640 1 -- 172.21.15.106:0/1548808544 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9754031e40 con 0x7f9758039260 2024-08-17T02:27:57.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.679+0000 7f9766200640 1 -- 172.21.15.106:0/1548808544 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9758051490 con 0x7f9758039260 2024-08-17T02:27:57.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.679+0000 7f4cdb400640 1 -- 172.21.15.106:0/4116350033 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc004e80 con 0x7f4ce40dd2d0 2024-08-17T02:27:57.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.679+0000 7f4cdb400640 1 -- 172.21.15.106:0/4116350033 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cdc0133f0 con 0x7f4ce40dd2d0 2024-08-17T02:27:57.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.679+0000 7f4cdb400640 1 -- 172.21.15.106:0/4116350033 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc013790 con 0x7f4ce40dd2d0 2024-08-17T02:27:57.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.679+0000 7f4cf1c00640 1 -- 172.21.15.106:0/4116350033 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce40dcad0 con 0x7f4ce40dd2d0 2024-08-17T02:27:57.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.679+0000 7f4cf1c00640 1 -- 172.21.15.106:0/4116350033 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce40e4940 con 0x7f4ce40dd2d0 2024-08-17T02:27:57.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.679+0000 7f31f6200640 1 --2- 172.21.15.106:0/2086426631 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31f00b1120 0x7f31f00cee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.679+0000 7f31f6200640 1 -- 172.21.15.106:0/2086426631 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31f00ada10 msgr2=0x7f31f009d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.679+0000 7f31f6200640 1 --2- 172.21.15.106:0/2086426631 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31f00ada10 0x7f31f009d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.679+0000 7f31f6200640 1 -- 172.21.15.106:0/2086426631 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e0009450 con 0x7f31f00b38b0 2024-08-17T02:27:57.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.679+0000 7f31f5800640 1 --2- 172.21.15.106:0/2086426631 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31f00ada10 0x7f31f009d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:57.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.679+0000 7f31f6200640 1 --2- 172.21.15.106:0/2086426631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31f00b38b0 0x7f31f0157ac0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f31e0031000 tx=0x7f31e0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.679+0000 7f31f4e00640 1 --2- 172.21.15.106:0/2086426631 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31f00b1120 0x7f31f00cee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:57.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.679+0000 7f7b2b200640 1 -- 172.21.15.106:0/2127486520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b240b1120 msgr2=0x7f7b240aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.679+0000 7f7b2b200640 1 --2- 172.21.15.106:0/2127486520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b240b1120 0x7f7b240aedf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7b10009850 tx=0x7f7b100090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.679+0000 7f7b2b200640 1 -- 172.21.15.106:0/2127486520 shutdown_connections 2024-08-17T02:27:57.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.679+0000 7f7b2b200640 1 --2- 172.21.15.106:0/2127486520 >> v2:172.21.15.171:3300/0 conn(0x7f7b240b3370 0x7f7b240b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.679+0000 7f7b2b200640 1 --2- 172.21.15.106:0/2127486520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b240b1120 0x7f7b240aedf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.679+0000 7f7b2b200640 1 -- 172.21.15.106:0/2127486520 >> 172.21.15.106:0/2127486520 conn(0x7f7b240cfdf0 msgr2=0x7f7b240d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.679+0000 7f38e2a00640 1 --2- 172.21.15.106:0/3038768565 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38dc039090 0x7f38dc005dc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f38d000ea30 tx=0x7f38d00091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.680+0000 7f7b2b200640 1 -- 172.21.15.106:0/2127486520 shutdown_connections 2024-08-17T02:27:57.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.680+0000 7f31ecc00640 1 -- 172.21.15.106:0/2086426631 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e003e450 con 0x7f31f00b38b0 2024-08-17T02:27:57.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.680+0000 7f7b2b200640 1 -- 172.21.15.106:0/2127486520 wait complete. 2024-08-17T02:27:57.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.680+0000 7f4a77e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4a780cc9d0 0x7f4a780ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.680+0000 7f4a77e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a780cf9d0 con 0x7f4a780cd700 2024-08-17T02:27:57.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.680+0000 7f4a77e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a780ceb60 con 0x7f4a78158c80 2024-08-17T02:27:57.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.680+0000 7f4a77e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a780cedc0 con 0x7f4a780cc9d0 2024-08-17T02:27:57.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.680+0000 7f31ecc00640 1 -- 172.21.15.106:0/2086426631 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e003e5b0 con 0x7f31f00b38b0 2024-08-17T02:27:57.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.680+0000 7f31ecc00640 1 -- 172.21.15.106:0/2086426631 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e003e970 con 0x7f31f00b38b0 2024-08-17T02:27:57.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.681+0000 7f4a46a00640 1 -- 172.21.15.106:0/2632104232 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4a4c0f6590 con 0x7f4a3c004780 2024-08-17T02:27:57.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.681+0000 7f4a77400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4a780cc9d0 0x7f4a780ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.681+0000 7f4a6e000640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f4a780cd700 0x7f4a780acfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39936/0 (socket says 172.21.15.106:39936) 2024-08-17T02:27:57.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.681+0000 7f4a6e000640 1 -- 172.21.15.106:0/610859009 learned_addr learned my addr 172.21.15.106:0/610859009 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:57.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.682+0000 7f38da000640 1 -- 172.21.15.106:0/3038768565 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d000ca10 con 0x7f38dc039090 2024-08-17T02:27:57.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.682+0000 7f4cf1c00640 1 -- 172.21.15.106:0/4116350033 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cc8005210 con 0x7f4ce40dd2d0 2024-08-17T02:27:57.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.682+0000 7f38da000640 1 -- 172.21.15.106:0/3038768565 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d000cb70 con 0x7f38dc039090 2024-08-17T02:27:57.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.682+0000 7f38da000640 1 -- 172.21.15.106:0/3038768565 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d0013470 con 0x7f38dc039090 2024-08-17T02:27:57.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.681+0000 7f4a77400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4a780cc9d0 0x7f4a780ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56682/0 (socket says 172.21.15.106:56682) 2024-08-17T02:27:57.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.682+0000 7f38e3e00640 1 -- 172.21.15.106:0/3038768565 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d4009390 con 0x7f38dc039090 2024-08-17T02:27:57.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.682+0000 7f9766200640 1 -- 172.21.15.106:0/1548808544 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9758050960 con 0x7f9758039260 2024-08-17T02:27:57.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.682+0000 7f9753e00640 1 -- 172.21.15.106:0/1548808544 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9754039070 con 0x7f9758039260 2024-08-17T02:27:57.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.682+0000 7f7b2b200640 1 Processor -- start 2024-08-17T02:27:57.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.682+0000 7f31f8200640 1 -- 172.21.15.106:0/2086426631 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f009d140 con 0x7f31f00b38b0 2024-08-17T02:27:57.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.683+0000 7f38e3e00640 1 -- 172.21.15.106:0/3038768565 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38dc051eb0 con 0x7f38dc039090 2024-08-17T02:27:57.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.683+0000 7f4a77400640 1 -- 172.21.15.106:0/610859009 >> v1:172.21.15.171:6789/0 conn(0x7f4a78158c80 legacy=0x7f4a780cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:57.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.683+0000 7f4a76000640 1 -- 172.21.15.106:0/610859009 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3391318743 0 0) 0x7f4a780cf9d0 con 0x7f4a780cd700 2024-08-17T02:27:57.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.682+0000 7f31f8200640 1 -- 172.21.15.106:0/2086426631 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f009cb70 con 0x7f31f00b38b0 2024-08-17T02:27:57.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.683+0000 7f7b2b200640 1 -- start start 2024-08-17T02:27:57.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.683+0000 7f9753e00640 1 --2- 172.21.15.106:0/1548808544 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9740065250 0x7f9740067700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.683+0000 7fd8b9800640 1 -- 172.21.15.106:0/1471930091 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b40c43b0 con 0x7fd8b40ca8a0 2024-08-17T02:27:57.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.684+0000 7f9753e00640 1 -- 172.21.15.106:0/1548808544 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f97540a2d80 con 0x7f9758039260 2024-08-17T02:27:57.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.683+0000 7f4cdb400640 1 -- 172.21.15.106:0/4116350033 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4cdc013b40 con 0x7f4ce40dd2d0 2024-08-17T02:27:57.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.683+0000 7f4a77400640 1 -- 172.21.15.106:0/610859009 >> v1:172.21.15.106:6789/0 conn(0x7f4a780cd700 legacy=0x7f4a780acfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.683+0000 7f4a77400640 1 -- 172.21.15.106:0/610859009 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a780cf0a0 con 0x7f4a780cc9d0 2024-08-17T02:27:57.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.685+0000 7fd8ab400640 1 -- 172.21.15.106:0/1471930091 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd8ac03c7b0 con 0x7fd8b40ca8a0 2024-08-17T02:27:57.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.685+0000 7f975fe00640 1 --2- 172.21.15.106:0/1548808544 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9740065250 0x7f9740067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.685+0000 7f4cdb400640 1 --2- 172.21.15.106:0/4116350033 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4cd00652a0 0x7f4cd0067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.685+0000 7f4cdb400640 1 -- 172.21.15.106:0/4116350033 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4cdc081ea0 con 0x7f4ce40dd2d0 2024-08-17T02:27:57.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.685+0000 7f4a77400640 1 --2- 172.21.15.106:0/610859009 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a780cc9d0 0x7f4a780ce620 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4a70009850 tx=0x7f4a700090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb634dc29b99359 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.685+0000 7f7b2b200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b240ada10 0x7f7b240ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.685+0000 7f7b2b200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b240b1120 0x7f7b2416c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.686+0000 7f7b2b200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b240b3370 0x7f7b240ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.686+0000 7f7b23e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b240ada10 0x7f7b240ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.686+0000 7f31f8200640 1 -- 172.21.15.106:0/2086426631 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f009d2d0 con 0x7f31f00b38b0 2024-08-17T02:27:57.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.686+0000 7f7b23e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b240ada10 0x7f7b240ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:58348/0 (socket says 172.21.15.106:58348) 2024-08-17T02:27:57.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.686+0000 7f7b23400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b240b1120 0x7f7b2416c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.686+0000 7f7b23400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b240b1120 0x7f7b2416c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56698/0 (socket says 172.21.15.106:56698) 2024-08-17T02:27:57.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.686+0000 7f7b23e00640 1 -- 172.21.15.106:0/2407227702 learned_addr learned my addr 172.21.15.106:0/2407227702 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:57.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.686+0000 7f7b29200640 1 --2- 172.21.15.106:0/2407227702 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b240b3370 0x7f7b240ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.686+0000 7f7b2b200640 1 -- 172.21.15.106:0/2407227702 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b240cc6d0 con 0x7f7b240b1120 2024-08-17T02:27:57.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.686+0000 7f7b2b200640 1 -- 172.21.15.106:0/2407227702 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b240cc0c0 con 0x7f7b240ada10 2024-08-17T02:27:57.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.686+0000 7f7b2b200640 1 -- 172.21.15.106:0/2407227702 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b240ce930 con 0x7f7b240b3370 2024-08-17T02:27:57.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.686+0000 7fd8ab400640 1 --2- 172.21.15.106:0/1471930091 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd8940652a0 0x7fd894067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.686+0000 7fd8ab400640 1 -- 172.21.15.106:0/1471930091 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd8ac0a39d0 con 0x7fd8b40ca8a0 2024-08-17T02:27:57.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.686+0000 7fd8b3400640 1 --2- 172.21.15.106:0/1471930091 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd8940652a0 0x7fd894067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.687+0000 7f4cebe00640 1 --2- 172.21.15.106:0/4116350033 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4cd00652a0 0x7f4cd0067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.687+0000 7f38e3e00640 1 -- 172.21.15.106:0/3038768565 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38bc005210 con 0x7f38dc039090 2024-08-17T02:27:57.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.687+0000 7f975fe00640 1 --2- 172.21.15.106:0/1548808544 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9740065250 0x7f9740067700 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f975804bee0 tx=0x7f974c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.687+0000 7f7b29200640 1 -- 172.21.15.106:0/2407227702 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b240ada10 msgr2=0x7f7b240ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.687+0000 7f7b29200640 1 --2- 172.21.15.106:0/2407227702 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b240ada10 0x7f7b240ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.687+0000 7f7b29200640 1 -- 172.21.15.106:0/2407227702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b240b1120 msgr2=0x7f7b2416c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.687+0000 7f7b29200640 1 --2- 172.21.15.106:0/2407227702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b240b1120 0x7f7b2416c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.687+0000 7f7b29200640 1 -- 172.21.15.106:0/2407227702 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b10009390 con 0x7f7b240b3370 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.687+0000 7f7b23400640 1 --2- 172.21.15.106:0/2407227702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b240b1120 0x7f7b2416c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.688+0000 7f7b23e00640 1 --2- 172.21.15.106:0/2407227702 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b240ada10 0x7f7b240ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.688+0000 7f7b29200640 1 --2- 172.21.15.106:0/2407227702 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b240b3370 0x7f7b240ccb60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c00ecc0 tx=0x7f7b1c00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.688+0000 7f7b1b400640 1 -- 172.21.15.106:0/2407227702 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c00cb30 con 0x7f7b240b3370 2024-08-17T02:27:57.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.688+0000 7f9753e00640 1 -- 172.21.15.106:0/1548808544 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9754070e20 con 0x7f9758039260 2024-08-17T02:27:57.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.689+0000 7f4cdb400640 1 -- 172.21.15.106:0/4116350033 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4cdc04ff40 con 0x7f4ce40dd2d0 2024-08-17T02:27:57.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.688+0000 7f7b2b200640 1 -- 172.21.15.106:0/2407227702 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b2416cf00 con 0x7f7b240b3370 2024-08-17T02:27:57.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.689+0000 7f7b2b200640 1 -- 172.21.15.106:0/2407227702 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b240cc360 con 0x7f7b240b3370 2024-08-17T02:27:57.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.690+0000 7f4cebe00640 1 --2- 172.21.15.106:0/4116350033 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4cd00652a0 0x7f4cd0067750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4cec065d00 tx=0x7f4cec069040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.690+0000 7fd8b3400640 1 --2- 172.21.15.106:0/1471930091 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd8940652a0 0x7fd894067750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd8b40cf800 tx=0x7fd8a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.690+0000 7f31ecc00640 1 -- 172.21.15.106:0/2086426631 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f31e003ece0 con 0x7f31f00b38b0 2024-08-17T02:27:57.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.692+0000 7f31ecc00640 1 --2- 172.21.15.106:0/2086426631 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f31d40651d0 0x7f31d4067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.692+0000 7f31ecc00640 1 -- 172.21.15.106:0/2086426631 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f31e002ae40 con 0x7f31f00b38b0 2024-08-17T02:27:57.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.692+0000 7f7b2b200640 1 -- 172.21.15.106:0/2407227702 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b240cc840 con 0x7f7b240b3370 2024-08-17T02:27:57.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.692+0000 7f38da000640 1 -- 172.21.15.106:0/3038768565 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f38d0013820 con 0x7f38dc039090 2024-08-17T02:27:57.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.693+0000 7f31f5800640 1 --2- 172.21.15.106:0/2086426631 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f31d40651d0 0x7f31d4067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.694+0000 7f38da000640 1 --2- 172.21.15.106:0/3038768565 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f38c40652a0 0x7f38c4067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.694+0000 7f38da000640 1 -- 172.21.15.106:0/3038768565 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f38d0082e50 con 0x7f38dc039090 2024-08-17T02:27:57.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.693+0000 7f7b1b400640 1 -- 172.21.15.106:0/2407227702 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1c00f040 con 0x7f7b240b3370 2024-08-17T02:27:57.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.694+0000 7f7b1b400640 1 -- 172.21.15.106:0/2407227702 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c00cea0 con 0x7f7b240b3370 2024-08-17T02:27:57.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.695+0000 7f38da000640 1 -- 172.21.15.106:0/3038768565 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f38d0051020 con 0x7f38dc039090 2024-08-17T02:27:57.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.695+0000 7fd8ab400640 1 -- 172.21.15.106:0/1471930091 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd8ac071b20 con 0x7fd8b40ca8a0 2024-08-17T02:27:57.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.694+0000 7f31f5800640 1 --2- 172.21.15.106:0/2086426631 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f31d40651d0 0x7f31d4067680 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f31e8009a00 tx=0x7f31e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.695+0000 7f38e2000640 1 --2- 172.21.15.106:0/3038768565 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f38c40652a0 0x7f38c4067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.696+0000 7f4a76000640 1 -- 172.21.15.106:0/610859009 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7002adb0 con 0x7f4a780cc9d0 2024-08-17T02:27:57.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.696+0000 7f38e2000640 1 --2- 172.21.15.106:0/3038768565 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f38c40652a0 0x7f38c4067750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f38d4034000 tx=0x7f38d4032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.697+0000 7f7b1b400640 1 -- 172.21.15.106:0/2407227702 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7b1c014690 con 0x7f7b240b3370 2024-08-17T02:27:57.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.698+0000 7f7b1b400640 1 --2- 172.21.15.106:0/2407227702 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7b04065180 0x7f7b04067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.699+0000 7f7b1b400640 1 -- 172.21.15.106:0/2407227702 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7b1c083770 con 0x7f7b240b3370 2024-08-17T02:27:57.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.699+0000 7f7b1b400640 1 -- 172.21.15.106:0/2407227702 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7b1c01d400 con 0x7f7b240b3370 2024-08-17T02:27:57.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.699+0000 7f7b23e00640 1 --2- 172.21.15.106:0/2407227702 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7b04065180 0x7f7b04067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.700+0000 7f7b23e00640 1 --2- 172.21.15.106:0/2407227702 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7b04065180 0x7f7b04067630 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7b14007fd0 tx=0x7f7b14009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.702+0000 7f31ecc00640 1 -- 172.21.15.106:0/2086426631 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f31e0070b40 con 0x7f31f00b38b0 2024-08-17T02:27:57.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.703+0000 7f4a76000640 1 -- 172.21.15.106:0/610859009 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a70032440 con 0x7f4a780cc9d0 2024-08-17T02:27:57.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.703+0000 7f4a76000640 1 -- 172.21.15.106:0/610859009 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a700327e0 con 0x7f4a780cc9d0 2024-08-17T02:27:57.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.704+0000 7f4a77e00640 1 -- 172.21.15.106:0/610859009 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a780cc9d0 msgr2=0x7f4a780ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.704+0000 7f4a77e00640 1 --2- 172.21.15.106:0/610859009 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a780cc9d0 0x7f4a780ce620 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4a70009850 tx=0x7f4a700090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.704+0000 7f4a77e00640 1 -- 172.21.15.106:0/610859009 shutdown_connections 2024-08-17T02:27:57.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.704+0000 7f4a77e00640 1 --2- 172.21.15.106:0/610859009 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a780cc9d0 0x7f4a780ce620 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.705+0000 7f4a77e00640 1 -- 172.21.15.106:0/610859009 >> 172.21.15.106:0/610859009 conn(0x7f4a78098e30 msgr2=0x7f4a7806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:57.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.707+0000 7f4a77e00640 1 -- 172.21.15.106:0/610859009 shutdown_connections 2024-08-17T02:27:57.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.707+0000 7f4a77e00640 1 -- 172.21.15.106:0/610859009 wait complete. 2024-08-17T02:27:57.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.710+0000 7f4a77e00640 1 Processor -- start 2024-08-17T02:27:57.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.711+0000 7f4a77e00640 1 -- start start 2024-08-17T02:27:57.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.713+0000 7f4a77e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a780cc9d0 0x7f4a78169200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.713+0000 7f4a77e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a780cd700 0x7f4a78151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.713+0000 7f4a77e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a78158c80 0x7f4a780c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.713+0000 7f4a6e000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a780cd700 0x7f4a78151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.713+0000 7f4a6e000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a780cd700 0x7f4a78151270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56712/0 (socket says 172.21.15.106:56712) 2024-08-17T02:27:57.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.713+0000 7f4a6e000640 1 -- 172.21.15.106:0/3196131095 learned_addr learned my addr 172.21.15.106:0/3196131095 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:57.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.713+0000 7f4a76a00640 1 --2- 172.21.15.106:0/3196131095 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a780cc9d0 0x7f4a78169200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.713+0000 7f4a77400640 1 --2- 172.21.15.106:0/3196131095 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a78158c80 0x7f4a780c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.713+0000 7f4a77e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7816bd90 con 0x7f4a780cd700 2024-08-17T02:27:57.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.714+0000 7f4a77e00640 1 -- 172.21.15.106:0/3196131095 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7816cbf0 con 0x7f4a78158c80 2024-08-17T02:27:57.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.714+0000 7f4a77e00640 1 -- 172.21.15.106:0/3196131095 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a78169740 con 0x7f4a780cc9d0 2024-08-17T02:27:57.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.714+0000 7f4a77400640 1 -- 172.21.15.106:0/3196131095 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a780cc9d0 msgr2=0x7f4a78169200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.714+0000 7f4a77400640 1 --2- 172.21.15.106:0/3196131095 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a780cc9d0 0x7f4a78169200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.716+0000 7f4a77400640 1 -- 172.21.15.106:0/3196131095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a780cd700 msgr2=0x7f4a78151270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:57.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.716+0000 7f4a77400640 1 --2- 172.21.15.106:0/3196131095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a780cd700 0x7f4a78151270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:57.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.716+0000 7f4a77400640 1 -- 172.21.15.106:0/3196131095 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a70009390 con 0x7f4a78158c80 2024-08-17T02:27:57.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.716+0000 7f4a6e000640 1 --2- 172.21.15.106:0/3196131095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a780cd700 0x7f4a78151270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:57.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.716+0000 7f4a77400640 1 --2- 172.21.15.106:0/3196131095 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a78158c80 0x7f4a780c5c20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4a70031000 tx=0x7f4a70032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.717+0000 7f4a6ea00640 1 -- 172.21.15.106:0/3196131095 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a70031bf0 con 0x7f4a78158c80 2024-08-17T02:27:57.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.717+0000 7f4a6ea00640 1 -- 172.21.15.106:0/3196131095 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a70031d50 con 0x7f4a78158c80 2024-08-17T02:27:57.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.717+0000 7f4a6ea00640 1 -- 172.21.15.106:0/3196131095 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7003e660 con 0x7f4a78158c80 2024-08-17T02:27:57.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.718+0000 7f4a77e00640 1 -- 172.21.15.106:0/3196131095 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a781517b0 con 0x7f4a78158c80 2024-08-17T02:27:57.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.718+0000 7f4a77e00640 1 -- 172.21.15.106:0/3196131095 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a7816c2c0 con 0x7f4a78158c80 2024-08-17T02:27:57.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.719+0000 7f4a77e00640 1 -- 172.21.15.106:0/3196131095 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a78071050 con 0x7f4a78158c80 2024-08-17T02:27:57.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.721+0000 7f4a6ea00640 1 -- 172.21.15.106:0/3196131095 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4a7003ea50 con 0x7f4a78158c80 2024-08-17T02:27:57.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.722+0000 7f4a6ea00640 1 --2- 172.21.15.106:0/3196131095 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4a54065150 0x7f4a54067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:57.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.722+0000 7f4a6ea00640 1 -- 172.21.15.106:0/3196131095 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4a700a29a0 con 0x7f4a78158c80 2024-08-17T02:27:57.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.724+0000 7f4a76a00640 1 --2- 172.21.15.106:0/3196131095 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4a54065150 0x7f4a54067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:57.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.725+0000 7f4a76a00640 1 --2- 172.21.15.106:0/3196131095 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4a54065150 0x7f4a54067600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4a68003720 tx=0x7f4a68009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:57.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:57.729+0000 7f4a6ea00640 1 -- 172.21.15.106:0/3196131095 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4a700709c0 con 0x7f4a78158c80 2024-08-17T02:27:58.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.088+0000 7f4a5a200640 1 -- 172.21.15.106:0/2632104232 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4a4c0f6590 con 0x7f4a3c004780 2024-08-17T02:27:58.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.089+0000 7f4a46a00640 1 -- 172.21.15.106:0/2632104232 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4a4c0f6590 con 0x7f4a3c004780 2024-08-17T02:27:58.091 INFO:teuthology.orchestra.run.smithi106.stdout:55834574852 2024-08-17T02:27:58.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.093+0000 7f4a5a200640 1 -- 172.21.15.106:0/2632104232 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4a340652a0 msgr2=0x7f4a34067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.093+0000 7f4a5a200640 1 --2- 172.21.15.106:0/2632104232 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4a340652a0 0x7f4a34067750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4a48034000 tx=0x7f4a48032000 comp rx=0 tx=0).stop 2024-08-17T02:27:58.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.093+0000 7f4a5a200640 1 -- 172.21.15.106:0/2632104232 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a3c004780 msgr2=0x7f4a4c04c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.093+0000 7f4a5a200640 1 --2- 172.21.15.106:0/2632104232 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a3c004780 0x7f4a4c04c5a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4a54065d00 tx=0x7f4a54069040 comp rx=0 tx=0).stop 2024-08-17T02:27:58.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.094+0000 7f4a5a200640 1 -- 172.21.15.106:0/2632104232 shutdown_connections 2024-08-17T02:27:58.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.094+0000 7f4a5a200640 1 --2- 172.21.15.106:0/2632104232 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a4c0d65e0 0x7f4a4c0f2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.094+0000 7f4a5a200640 1 --2- 172.21.15.106:0/2632104232 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4a340652a0 0x7f4a34067750 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.094+0000 7f4a5a200640 1 --2- 172.21.15.106:0/2632104232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a4c03a2f0 0x7f4a4c0f6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.094+0000 7f4a5a200640 1 --2- 172.21.15.106:0/2632104232 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a3c004780 0x7f4a4c04c5a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.094+0000 7f4a5a200640 1 -- 172.21.15.106:0/2632104232 >> 172.21.15.106:0/2632104232 conn(0x7f4a4c051630 msgr2=0x7f4a4c049cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:58.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.095+0000 7f4a5a200640 1 -- 172.21.15.106:0/2632104232 shutdown_connections 2024-08-17T02:27:58.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.095+0000 7f4a5a200640 1 -- 172.21.15.106:0/2632104232 wait complete. 2024-08-17T02:27:58.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.098+0000 7f4cf1c00640 1 -- 172.21.15.106:0/4116350033 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4cc80054c0 con 0x7f4ce40dd2d0 2024-08-17T02:27:58.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.099+0000 7f4cdb400640 1 -- 172.21.15.106:0/4116350033 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4cdc053560 con 0x7f4ce40dd2d0 2024-08-17T02:27:58.101 INFO:teuthology.orchestra.run.smithi106.stdout:55834574853 2024-08-17T02:27:58.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.103+0000 7f4cf1c00640 1 -- 172.21.15.106:0/4116350033 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4cd00652a0 msgr2=0x7f4cd0067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.103+0000 7f4cf1c00640 1 --2- 172.21.15.106:0/4116350033 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4cd00652a0 0x7f4cd0067750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4cec065d00 tx=0x7f4cec069040 comp rx=0 tx=0).stop 2024-08-17T02:27:58.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.103+0000 7f4cf1c00640 1 -- 172.21.15.106:0/4116350033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ce40dd2d0 msgr2=0x7f4ce40ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.103+0000 7f4cf1c00640 1 --2- 172.21.15.106:0/4116350033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ce40dd2d0 0x7f4ce40ce350 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4051ee0 tx=0x7f4ce40533c0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.104+0000 7f4cf1c00640 1 -- 172.21.15.106:0/4116350033 shutdown_connections 2024-08-17T02:27:58.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.104+0000 7f4cf1c00640 1 --2- 172.21.15.106:0/4116350033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ce40dd2d0 0x7f4ce40ce350 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.104+0000 7f4cf1c00640 1 --2- 172.21.15.106:0/4116350033 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4cd00652a0 0x7f4cd0067750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.104+0000 7f4cf1c00640 1 --2- 172.21.15.106:0/4116350033 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ce4009270 0x7f4ce40e4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.104+0000 7f9766200640 1 -- 172.21.15.106:0/1548808544 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9758005770 con 0x7f9758039260 2024-08-17T02:27:58.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.104+0000 7f4cf1c00640 1 --2- 172.21.15.106:0/4116350033 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cd4004000 0x7f4ce4008d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.104+0000 7f4cf1c00640 1 -- 172.21.15.106:0/4116350033 >> 172.21.15.106:0/4116350033 conn(0x7f4ce4057870 msgr2=0x7f4ce40dfca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:58.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.105+0000 7f4cf1c00640 1 -- 172.21.15.106:0/4116350033 shutdown_connections 2024-08-17T02:27:58.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.105+0000 7f4cf1c00640 1 -- 172.21.15.106:0/4116350033 wait complete. 2024-08-17T02:27:58.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.105+0000 7f9753e00640 1 -- 172.21.15.106:0/1548808544 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9754040090 con 0x7f9758039260 2024-08-17T02:27:58.106 INFO:teuthology.orchestra.run.smithi106.stdout:55834574853 2024-08-17T02:27:58.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.107+0000 7f31f8200640 1 -- 172.21.15.106:0/2086426631 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f31f0064db0 con 0x7f31f00b38b0 2024-08-17T02:27:58.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.108+0000 7f9766200640 1 -- 172.21.15.106:0/1548808544 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9740065250 msgr2=0x7f9740067700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.108+0000 7f9766200640 1 --2- 172.21.15.106:0/1548808544 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9740065250 0x7f9740067700 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f975804bee0 tx=0x7f974c008040 comp rx=0 tx=0).stop 2024-08-17T02:27:58.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.108+0000 7f9766200640 1 -- 172.21.15.106:0/1548808544 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9758039260 msgr2=0x7f97580fa860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.108+0000 7f9766200640 1 --2- 172.21.15.106:0/1548808544 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9758039260 0x7f97580fa860 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9754031000 tx=0x7f9754032000 comp rx=0 tx=0).stop 2024-08-17T02:27:58.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.109+0000 7f9766200640 1 -- 172.21.15.106:0/1548808544 shutdown_connections 2024-08-17T02:27:58.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.109+0000 7f9766200640 1 --2- 172.21.15.106:0/1548808544 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f97580e2020 0x7f975804eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.109+0000 7f9766200640 1 --2- 172.21.15.106:0/1548808544 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9740065250 0x7f9740067700 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.109+0000 7f9766200640 1 --2- 172.21.15.106:0/1548808544 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f975803b3f0 0x7f97580503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.109+0000 7f9766200640 1 --2- 172.21.15.106:0/1548808544 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9758039260 0x7f97580fa860 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.109+0000 7f9766200640 1 -- 172.21.15.106:0/1548808544 >> 172.21.15.106:0/1548808544 conn(0x7f975800f050 msgr2=0x7f975803be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:58.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.109+0000 7f9766200640 1 -- 172.21.15.106:0/1548808544 shutdown_connections 2024-08-17T02:27:58.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.110+0000 7f9766200640 1 -- 172.21.15.106:0/1548808544 wait complete. 2024-08-17T02:27:58.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.111+0000 7fd8b9800640 1 -- 172.21.15.106:0/1471930091 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd8b4071050 con 0x7fd8b40ca8a0 2024-08-17T02:27:58.113 INFO:teuthology.orchestra.run.smithi106.stdout:55834574853 2024-08-17T02:27:58.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.108+0000 7f31ecc00640 1 -- 172.21.15.106:0/2086426631 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f31e0074160 con 0x7f31f00b38b0 2024-08-17T02:27:58.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.111+0000 7f7b2b200640 1 -- 172.21.15.106:0/2407227702 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f7b24064db0 con 0x7f7b240b3370 2024-08-17T02:27:58.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.111+0000 7fd8ab400640 1 -- 172.21.15.106:0/1471930091 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd8ac04b090 con 0x7fd8b40ca8a0 2024-08-17T02:27:58.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.111+0000 7f7b1b400640 1 -- 172.21.15.106:0/2407227702 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7b1c054ed0 con 0x7f7b240b3370 2024-08-17T02:27:58.115 INFO:teuthology.orchestra.run.smithi106.stdout:55834574853 2024-08-17T02:27:58.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.112+0000 7f38e3e00640 1 -- 172.21.15.106:0/3038768565 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f38bc005790 con 0x7f38dc039090 2024-08-17T02:27:58.115 INFO:teuthology.orchestra.run.smithi106.stdout:55834574852 2024-08-17T02:27:58.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.112+0000 7f31f8200640 1 -- 172.21.15.106:0/2086426631 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f31d40651d0 msgr2=0x7f31d4067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.113+0000 7f31f8200640 1 --2- 172.21.15.106:0/2086426631 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f31d40651d0 0x7f31d4067680 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f31e8009a00 tx=0x7f31e8008040 comp rx=0 tx=0).stop 2024-08-17T02:27:58.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.113+0000 7f31f8200640 1 -- 172.21.15.106:0/2086426631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31f00b38b0 msgr2=0x7f31f0157ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.113+0000 7f31f8200640 1 --2- 172.21.15.106:0/2086426631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31f00b38b0 0x7f31f0157ac0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f31e0031000 tx=0x7f31e0032000 comp rx=0 tx=0).stop 2024-08-17T02:27:58.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.113+0000 7f31f8200640 1 -- 172.21.15.106:0/2086426631 shutdown_connections 2024-08-17T02:27:58.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.113+0000 7f31f8200640 1 --2- 172.21.15.106:0/2086426631 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f31d40651d0 0x7f31d4067680 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.113+0000 7f31f8200640 1 --2- 172.21.15.106:0/2086426631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31f00b38b0 0x7f31f0157ac0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.113+0000 7f31f8200640 1 --2- 172.21.15.106:0/2086426631 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f31f00b1120 0x7f31f00cee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.114+0000 7f38da000640 1 -- 172.21.15.106:0/3038768565 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f38d0054640 con 0x7f38dc039090 2024-08-17T02:27:58.118 INFO:teuthology.orchestra.run.smithi106.stdout:55834574853 2024-08-17T02:27:58.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.113+0000 7f31f8200640 1 --2- 172.21.15.106:0/2086426631 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31f00ada10 0x7f31f009d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.113+0000 7f31f8200640 1 -- 172.21.15.106:0/2086426631 >> 172.21.15.106:0/2086426631 conn(0x7f31f00cfdf0 msgr2=0x7f31f00b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:58.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.114+0000 7f31f8200640 1 -- 172.21.15.106:0/2086426631 shutdown_connections 2024-08-17T02:27:58.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.114+0000 7f31f8200640 1 -- 172.21.15.106:0/2086426631 wait complete. 2024-08-17T02:27:58.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.115+0000 7f7b2b200640 1 -- 172.21.15.106:0/2407227702 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7b04065180 msgr2=0x7f7b04067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.115+0000 7fd8b9800640 1 -- 172.21.15.106:0/1471930091 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd8940652a0 msgr2=0x7fd894067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.115+0000 7fd8b9800640 1 --2- 172.21.15.106:0/1471930091 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd8940652a0 0x7fd894067750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd8b40cf800 tx=0x7fd8a4008040 comp rx=0 tx=0).stop 2024-08-17T02:27:58.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.115+0000 7fd8b9800640 1 -- 172.21.15.106:0/1471930091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8b40ca8a0 msgr2=0x7fd8b40b4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.115+0000 7fd8b9800640 1 --2- 172.21.15.106:0/1471930091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8b40ca8a0 0x7fd8b40b4310 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac0099f0 tx=0x7fd8ac037000 comp rx=0 tx=0).stop 2024-08-17T02:27:58.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.116+0000 7f7b2b200640 1 --2- 172.21.15.106:0/2407227702 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7b04065180 0x7f7b04067630 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7b14007fd0 tx=0x7f7b14009040 comp rx=0 tx=0).stop 2024-08-17T02:27:58.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.116+0000 7f7b2b200640 1 -- 172.21.15.106:0/2407227702 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b240b3370 msgr2=0x7f7b240ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.116+0000 7f7b2b200640 1 --2- 172.21.15.106:0/2407227702 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b240b3370 0x7f7b240ccb60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c00ecc0 tx=0x7f7b1c00b040 comp rx=0 tx=0).stop 2024-08-17T02:27:58.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.116+0000 7fd8b9800640 1 -- 172.21.15.106:0/1471930091 shutdown_connections 2024-08-17T02:27:58.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.116+0000 7fd8b9800640 1 --2- 172.21.15.106:0/1471930091 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd8b4159ca0 0x7fd8b40999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.116+0000 7fd8b9800640 1 --2- 172.21.15.106:0/1471930091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8b40ccad0 0x7fd8b409c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.116+0000 7fd8b9800640 1 --2- 172.21.15.106:0/1471930091 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd8940652a0 0x7fd894067750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.116+0000 7fd8b9800640 1 --2- 172.21.15.106:0/1471930091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8b40ca8a0 0x7fd8b40b4310 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.116+0000 7fd8b9800640 1 -- 172.21.15.106:0/1471930091 >> 172.21.15.106:0/1471930091 conn(0x7fd8b4098e00 msgr2=0x7fd8b4159540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:58.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.116+0000 7f7b2b200640 1 -- 172.21.15.106:0/2407227702 shutdown_connections 2024-08-17T02:27:58.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.116+0000 7f7b2b200640 1 --2- 172.21.15.106:0/2407227702 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7b240b3370 0x7f7b240ccb60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.116+0000 7f7b2b200640 1 --2- 172.21.15.106:0/2407227702 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7b04065180 0x7f7b04067630 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.116+0000 7f7b2b200640 1 --2- 172.21.15.106:0/2407227702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b240b1120 0x7f7b2416c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.116+0000 7f7b2b200640 1 --2- 172.21.15.106:0/2407227702 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7b240ada10 0x7f7b240ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.116+0000 7f7b2b200640 1 -- 172.21.15.106:0/2407227702 >> 172.21.15.106:0/2407227702 conn(0x7f7b240cfdf0 msgr2=0x7f7b240d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:58.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.117+0000 7fd8b9800640 1 -- 172.21.15.106:0/1471930091 shutdown_connections 2024-08-17T02:27:58.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.117+0000 7fd8b9800640 1 -- 172.21.15.106:0/1471930091 wait complete. 2024-08-17T02:27:58.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.117+0000 7f7b2b200640 1 -- 172.21.15.106:0/2407227702 shutdown_connections 2024-08-17T02:27:58.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.118+0000 7f7b2b200640 1 -- 172.21.15.106:0/2407227702 wait complete. 2024-08-17T02:27:58.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.118+0000 7f38e3e00640 1 -- 172.21.15.106:0/3038768565 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f38c40652a0 msgr2=0x7f38c4067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.118+0000 7f38e3e00640 1 --2- 172.21.15.106:0/3038768565 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f38c40652a0 0x7f38c4067750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f38d4034000 tx=0x7f38d4032000 comp rx=0 tx=0).stop 2024-08-17T02:27:58.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.118+0000 7f38e3e00640 1 -- 172.21.15.106:0/3038768565 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38dc039090 msgr2=0x7f38dc005dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.118+0000 7f38e3e00640 1 --2- 172.21.15.106:0/3038768565 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38dc039090 0x7f38dc005dc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f38d000ea30 tx=0x7f38d00091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.119+0000 7f38e3e00640 1 -- 172.21.15.106:0/3038768565 shutdown_connections 2024-08-17T02:27:58.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.119+0000 7f38e3e00640 1 --2- 172.21.15.106:0/3038768565 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38dc0e2020 0x7f38dc0e4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.119+0000 7f38e3e00640 1 --2- 172.21.15.106:0/3038768565 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f38c40652a0 0x7f38c4067750 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.119+0000 7f38e3e00640 1 --2- 172.21.15.106:0/3038768565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38dc03b3f0 0x7f38dc0f2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.119+0000 7f38e3e00640 1 --2- 172.21.15.106:0/3038768565 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38dc039090 0x7f38dc005dc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.119+0000 7f38e3e00640 1 -- 172.21.15.106:0/3038768565 >> 172.21.15.106:0/3038768565 conn(0x7f38dc00f050 msgr2=0x7f38dc0e1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:58.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.120+0000 7f38e3e00640 1 -- 172.21.15.106:0/3038768565 shutdown_connections 2024-08-17T02:27:58.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.120+0000 7f38e3e00640 1 -- 172.21.15.106:0/3038768565 wait complete. 2024-08-17T02:27:58.124 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2024-08-17T02:27:58.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2024-08-17T02:27:58.134 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2024-08-17T02:27:58.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.134+0000 7f4a77e00640 1 -- 172.21.15.106:0/3196131095 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f4a780cbaf0 con 0x7f4a78158c80 2024-08-17T02:27:58.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.135+0000 7f4a6ea00640 1 -- 172.21.15.106:0/3196131095 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4a70042020 con 0x7f4a78158c80 2024-08-17T02:27:58.135 INFO:teuthology.orchestra.run.smithi106.stdout:55834574852 2024-08-17T02:27:58.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.138+0000 7f4a77e00640 1 -- 172.21.15.106:0/3196131095 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4a54065150 msgr2=0x7f4a54067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.138+0000 7f4a77e00640 1 --2- 172.21.15.106:0/3196131095 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4a54065150 0x7f4a54067600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4a68003720 tx=0x7f4a68009040 comp rx=0 tx=0).stop 2024-08-17T02:27:58.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.138+0000 7f4a77e00640 1 -- 172.21.15.106:0/3196131095 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a78158c80 msgr2=0x7f4a780c5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:58.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.138+0000 7f4a77e00640 1 --2- 172.21.15.106:0/3196131095 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a78158c80 0x7f4a780c5c20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4a70031000 tx=0x7f4a70032000 comp rx=0 tx=0).stop 2024-08-17T02:27:58.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.138+0000 7f4a77e00640 1 -- 172.21.15.106:0/3196131095 shutdown_connections 2024-08-17T02:27:58.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.138+0000 7f4a77e00640 1 --2- 172.21.15.106:0/3196131095 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a78158c80 0x7f4a780c5c20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.138+0000 7f4a77e00640 1 --2- 172.21.15.106:0/3196131095 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4a54065150 0x7f4a54067600 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.138+0000 7f4a77e00640 1 --2- 172.21.15.106:0/3196131095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4a780cd700 0x7f4a78151270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.138+0000 7f4a77e00640 1 --2- 172.21.15.106:0/3196131095 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4a780cc9d0 0x7f4a78169200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:58.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.138+0000 7f4a77e00640 1 -- 172.21.15.106:0/3196131095 >> 172.21.15.106:0/3196131095 conn(0x7f4a78098e30 msgr2=0x7f4a781574c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:58.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.140+0000 7f4a77e00640 1 -- 172.21.15.106:0/3196131095 shutdown_connections 2024-08-17T02:27:58.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:58.140+0000 7f4a77e00640 1 -- 172.21.15.106:0/3196131095 wait complete. 2024-08-17T02:27:58.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2024-08-17T02:27:58.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2024-08-17T02:27:58.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-08-17T02:27:58.148 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-08-17T02:27:58.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2024-08-17T02:27:59.125 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:27:59.134 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:27:59.135 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:27:59.143 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:27:59.145 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:27:59.148 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:27:59.148 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:27:59.157 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:27:59.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.348+0000 7fc64fe00640 1 Processor -- start 2024-08-17T02:27:59.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.348+0000 7fc64fe00640 1 -- start start 2024-08-17T02:27:59.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.350+0000 7fc64fe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc64800da90 0x7fc64800de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.350+0000 7fc64fe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc6480358c0 0x7fc6480dfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.350+0000 7fc64fe00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc648054970 con 0x7fc648035d40 2024-08-17T02:27:59.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.350+0000 7fc64fe00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc648055210 con 0x7fc6480358c0 2024-08-17T02:27:59.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.350+0000 7fc64fe00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6480362a0 con 0x7fc64800da90 2024-08-17T02:27:59.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.351+0000 7fc64f400640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fc648035d40 0x7fc6480e3b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:53900/0 (socket says 172.21.15.106:53900) 2024-08-17T02:27:59.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.351+0000 7fc64f400640 1 -- 172.21.15.106:0/4007323004 learned_addr learned my addr 172.21.15.106:0/4007323004 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:59.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.352+0000 7fc64ea00640 1 --2- 172.21.15.106:0/4007323004 >> v2:172.21.15.171:3300/0 conn(0x7fc64800da90 0x7fc64800de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.352+0000 7fc64e000640 1 --2- 172.21.15.106:0/4007323004 >> v2:172.21.15.106:3300/0 conn(0x7fc6480358c0 0x7fc6480dfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.352+0000 7fc64d600640 1 -- 172.21.15.106:0/4007323004 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4270704114 0 0) 0x7fc648054970 con 0x7fc648035d40 2024-08-17T02:27:59.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.352+0000 7fc64d600640 1 -- 172.21.15.106:0/4007323004 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6340034e0 con 0x7fc648035d40 2024-08-17T02:27:59.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.353+0000 7fc64ea00640 1 -- 172.21.15.106:0/4007323004 >> v2:172.21.15.106:3300/0 conn(0x7fc6480358c0 msgr2=0x7fc6480dfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.353+0000 7fc64ea00640 1 --2- 172.21.15.106:0/4007323004 >> v2:172.21.15.106:3300/0 conn(0x7fc6480358c0 0x7fc6480dfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.353+0000 7fc64d600640 1 -- 172.21.15.106:0/4007323004 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3049057194 0 0) 0x7fc6340034e0 con 0x7fc648035d40 2024-08-17T02:27:59.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.353+0000 7fc64ea00640 1 -- 172.21.15.106:0/4007323004 >> v1:172.21.15.171:6789/0 conn(0x7fc648035d40 legacy=0x7fc6480e3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.353+0000 7fc64ea00640 1 -- 172.21.15.106:0/4007323004 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc648054bc0 con 0x7fc64800da90 2024-08-17T02:27:59.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.355+0000 7fc64e000640 1 --2- 172.21.15.106:0/4007323004 >> v2:172.21.15.106:3300/0 conn(0x7fc6480358c0 0x7fc6480dfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:59.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.356+0000 7fc64ea00640 1 --2- 172.21.15.106:0/4007323004 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc64800da90 0x7fc64800de60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc64800ff60 tx=0x7fc6400090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a40b488331872ba server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.356+0000 7fc64d600640 1 -- 172.21.15.106:0/4007323004 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65004b9e0 con 0x7fc64800da90 2024-08-17T02:27:59.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.357+0000 7fc64d600640 1 -- 172.21.15.106:0/4007323004 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64002a8c0 con 0x7fc64800da90 2024-08-17T02:27:59.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.357+0000 7fc64d600640 1 -- 172.21.15.106:0/4007323004 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65004b9e0 con 0x7fc64800da90 2024-08-17T02:27:59.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.358+0000 7fc64fe00640 1 -- 172.21.15.106:0/4007323004 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc64800da90 msgr2=0x7fc64800de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.358+0000 7fc64fe00640 1 --2- 172.21.15.106:0/4007323004 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc64800da90 0x7fc64800de60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc64800ff60 tx=0x7fc6400090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.358+0000 7fc64fe00640 1 -- 172.21.15.106:0/4007323004 shutdown_connections 2024-08-17T02:27:59.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.359+0000 7fc64fe00640 1 --2- 172.21.15.106:0/4007323004 >> v2:172.21.15.106:3300/0 conn(0x7fc6480358c0 0x7fc6480dfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.359+0000 7fc64fe00640 1 --2- 172.21.15.106:0/4007323004 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc64800da90 0x7fc64800de60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.359+0000 7fc64fe00640 1 -- 172.21.15.106:0/4007323004 >> 172.21.15.106:0/4007323004 conn(0x7fc648057870 msgr2=0x7fc648009ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.359+0000 7fc64fe00640 1 -- 172.21.15.106:0/4007323004 shutdown_connections 2024-08-17T02:27:59.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.359+0000 7fc64fe00640 1 -- 172.21.15.106:0/4007323004 wait complete. 2024-08-17T02:27:59.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.363+0000 7fc64fe00640 1 Processor -- start 2024-08-17T02:27:59.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.363+0000 7fc64fe00640 1 -- start start 2024-08-17T02:27:59.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.365+0000 7fc64fe00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc64800da90 0x7fc6480e2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.365+0000 7fc64fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6480358c0 0x7fc6480dfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.366+0000 7fc64fe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc648035d40 0x7fc6480f0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.366+0000 7fc64ea00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc64800da90 0x7fc6480e2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.367+0000 7fc64ea00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc64800da90 0x7fc6480e2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:58358/0 (socket says 172.21.15.106:58358) 2024-08-17T02:27:59.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.367+0000 7fc64ea00640 1 -- 172.21.15.106:0/666090285 learned_addr learned my addr 172.21.15.106:0/666090285 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:59.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.367+0000 7fc64f400640 1 --2- 172.21.15.106:0/666090285 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc648035d40 0x7fc6480f0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.367+0000 7fc64fe00640 1 -- 172.21.15.106:0/666090285 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6480e14a0 con 0x7fc6480358c0 2024-08-17T02:27:59.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.367+0000 7fc64fe00640 1 -- 172.21.15.106:0/666090285 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6480ddb50 con 0x7fc64800da90 2024-08-17T02:27:59.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.368+0000 7fc64fe00640 1 -- 172.21.15.106:0/666090285 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6480e0120 con 0x7fc648035d40 2024-08-17T02:27:59.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.368+0000 7fc64e000640 1 --2- 172.21.15.106:0/666090285 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6480358c0 0x7fc6480dfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.369+0000 7fc64f400640 1 -- 172.21.15.106:0/666090285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc64800da90 msgr2=0x7fc6480e2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.369+0000 7fc64f400640 1 --2- 172.21.15.106:0/666090285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc64800da90 0x7fc6480e2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.369+0000 7fc64f400640 1 -- 172.21.15.106:0/666090285 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6480358c0 msgr2=0x7fc6480dfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.369+0000 7fc64f400640 1 --2- 172.21.15.106:0/666090285 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6480358c0 0x7fc6480dfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.369+0000 7fc64f400640 1 -- 172.21.15.106:0/666090285 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc640009390 con 0x7fc648035d40 2024-08-17T02:27:59.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.370+0000 7fc64ea00640 1 --2- 172.21.15.106:0/666090285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc64800da90 0x7fc6480e2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:59.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.370+0000 7fc64f400640 1 --2- 172.21.15.106:0/666090285 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc648035d40 0x7fc6480f0c40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc650060af0 tx=0x7fc65006f710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.371+0000 7fc646000640 1 -- 172.21.15.106:0/666090285 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6500647c0 con 0x7fc648035d40 2024-08-17T02:27:59.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.372+0000 7fc646000640 1 -- 172.21.15.106:0/666090285 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65006f260 con 0x7fc648035d40 2024-08-17T02:27:59.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.372+0000 7fc646000640 1 -- 172.21.15.106:0/666090285 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65006c630 con 0x7fc648035d40 2024-08-17T02:27:59.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.372+0000 7fc64fe00640 1 -- 172.21.15.106:0/666090285 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6480dd260 con 0x7fc648035d40 2024-08-17T02:27:59.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.372+0000 7fc64fe00640 1 -- 172.21.15.106:0/666090285 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6480dd500 con 0x7fc648035d40 2024-08-17T02:27:59.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.376+0000 7fc646000640 1 -- 172.21.15.106:0/666090285 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc65006c9e0 con 0x7fc648035d40 2024-08-17T02:27:59.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.377+0000 7fc646000640 1 --2- 172.21.15.106:0/666090285 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc6300651d0 0x7fc630067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.377+0000 7fc646000640 1 -- 172.21.15.106:0/666090285 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc65008b030 con 0x7fc648035d40 2024-08-17T02:27:59.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.378+0000 7fc64fe00640 1 -- 172.21.15.106:0/666090285 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6480ddcc0 con 0x7fc648035d40 2024-08-17T02:27:59.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.379+0000 7fc64ea00640 1 --2- 172.21.15.106:0/666090285 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc6300651d0 0x7fc630067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.380+0000 7fc64ea00640 1 --2- 172.21.15.106:0/666090285 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc6300651d0 0x7fc630067680 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc640006cd0 tx=0x7fc640032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.386+0000 7fc646000640 1 -- 172.21.15.106:0/666090285 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc6500c66c0 con 0x7fc648035d40 2024-08-17T02:27:59.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.435+0000 7fcf51200640 1 Processor -- start 2024-08-17T02:27:59.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.435+0000 7fcf51200640 1 -- start start 2024-08-17T02:27:59.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.437+0000 7fcf51200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcf4c15ab80 0x7fcf4c0ad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.437+0000 7f770e800640 1 Processor -- start 2024-08-17T02:27:59.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.437+0000 7f770e800640 1 -- start start 2024-08-17T02:27:59.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.437+0000 7fcf51200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fcf4c161480 0x7fcf4c15e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.437+0000 7fcf51200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf4c0b0500 con 0x7fcf4c15af50 2024-08-17T02:27:59.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.437+0000 7fcf51200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf4c161b50 con 0x7fcf4c15ab80 2024-08-17T02:27:59.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.437+0000 7fcf51200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf4c0af8f0 con 0x7fcf4c161480 2024-08-17T02:27:59.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.438+0000 7fcf4b400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcf4c15ab80 0x7fcf4c0ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.438+0000 7fcf4b400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcf4c15ab80 0x7fcf4c0ad9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56736/0 (socket says 172.21.15.106:56736) 2024-08-17T02:27:59.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.439+0000 7fa79b200640 1 Processor -- start 2024-08-17T02:27:59.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.439+0000 7fa79b200640 1 -- start start 2024-08-17T02:27:59.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.439+0000 7f770e800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7708159430 0x7f77080cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.439+0000 7f770e800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77080cbf40 con 0x7f7708159060 2024-08-17T02:27:59.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.439+0000 7f770e800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77080cb930 con 0x7f77080c6a30 2024-08-17T02:27:59.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.439+0000 7f770e800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77080ced10 con 0x7f7708159430 2024-08-17T02:27:59.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.440+0000 7f7707400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7708159060 0x7f77080cabc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39942/0 (socket says 172.21.15.106:39942) 2024-08-17T02:27:59.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.440+0000 7f7707400640 1 -- 172.21.15.106:0/832845911 learned_addr learned my addr 172.21.15.106:0/832845911 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:59.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.438+0000 7fcf4b400640 1 -- 172.21.15.106:0/1703671280 learned_addr learned my addr 172.21.15.106:0/1703671280 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:59.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.438+0000 7fcf4be00640 1 --2- 172.21.15.106:0/1703671280 >> v2:172.21.15.171:3300/0 conn(0x7fcf4c161480 0x7fcf4c15e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.439+0000 7fcf4b400640 1 -- 172.21.15.106:0/1703671280 >> v2:172.21.15.171:3300/0 conn(0x7fcf4c161480 msgr2=0x7fcf4c15e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.439+0000 7fcf4a000640 1 -- 172.21.15.106:0/1703671280 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3900067272 0 0) 0x7fcf4c0b0500 con 0x7fcf4c15af50 2024-08-17T02:27:59.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.440+0000 7fcf4b400640 1 --2- 172.21.15.106:0/1703671280 >> v2:172.21.15.171:3300/0 conn(0x7fcf4c161480 0x7fcf4c15e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.440+0000 7fcf4b400640 1 -- 172.21.15.106:0/1703671280 >> v1:172.21.15.171:6789/0 conn(0x7fcf4c15af50 legacy=0x7fcf4c160d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.440+0000 7fcf4b400640 1 -- 172.21.15.106:0/1703671280 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4c0afbd0 con 0x7fcf4c15ab80 2024-08-17T02:27:59.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.440+0000 7fcf4be00640 1 --2- 172.21.15.106:0/1703671280 >> v2:172.21.15.171:3300/0 conn(0x7fcf4c161480 0x7fcf4c15e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:59.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.440+0000 7f7707e00640 1 --2- 172.21.15.106:0/832845911 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7708159430 0x7f77080cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.441+0000 7f7706000640 1 -- 172.21.15.106:0/832845911 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737182505 0 0) 0x7f77080cbf40 con 0x7f7708159060 2024-08-17T02:27:59.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.441+0000 7f7706000640 1 -- 172.21.15.106:0/832845911 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76ec0034e0 con 0x7f7708159060 2024-08-17T02:27:59.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.442+0000 7fa79b200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa79000c040 0x7fa790034160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.442+0000 7fa79b200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa7900502f0 0x7fa790006060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.442+0000 7fa79b200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa790053520 con 0x7fa790053020 2024-08-17T02:27:59.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.442+0000 7fa79b200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa790053800 con 0x7fa7900502f0 2024-08-17T02:27:59.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.442+0000 7fcf4b400640 1 --2- 172.21.15.106:0/1703671280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf4c15ab80 0x7fcf4c0ad9d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c0ac1c0 tx=0x7fcf3c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3287581fdd6428a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.442+0000 7fa79b200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa790053ae0 con 0x7fa79000c040 2024-08-17T02:27:59.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.441+0000 7f7706000640 1 -- 172.21.15.106:0/832845911 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2661625262 0 0) 0x7f76ec0034e0 con 0x7f7708159060 2024-08-17T02:27:59.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.441+0000 7f7706000640 1 -- 172.21.15.106:0/832845911 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7708159430 msgr2=0x7f77080cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.441+0000 7f7706000640 1 --2- 172.21.15.106:0/832845911 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7708159430 0x7f77080cb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.442+0000 7fa799400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa790053020 0x7fa79004fbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39946/0 (socket says 172.21.15.106:39946) 2024-08-17T02:27:59.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.443+0000 7fa799400640 1 -- 172.21.15.106:0/358538589 learned_addr learned my addr 172.21.15.106:0/358538589 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:59.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.443+0000 7fcf4a000640 1 -- 172.21.15.106:0/1703671280 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c02ad50 con 0x7fcf4c15ab80 2024-08-17T02:27:59.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.443+0000 7fa799e00640 1 --2- 172.21.15.106:0/358538589 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa79000c040 0x7fa790034160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.443+0000 7fa79a800640 1 --2- 172.21.15.106:0/358538589 >> v2:172.21.15.106:3300/0 conn(0x7fa7900502f0 0x7fa790006060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.441+0000 7f7706000640 1 -- 172.21.15.106:0/832845911 >> v1:172.21.15.171:6789/0 conn(0x7f77080c6a30 legacy=0x7f77080c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.443+0000 7fa799e00640 1 -- 172.21.15.106:0/358538589 >> v2:172.21.15.106:3300/0 conn(0x7fa7900502f0 msgr2=0x7fa790006060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.443+0000 7fcf4a000640 1 -- 172.21.15.106:0/1703671280 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3c032440 con 0x7fcf4c15ab80 2024-08-17T02:27:59.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.443+0000 7fa799e00640 1 --2- 172.21.15.106:0/358538589 >> v2:172.21.15.106:3300/0 conn(0x7fa7900502f0 0x7fa790006060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.443+0000 7fa799e00640 1 -- 172.21.15.106:0/358538589 >> v1:172.21.15.106:6789/0 conn(0x7fa790053020 legacy=0x7fa79004fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.443+0000 7fcf4a000640 1 -- 172.21.15.106:0/1703671280 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c02ad50 con 0x7fcf4c15ab80 2024-08-17T02:27:59.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.443+0000 7fa799e00640 1 -- 172.21.15.106:0/358538589 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa790053dc0 con 0x7fa79000c040 2024-08-17T02:27:59.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.443+0000 7f7706000640 1 -- 172.21.15.106:0/832845911 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77080cbbd0 con 0x7f7708159060 2024-08-17T02:27:59.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.444+0000 7f7706000640 1 -- 172.21.15.106:0/832845911 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7f76f8001470 con 0x7f7708159060 2024-08-17T02:27:59.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.444+0000 7f7706000640 1 -- 172.21.15.106:0/832845911 >> v1:172.21.15.106:6789/0 conn(0x7f7708159060 legacy=0x7f77080cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.444+0000 7f7706000640 1 --2- 172.21.15.106:0/832845911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76ec003a80 0x7f76ec003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.444+0000 7fcf51200640 1 -- 172.21.15.106:0/1703671280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf4c15ab80 msgr2=0x7fcf4c0ad9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.444+0000 7fcf51200640 1 --2- 172.21.15.106:0/1703671280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf4c15ab80 0x7fcf4c0ad9d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c0ac1c0 tx=0x7fcf3c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.444+0000 7f7706000640 1 --2- 172.21.15.106:0/832845911 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76ec004780 0x7f76ec004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.444+0000 7f7706000640 1 --2- 172.21.15.106:0/832845911 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7708159430 0x7f76ec005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.445+0000 7fe21f200640 1 Processor -- start 2024-08-17T02:27:59.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.445+0000 7fa79a800640 1 --2- 172.21.15.106:0/358538589 >> v2:172.21.15.106:3300/0 conn(0x7fa7900502f0 0x7fa790006060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:59.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.444+0000 7f7706000640 1 -- 172.21.15.106:0/832845911 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77080ced10 con 0x7f76ec003a80 2024-08-17T02:27:59.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.444+0000 7f7706000640 1 -- 172.21.15.106:0/832845911 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec00bb00 con 0x7f76ec004780 2024-08-17T02:27:59.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.445+0000 7fa799e00640 1 --2- 172.21.15.106:0/358538589 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa79000c040 0x7fa790034160 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa788009850 tx=0x7fa7880090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af35ab151c11f3fb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.445+0000 7fcf51200640 1 -- 172.21.15.106:0/1703671280 shutdown_connections 2024-08-17T02:27:59.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.445+0000 7fcf51200640 1 --2- 172.21.15.106:0/1703671280 >> v2:172.21.15.171:3300/0 conn(0x7fcf4c161480 0x7fcf4c15e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.445+0000 7fcf51200640 1 --2- 172.21.15.106:0/1703671280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf4c15ab80 0x7fcf4c0ad9d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.445+0000 7fcf51200640 1 -- 172.21.15.106:0/1703671280 >> 172.21.15.106:0/1703671280 conn(0x7fcf4c0cb790 msgr2=0x7fcf4c0cbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.444+0000 7f7706000640 1 -- 172.21.15.106:0/832845911 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec00bcc0 con 0x7f7708159430 2024-08-17T02:27:59.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.444+0000 7f7707e00640 1 --2- 172.21.15.106:0/832845911 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7708159430 0x7f76ec005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.445+0000 7fa798a00640 1 -- 172.21.15.106:0/358538589 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78802adb0 con 0x7fa79000c040 2024-08-17T02:27:59.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.445+0000 7fa798a00640 1 -- 172.21.15.106:0/358538589 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa788032440 con 0x7fa79000c040 2024-08-17T02:27:59.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.445+0000 7fa798a00640 1 -- 172.21.15.106:0/358538589 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa788032820 con 0x7fa79000c040 2024-08-17T02:27:59.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.445+0000 7f7707400640 1 --2- 172.21.15.106:0/832845911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76ec003a80 0x7f76ec003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.445+0000 7f7707e00640 1 -- 172.21.15.106:0/832845911 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76ec004780 msgr2=0x7f76ec004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.445+0000 7f7706a00640 1 --2- 172.21.15.106:0/832845911 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76ec004780 0x7f76ec004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.445+0000 7f7707e00640 1 --2- 172.21.15.106:0/832845911 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76ec004780 0x7f76ec004bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.445+0000 7f7707e00640 1 -- 172.21.15.106:0/832845911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76ec003a80 msgr2=0x7f76ec003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.445+0000 7f7707e00640 1 --2- 172.21.15.106:0/832845911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76ec003a80 0x7f76ec003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.445+0000 7f7707e00640 1 -- 172.21.15.106:0/832845911 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77080cbbd0 con 0x7f7708159430 2024-08-17T02:27:59.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.447+0000 7fa79b200640 1 -- 172.21.15.106:0/358538589 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa79000c040 msgr2=0x7fa790034160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.447+0000 7fa79b200640 1 --2- 172.21.15.106:0/358538589 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa79000c040 0x7fa790034160 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa788009850 tx=0x7fa7880090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.446+0000 7f7707400640 1 --2- 172.21.15.106:0/832845911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76ec003a80 0x7f76ec003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:27:59.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.445+0000 7fcf51200640 1 -- 172.21.15.106:0/1703671280 shutdown_connections 2024-08-17T02:27:59.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.445+0000 7fcf51200640 1 -- 172.21.15.106:0/1703671280 wait complete. 2024-08-17T02:27:59.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.447+0000 7fa79b200640 1 -- 172.21.15.106:0/358538589 shutdown_connections 2024-08-17T02:27:59.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.447+0000 7fa79b200640 1 --2- 172.21.15.106:0/358538589 >> v2:172.21.15.106:3300/0 conn(0x7fa7900502f0 0x7fa790006060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.447+0000 7fa79b200640 1 --2- 172.21.15.106:0/358538589 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa79000c040 0x7fa790034160 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.447+0000 7fa79b200640 1 -- 172.21.15.106:0/358538589 >> 172.21.15.106:0/358538589 conn(0x7fa790009fa0 msgr2=0x7fa79000a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.445+0000 7fe21f200640 1 -- start start 2024-08-17T02:27:59.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.447+0000 7fe21f200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2180504b0 0x7fe218005e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.447+0000 7fe21f200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe218053840 con 0x7fe21804f1d0 2024-08-17T02:27:59.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.447+0000 7fe21f200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe218053380 con 0x7fe2180d86d0 2024-08-17T02:27:59.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.447+0000 7fe21f200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2180df740 con 0x7fe2180504b0 2024-08-17T02:27:59.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.447+0000 7f7707e00640 1 --2- 172.21.15.106:0/832845911 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7708159430 0x7f76ec005150 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7708159850 tx=0x7f76f40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fc91c15b981d307 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.447+0000 7fcf51200640 1 Processor -- start 2024-08-17T02:27:59.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.448+0000 7fcf51200640 1 -- start start 2024-08-17T02:27:59.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.448+0000 7fa79b200640 1 -- 172.21.15.106:0/358538589 shutdown_connections 2024-08-17T02:27:59.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.447+0000 7fe21de00640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fe2180d86d0 0x7fe21804fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:53920/0 (socket says 172.21.15.106:53920) 2024-08-17T02:27:59.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.447+0000 7fe21de00640 1 -- 172.21.15.106:0/2529997207 learned_addr learned my addr 172.21.15.106:0/2529997207 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:59.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.448+0000 7fe21d400640 1 --2- 172.21.15.106:0/2529997207 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2180504b0 0x7fe218005e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.448+0000 7fe21d400640 1 -- 172.21.15.106:0/2529997207 >> v1:172.21.15.171:6789/0 conn(0x7fe2180d86d0 legacy=0x7fe21804fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.448+0000 7fe21d400640 1 -- 172.21.15.106:0/2529997207 >> v1:172.21.15.106:6789/0 conn(0x7fe21804f1d0 legacy=0x7fe218053cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.448+0000 7fe21d400640 1 -- 172.21.15.106:0/2529997207 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2180deea0 con 0x7fe2180504b0 2024-08-17T02:27:59.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.449+0000 7f7706000640 1 -- 172.21.15.106:0/832845911 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f40336d0 con 0x7f7708159430 2024-08-17T02:27:59.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.449+0000 7f7706000640 1 -- 172.21.15.106:0/832845911 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f4033830 con 0x7f7708159430 2024-08-17T02:27:59.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.449+0000 7f7706000640 1 -- 172.21.15.106:0/832845911 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4033bd0 con 0x7f7708159430 2024-08-17T02:27:59.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.449+0000 7fcf51200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf4c15ab80 0x7fcf4c15be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.449+0000 7fcf51200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf4c15af50 0x7fcf4c0c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.449+0000 7fcf51200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf4c161480 0x7fcf4c0c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.450+0000 7fcf4b400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf4c15ab80 0x7fcf4c15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.450+0000 7fcf4aa00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf4c15af50 0x7fcf4c0c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.450+0000 7fcf4aa00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf4c15af50 0x7fcf4c0c8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:58396/0 (socket says 172.21.15.106:58396) 2024-08-17T02:27:59.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.450+0000 7f770e800640 1 -- 172.21.15.106:0/832845911 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7708159430 msgr2=0x7f76ec005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.450+0000 7f770e800640 1 --2- 172.21.15.106:0/832845911 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7708159430 0x7f76ec005150 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7708159850 tx=0x7f76f40090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.450+0000 7f7707e00640 1 -- 172.21.15.106:0/832845911 reap_dead start 2024-08-17T02:27:59.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.450+0000 7fcf4b400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf4c15ab80 0x7fcf4c15be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:52574/0 (socket says 172.21.15.106:52574) 2024-08-17T02:27:59.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.450+0000 7fcf4be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf4c161480 0x7fcf4c0c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.450+0000 7f770e800640 1 -- 172.21.15.106:0/832845911 shutdown_connections 2024-08-17T02:27:59.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.450+0000 7f770e800640 1 -- 172.21.15.106:0/832845911 >> 172.21.15.106:0/832845911 conn(0x7f77080cfde0 msgr2=0x7f77080d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.450+0000 7fcf4be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf4c161480 0x7fcf4c0c9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56758/0 (socket says 172.21.15.106:56758) 2024-08-17T02:27:59.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.450+0000 7fcf51200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c15c380 con 0x7fcf4c161480 2024-08-17T02:27:59.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.450+0000 7fcf51200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c15c620 con 0x7fcf4c15af50 2024-08-17T02:27:59.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.450+0000 7fcf51200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c15c900 con 0x7fcf4c15ab80 2024-08-17T02:27:59.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.448+0000 7fa79b200640 1 -- 172.21.15.106:0/358538589 wait complete. 2024-08-17T02:27:59.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.450+0000 7fe21d400640 1 --2- 172.21.15.106:0/2529997207 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2180504b0 0x7fe218005e20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe20c010cb0 tx=0x7fe20c00a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f779c90adb28b61 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.450+0000 7fa79b200640 1 Processor -- start 2024-08-17T02:27:59.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.450+0000 7f770e800640 1 -- 172.21.15.106:0/832845911 shutdown_connections 2024-08-17T02:27:59.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.451+0000 7fe21ca00640 1 -- 172.21.15.106:0/2529997207 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20c033740 con 0x7fe2180504b0 2024-08-17T02:27:59.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.451+0000 7fe21ca00640 1 -- 172.21.15.106:0/2529997207 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20c037070 con 0x7fe2180504b0 2024-08-17T02:27:59.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.451+0000 7fe21ca00640 1 -- 172.21.15.106:0/2529997207 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20c033b10 con 0x7fe2180504b0 2024-08-17T02:27:59.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.451+0000 7fcf4aa00640 1 -- 172.21.15.106:0/2420570821 learned_addr learned my addr 172.21.15.106:0/2420570821 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:59.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.452+0000 7fe21f200640 1 -- 172.21.15.106:0/2529997207 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2180504b0 msgr2=0x7fe218005e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.452+0000 7fe21f200640 1 --2- 172.21.15.106:0/2529997207 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2180504b0 0x7fe218005e20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe20c010cb0 tx=0x7fe20c00a0f0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.452+0000 7fe21f200640 1 -- 172.21.15.106:0/2529997207 shutdown_connections 2024-08-17T02:27:59.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.452+0000 7fe21f200640 1 --2- 172.21.15.106:0/2529997207 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2180504b0 0x7fe218005e20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.451+0000 7f770e800640 1 -- 172.21.15.106:0/832845911 wait complete. 2024-08-17T02:27:59.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.453+0000 7f770e800640 1 Processor -- start 2024-08-17T02:27:59.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.453+0000 7f770e800640 1 -- start start 2024-08-17T02:27:59.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.452+0000 7fcf4be00640 1 -- 172.21.15.106:0/2420570821 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf4c15ab80 msgr2=0x7fcf4c15be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.452+0000 7fcf4be00640 1 --2- 172.21.15.106:0/2420570821 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf4c15ab80 0x7fcf4c15be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.452+0000 7fcf4be00640 1 -- 172.21.15.106:0/2420570821 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf4c15af50 msgr2=0x7fcf4c0c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.452+0000 7fcf4be00640 1 --2- 172.21.15.106:0/2420570821 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf4c15af50 0x7fcf4c0c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.452+0000 7fcf4be00640 1 -- 172.21.15.106:0/2420570821 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf44009a20 con 0x7fcf4c161480 2024-08-17T02:27:59.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.453+0000 7fcf4b400640 1 --2- 172.21.15.106:0/2420570821 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf4c15ab80 0x7fcf4c15be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-08-17T02:27:59.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.454+0000 7fcf4be00640 1 --2- 172.21.15.106:0/2420570821 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf4c161480 0x7fcf4c0c9170 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c161880 tx=0x7fcf4400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.451+0000 7fa79b200640 1 -- start start 2024-08-17T02:27:59.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.452+0000 7fa79b200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa79000c040 0x7fa7900c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.452+0000 7fa79b200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7900502f0 0x7fa7900c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.452+0000 7fa79b200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa790053020 0x7fa7900d4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.452+0000 7fa79b200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7900c7f30 con 0x7fa7900502f0 2024-08-17T02:27:59.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.452+0000 7fa79b200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7900cbbd0 con 0x7fa79000c040 2024-08-17T02:27:59.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.452+0000 7fa79b200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7900cafc0 con 0x7fa790053020 2024-08-17T02:27:59.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.453+0000 7fa79a800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa790053020 0x7fa7900d4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.453+0000 7fa79a800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa790053020 0x7fa7900d4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:52588/0 (socket says 172.21.15.106:52588) 2024-08-17T02:27:59.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.454+0000 7fa79a800640 1 -- 172.21.15.106:0/3183049849 learned_addr learned my addr 172.21.15.106:0/3183049849 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:59.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.454+0000 7fa799e00640 1 --2- 172.21.15.106:0/3183049849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa79000c040 0x7fa7900c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.452+0000 7fe21f200640 1 -- 172.21.15.106:0/2529997207 >> 172.21.15.106:0/2529997207 conn(0x7fe218051600 msgr2=0x7fe218051a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.452+0000 7fe21f200640 1 -- 172.21.15.106:0/2529997207 shutdown_connections 2024-08-17T02:27:59.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.453+0000 7fe21f200640 1 -- 172.21.15.106:0/2529997207 wait complete. 2024-08-17T02:27:59.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.454+0000 7f770e800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7708159430 0x7f770815b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.455+0000 7f770e800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f770814cfc0 0x7f770814ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.455+0000 7f770e800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f770814ef90 0x7f770814b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.455+0000 7f770e800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77080c7cc0 con 0x7f7708159430 2024-08-17T02:27:59.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.455+0000 7f770e800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77080c7fa0 con 0x7f770814cfc0 2024-08-17T02:27:59.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.455+0000 7f770e800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770815bf00 con 0x7f770814ef90 2024-08-17T02:27:59.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.455+0000 7fa799e00640 1 -- 172.21.15.106:0/3183049849 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa790053020 msgr2=0x7fa7900d4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.455+0000 7fa799e00640 1 --2- 172.21.15.106:0/3183049849 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa790053020 0x7fa7900d4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.455+0000 7fa799e00640 1 -- 172.21.15.106:0/3183049849 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7900502f0 msgr2=0x7fa7900c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.455+0000 7fa799e00640 1 --2- 172.21.15.106:0/3183049849 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7900502f0 0x7fa7900c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.455+0000 7fa799e00640 1 -- 172.21.15.106:0/3183049849 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa788009390 con 0x7fa79000c040 2024-08-17T02:27:59.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.455+0000 7f7707e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f770814ef90 0x7f770814b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.455+0000 7f7707e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f770814ef90 0x7f770814b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:52594/0 (socket says 172.21.15.106:52594) 2024-08-17T02:27:59.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.455+0000 7f7707e00640 1 -- 172.21.15.106:0/2880841706 learned_addr learned my addr 172.21.15.106:0/2880841706 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:59.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.455+0000 7f7706a00640 1 --2- 172.21.15.106:0/2880841706 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f770814cfc0 0x7f770814ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.455+0000 7fa799e00640 1 --2- 172.21.15.106:0/3183049849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa79000c040 0x7fa7900c79f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa790053c20 tx=0x7fa788032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.456+0000 7f7707400640 1 --2- 172.21.15.106:0/2880841706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7708159430 0x7f770815b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.456+0000 7f3729200640 1 Processor -- start 2024-08-17T02:27:59.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.456+0000 7f7707e00640 1 -- 172.21.15.106:0/2880841706 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f770814cfc0 msgr2=0x7f770814ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.456+0000 7f7707e00640 1 --2- 172.21.15.106:0/2880841706 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f770814cfc0 0x7f770814ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.456+0000 7f7707e00640 1 -- 172.21.15.106:0/2880841706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7708159430 msgr2=0x7f770815b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.456+0000 7f7707e00640 1 --2- 172.21.15.106:0/2880841706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7708159430 0x7f770815b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.456+0000 7f7707e00640 1 -- 172.21.15.106:0/2880841706 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770815c1e0 con 0x7f770814ef90 2024-08-17T02:27:59.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.456+0000 7fe21f200640 1 Processor -- start 2024-08-17T02:27:59.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.456+0000 7fa78d600640 1 -- 172.21.15.106:0/3183049849 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa788031b30 con 0x7fa79000c040 2024-08-17T02:27:59.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.456+0000 7fa78d600640 1 -- 172.21.15.106:0/3183049849 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa788031c90 con 0x7fa79000c040 2024-08-17T02:27:59.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.456+0000 7f3729200640 1 -- start start 2024-08-17T02:27:59.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.456+0000 7fa78d600640 1 -- 172.21.15.106:0/3183049849 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78803c660 con 0x7fa79000c040 2024-08-17T02:27:59.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.456+0000 7fa79b200640 1 -- 172.21.15.106:0/3183049849 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7900cb2a0 con 0x7fa79000c040 2024-08-17T02:27:59.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.457+0000 7fe21f200640 1 -- start start 2024-08-17T02:27:59.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.456+0000 7fcf42a00640 1 -- 172.21.15.106:0/2420570821 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4400ce10 con 0x7fcf4c161480 2024-08-17T02:27:59.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.457+0000 7f7707e00640 1 --2- 172.21.15.106:0/2880841706 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f770814ef90 0x7f770814b800 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f76f40333a0 tx=0x7f76f403b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.458+0000 7f76fea00640 1 -- 172.21.15.106:0/2880841706 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f403bc50 con 0x7f770814ef90 2024-08-17T02:27:59.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.458+0000 7f76fea00640 1 -- 172.21.15.106:0/2880841706 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f403bdb0 con 0x7f770814ef90 2024-08-17T02:27:59.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.458+0000 7f76fea00640 1 -- 172.21.15.106:0/2880841706 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4046650 con 0x7f770814ef90 2024-08-17T02:27:59.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.457+0000 7fa79b200640 1 -- 172.21.15.106:0/3183049849 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7900cb860 con 0x7fa79000c040 2024-08-17T02:27:59.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.458+0000 7fa79b200640 1 -- 172.21.15.106:0/3183049849 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa790005320 con 0x7fa79000c040 2024-08-17T02:27:59.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.457+0000 7fcf51200640 1 -- 172.21.15.106:0/2420570821 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf3c009450 con 0x7fcf4c161480 2024-08-17T02:27:59.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.457+0000 7fcf51200640 1 -- 172.21.15.106:0/2420570821 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4c15cec0 con 0x7fcf4c161480 2024-08-17T02:27:59.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.458+0000 7f3729200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f372415a260 0x7f37240b2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.458+0000 7f3729200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3724096a70 0x7f37240ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.459+0000 7fe21f200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe21804f1d0 0x7fe2180d8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.459+0000 7fcf37e00640 1 -- 172.21.15.106:0/2420570821 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf4c071050 con 0x7fcf4c161480 2024-08-17T02:27:59.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.459+0000 7fcf42a00640 1 -- 172.21.15.106:0/2420570821 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4400f040 con 0x7fcf4c161480 2024-08-17T02:27:59.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.459+0000 7f3729200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37240adb60 con 0x7f37240aba20 2024-08-17T02:27:59.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.459+0000 7f3729200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37240abea0 con 0x7f372415a260 2024-08-17T02:27:59.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.459+0000 7f3729200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37240975a0 con 0x7f3724096a70 2024-08-17T02:27:59.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.459+0000 7f3722800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f37240aba20 0x7f37240b0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39972/0 (socket says 172.21.15.106:39972) 2024-08-17T02:27:59.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.459+0000 7f3722800640 1 -- 172.21.15.106:0/1573835801 learned_addr learned my addr 172.21.15.106:0/1573835801 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:59.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.459+0000 7fe21f200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2180504b0 0x7fe218006bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.459+0000 7fe21f200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2180d86d0 0x7fe2180070f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.459+0000 7f770e800640 1 -- 172.21.15.106:0/2880841706 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f770815c4c0 con 0x7f770814ef90 2024-08-17T02:27:59.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.460+0000 7fe21f200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2180d9360 con 0x7fe2180d86d0 2024-08-17T02:27:59.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.460+0000 7fe21f200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2180c1210 con 0x7fe21804f1d0 2024-08-17T02:27:59.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.460+0000 7fe21f200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2180da780 con 0x7fe2180504b0 2024-08-17T02:27:59.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.459+0000 7f770e800640 1 -- 172.21.15.106:0/2880841706 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f770815bc90 con 0x7f770814ef90 2024-08-17T02:27:59.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.459+0000 7f3721400640 1 --2- 172.21.15.106:0/1573835801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3724096a70 0x7f37240ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.460+0000 7f3720a00640 1 -- 172.21.15.106:0/1573835801 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1892627138 0 0) 0x7f37240adb60 con 0x7f37240aba20 2024-08-17T02:27:59.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.460+0000 7fe21e800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2180d86d0 0x7fe2180070f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.460+0000 7f3720a00640 1 -- 172.21.15.106:0/1573835801 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37080034e0 con 0x7f37240aba20 2024-08-17T02:27:59.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.460+0000 7fe21e800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2180d86d0 0x7fe2180070f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:56790/0 (socket says 172.21.15.106:56790) 2024-08-17T02:27:59.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.460+0000 7fe21e800640 1 -- 172.21.15.106:0/363557531 learned_addr learned my addr 172.21.15.106:0/363557531 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:59.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.460+0000 7fe21de00640 1 --2- 172.21.15.106:0/363557531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe21804f1d0 0x7fe2180d8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.460+0000 7f3720a00640 1 -- 172.21.15.106:0/1573835801 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2185802601 0 0) 0x7f37080034e0 con 0x7f37240aba20 2024-08-17T02:27:59.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.460+0000 7fe21d400640 1 --2- 172.21.15.106:0/363557531 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2180504b0 0x7fe218006bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.460+0000 7f3720a00640 1 -- 172.21.15.106:0/1573835801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3724096a70 msgr2=0x7f37240ab4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.460+0000 7f3720a00640 1 --2- 172.21.15.106:0/1573835801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3724096a70 0x7f37240ab4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.460+0000 7f3720a00640 1 -- 172.21.15.106:0/1573835801 >> v2:172.21.15.171:3300/0 conn(0x7f372415a260 msgr2=0x7f37240b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.460+0000 7f3720a00640 1 --2- 172.21.15.106:0/1573835801 >> v2:172.21.15.171:3300/0 conn(0x7f372415a260 0x7f37240b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.460+0000 7f3720a00640 1 -- 172.21.15.106:0/1573835801 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372415a630 con 0x7f37240aba20 2024-08-17T02:27:59.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.461+0000 7fa78d600640 1 -- 172.21.15.106:0/3183049849 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa788039050 con 0x7fa79000c040 2024-08-17T02:27:59.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.461+0000 7f3720a00640 1 -- 172.21.15.106:0/1573835801 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7f370c001470 con 0x7f37240aba20 2024-08-17T02:27:59.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.461+0000 7f3720a00640 1 -- 172.21.15.106:0/1573835801 >> v1:172.21.15.106:6789/0 conn(0x7f37240aba20 legacy=0x7f37240b0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.461+0000 7f3720a00640 1 --2- 172.21.15.106:0/1573835801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3724096a70 0x7f3708003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.461+0000 7f3720a00640 1 --2- 172.21.15.106:0/1573835801 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3708004020 0x7f3708004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.461+0000 7f3720a00640 1 --2- 172.21.15.106:0/1573835801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3708004d10 0x7f3708005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.461+0000 7f3720a00640 1 -- 172.21.15.106:0/1573835801 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37240abea0 con 0x7f3708004020 2024-08-17T02:27:59.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.461+0000 7f3720a00640 1 -- 172.21.15.106:0/1573835801 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37240975a0 con 0x7f3708004d10 2024-08-17T02:27:59.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.461+0000 7f3720a00640 1 -- 172.21.15.106:0/1573835801 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3708014470 con 0x7f3724096a70 2024-08-17T02:27:59.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.461+0000 7f3721400640 1 --2- 172.21.15.106:0/1573835801 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3708004020 0x7f3708004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.461+0000 7f3722800640 1 --2- 172.21.15.106:0/1573835801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3708004d10 0x7f3708005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.462+0000 7f3721e00640 1 --2- 172.21.15.106:0/1573835801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3724096a70 0x7f3708003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.462+0000 7f3722800640 1 -- 172.21.15.106:0/1573835801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3724096a70 msgr2=0x7f3708003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.462+0000 7f3722800640 1 --2- 172.21.15.106:0/1573835801 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3724096a70 0x7f3708003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.462+0000 7f3722800640 1 -- 172.21.15.106:0/1573835801 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3708004020 msgr2=0x7f3708004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.462+0000 7f3722800640 1 --2- 172.21.15.106:0/1573835801 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3708004020 0x7f3708004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.462+0000 7f3722800640 1 -- 172.21.15.106:0/1573835801 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37080034e0 con 0x7f3708004d10 2024-08-17T02:27:59.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.462+0000 7f770e800640 1 -- 172.21.15.106:0/2880841706 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77080c8150 con 0x7f770814ef90 2024-08-17T02:27:59.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.463+0000 7fa78d600640 1 --2- 172.21.15.106:0/3183049849 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa7780652a0 0x7fa778067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.463+0000 7fa78d600640 1 -- 172.21.15.106:0/3183049849 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa7880a3180 con 0x7fa79000c040 2024-08-17T02:27:59.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.463+0000 7fe21e800640 1 -- 172.21.15.106:0/363557531 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2180504b0 msgr2=0x7fe218006bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.463+0000 7fe21e800640 1 --2- 172.21.15.106:0/363557531 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2180504b0 0x7fe218006bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.463+0000 7fe21e800640 1 -- 172.21.15.106:0/363557531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe21804f1d0 msgr2=0x7fe2180d8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.463+0000 7fe21e800640 1 --2- 172.21.15.106:0/363557531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe21804f1d0 0x7fe2180d8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.463+0000 7fe21e800640 1 -- 172.21.15.106:0/363557531 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20c0107c0 con 0x7fe2180d86d0 2024-08-17T02:27:59.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.464+0000 7f3722800640 1 --2- 172.21.15.106:0/1573835801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3708004d10 0x7f3708005180 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f370c00c210 tx=0x7f370c001dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c56bc3c1367cae6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.464+0000 7fa799400640 1 --2- 172.21.15.106:0/3183049849 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa7780652a0 0x7fa778067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.464+0000 7fe21e800640 1 --2- 172.21.15.106:0/363557531 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2180d86d0 0x7fe2180070f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe22004c0c0 tx=0x7fe22006f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.464+0000 7f76fea00640 1 -- 172.21.15.106:0/2880841706 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f76f4046a00 con 0x7f770814ef90 2024-08-17T02:27:59.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.464+0000 7fcf42a00640 1 -- 172.21.15.106:0/2420570821 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4400ce10 con 0x7fcf4c161480 2024-08-17T02:27:59.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.465+0000 7faade600640 1 Processor -- start 2024-08-17T02:27:59.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.465+0000 7fa799400640 1 --2- 172.21.15.106:0/3183049849 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa7780652a0 0x7fa778067750 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa784007fd0 tx=0x7fa784007b00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.465+0000 7faade600640 1 -- start start 2024-08-17T02:27:59.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.465+0000 7f76fea00640 1 --2- 172.21.15.106:0/2880841706 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f76e80652a0 0x7f76e8067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.466+0000 7f76fea00640 1 -- 172.21.15.106:0/2880841706 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f76f40ab520 con 0x7f770814ef90 2024-08-17T02:27:59.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.466+0000 7f7707400640 1 --2- 172.21.15.106:0/2880841706 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f76e80652a0 0x7f76e8067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.466+0000 7fcf42a00640 1 -- 172.21.15.106:0/2420570821 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcf44003020 con 0x7fcf4c161480 2024-08-17T02:27:59.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.466+0000 7f7707400640 1 --2- 172.21.15.106:0/2880841706 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f76e80652a0 0x7f76e8067750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f76f8001ed0 tx=0x7f76f8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.467+0000 7faade600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faad8159060 0x7faad80c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.467+0000 7faade600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7faad8159430 0x7faad80cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.467+0000 7faade600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad80cbf40 con 0x7faad80c6a30 2024-08-17T02:27:59.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.467+0000 7faade600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad80cb930 con 0x7faad8159430 2024-08-17T02:27:59.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.467+0000 7faade600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad80ced10 con 0x7faad8159060 2024-08-17T02:27:59.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.467+0000 7fcf42a00640 1 --2- 172.21.15.106:0/2420570821 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcf2c0651b0 0x7fcf2c067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.467+0000 7faad7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7faad8159430 0x7faad80cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.468+0000 7faad7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7faad8159430 0x7faad80cb2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:58436/0 (socket says 172.21.15.106:58436) 2024-08-17T02:27:59.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.468+0000 7faad7e00640 1 -- 172.21.15.106:0/1441416943 learned_addr learned my addr 172.21.15.106:0/1441416943 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:59.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.468+0000 7fa78d600640 1 -- 172.21.15.106:0/3183049849 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa788071220 con 0x7fa79000c040 2024-08-17T02:27:59.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.468+0000 7fcf42a00640 1 -- 172.21.15.106:0/2420570821 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcf44083640 con 0x7fcf4c161480 2024-08-17T02:27:59.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.468+0000 7f3720a00640 1 -- 172.21.15.106:0/1573835801 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c005890 con 0x7f3708004d10 2024-08-17T02:27:59.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.468+0000 7f3720a00640 1 -- 172.21.15.106:0/1573835801 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370c005a30 con 0x7f3708004d10 2024-08-17T02:27:59.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.468+0000 7f3720a00640 1 -- 172.21.15.106:0/1573835801 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c005e70 con 0x7f3708004d10 2024-08-17T02:27:59.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.468+0000 7fcf4b400640 1 --2- 172.21.15.106:0/2420570821 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcf2c0651b0 0x7fcf2c067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.469+0000 7faad7400640 1 --2- 172.21.15.106:0/1441416943 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faad8159060 0x7faad80c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.469+0000 7faad6000640 1 -- 172.21.15.106:0/1441416943 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1932146874 0 0) 0x7faad80cbf40 con 0x7faad80c6a30 2024-08-17T02:27:59.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.469+0000 7faad6000640 1 -- 172.21.15.106:0/1441416943 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faabc0034e0 con 0x7faad80c6a30 2024-08-17T02:27:59.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.469+0000 7f3729200640 1 -- 172.21.15.106:0/1573835801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3708004d10 msgr2=0x7f3708005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.469+0000 7fcf4b400640 1 --2- 172.21.15.106:0/2420570821 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcf2c0651b0 0x7fcf2c067660 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c034000 tx=0x7fcf3c032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.470+0000 7f3729200640 1 --2- 172.21.15.106:0/1573835801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3708004d10 0x7f3708005180 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f370c00c210 tx=0x7f370c001dc0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.469+0000 7faad6000640 1 -- 172.21.15.106:0/1441416943 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2621997349 0 0) 0x7faabc0034e0 con 0x7faad80c6a30 2024-08-17T02:27:59.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.469+0000 7faad6000640 1 -- 172.21.15.106:0/1441416943 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faad8159060 msgr2=0x7faad80c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.469+0000 7faad6000640 1 --2- 172.21.15.106:0/1441416943 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faad8159060 0x7faad80c6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.469+0000 7faad6000640 1 -- 172.21.15.106:0/1441416943 >> v2:172.21.15.171:3300/0 conn(0x7faad8159430 msgr2=0x7faad80cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.469+0000 7faad6000640 1 --2- 172.21.15.106:0/1441416943 >> v2:172.21.15.171:3300/0 conn(0x7faad8159430 0x7faad80cb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.469+0000 7faad6000640 1 -- 172.21.15.106:0/1441416943 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad80cbbd0 con 0x7faad80c6a30 2024-08-17T02:27:59.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.469+0000 7faad6000640 1 -- 172.21.15.106:0/1441416943 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7faac4001470 con 0x7faad80c6a30 2024-08-17T02:27:59.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.470+0000 7faad6000640 1 -- 172.21.15.106:0/1441416943 >> v1:172.21.15.171:6789/0 conn(0x7faad80c6a30 legacy=0x7faad80cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.470+0000 7faad6000640 1 --2- 172.21.15.106:0/1441416943 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faabc003a50 0x7faabc003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.470+0000 7faad6000640 1 --2- 172.21.15.106:0/1441416943 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faabc004780 0x7faabc004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.470+0000 7faad6000640 1 --2- 172.21.15.106:0/1441416943 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faabc005130 0x7faabc0141e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.470+0000 7faad6000640 1 -- 172.21.15.106:0/1441416943 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad80cb930 con 0x7faabc004780 2024-08-17T02:27:59.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.470+0000 7f3722800640 1 -- 172.21.15.106:0/1573835801 reap_dead start 2024-08-17T02:27:59.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.470+0000 7faad6000640 1 -- 172.21.15.106:0/1441416943 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad80ced10 con 0x7faabc005130 2024-08-17T02:27:59.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.470+0000 7faad6000640 1 -- 172.21.15.106:0/1441416943 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faabc0147a0 con 0x7faabc003a50 2024-08-17T02:27:59.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.470+0000 7f3729200640 1 -- 172.21.15.106:0/1573835801 shutdown_connections 2024-08-17T02:27:59.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.470+0000 7f3729200640 1 -- 172.21.15.106:0/1573835801 >> 172.21.15.106:0/1573835801 conn(0x7f37240b3040 msgr2=0x7f37240b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.470+0000 7faad7e00640 1 --2- 172.21.15.106:0/1441416943 >> v2:172.21.15.171:3300/0 conn(0x7faad8159430 0x7faad80cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:27:59.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.470+0000 7faad7400640 1 --2- 172.21.15.106:0/1441416943 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faabc003a50 0x7faabc003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.470+0000 7f3729200640 1 -- 172.21.15.106:0/1573835801 shutdown_connections 2024-08-17T02:27:59.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.470+0000 7faad7e00640 1 --2- 172.21.15.106:0/1441416943 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faabc005130 0x7faabc0141e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.470+0000 7faad6a00640 1 --2- 172.21.15.106:0/1441416943 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faabc004780 0x7faabc004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.471+0000 7faad7400640 1 -- 172.21.15.106:0/1441416943 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faabc005130 msgr2=0x7faabc0141e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.471+0000 7faad7400640 1 --2- 172.21.15.106:0/1441416943 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faabc005130 0x7faabc0141e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.471+0000 7faad7400640 1 -- 172.21.15.106:0/1441416943 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faabc004780 msgr2=0x7faabc004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.471+0000 7faad7400640 1 --2- 172.21.15.106:0/1441416943 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faabc004780 0x7faabc004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.471+0000 7faad7400640 1 -- 172.21.15.106:0/1441416943 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad80cbbd0 con 0x7faabc003a50 2024-08-17T02:27:59.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.472+0000 7fcf42a00640 1 -- 172.21.15.106:0/2420570821 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcf44051820 con 0x7fcf4c161480 2024-08-17T02:27:59.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.471+0000 7f3729200640 1 -- 172.21.15.106:0/1573835801 wait complete. 2024-08-17T02:27:59.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.472+0000 7f9c7ae00640 1 Processor -- start 2024-08-17T02:27:59.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.471+0000 7f76fea00640 1 -- 172.21.15.106:0/2880841706 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f77080c8150 con 0x7f770814ef90 2024-08-17T02:27:59.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.472+0000 7fe215600640 1 -- 172.21.15.106:0/363557531 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22006f470 con 0x7fe2180d86d0 2024-08-17T02:27:59.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.472+0000 7f9c7ae00640 1 -- start start 2024-08-17T02:27:59.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.473+0000 7fe215600640 1 -- 172.21.15.106:0/363557531 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22008f3b0 con 0x7fe2180d86d0 2024-08-17T02:27:59.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.473+0000 7fe215600640 1 -- 172.21.15.106:0/363557531 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22008f770 con 0x7fe2180d86d0 2024-08-17T02:27:59.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.473+0000 7fe21f200640 1 -- 172.21.15.106:0/363557531 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2180daa20 con 0x7fe2180d86d0 2024-08-17T02:27:59.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.472+0000 7faad7400640 1 --2- 172.21.15.106:0/1441416943 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faabc003a50 0x7faabc003e60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faac8009a40 tx=0x7faac80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4aa592f14e0f1fd4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.473+0000 7f3729200640 1 Processor -- start 2024-08-17T02:27:59.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.474+0000 7f3729200640 1 -- start start 2024-08-17T02:27:59.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.474+0000 7faad6000640 1 -- 172.21.15.106:0/1441416943 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac802a9f0 con 0x7faabc003a50 2024-08-17T02:27:59.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.473+0000 7fe21f200640 1 -- 172.21.15.106:0/363557531 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2180dafe0 con 0x7fe2180d86d0 2024-08-17T02:27:59.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.475+0000 7f3729200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3724144490 0x7f3724151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.475+0000 7f3729200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3724144860 0x7f3724151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.475+0000 7f3729200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37240b1f20 0x7f37240b2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.475+0000 7f3729200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3724157490 con 0x7f3724144490 2024-08-17T02:27:59.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.475+0000 7f3729200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3724156b60 con 0x7f3724144860 2024-08-17T02:27:59.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.475+0000 7f3729200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3724156e40 con 0x7f37240b1f20 2024-08-17T02:27:59.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.475+0000 7f9c7ae00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c740aa7d0 0x7f9c7406ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.474+0000 7faad6000640 1 -- 172.21.15.106:0/1441416943 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac802ab50 con 0x7faabc003a50 2024-08-17T02:27:59.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.474+0000 7faad6000640 1 -- 172.21.15.106:0/1441416943 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac8032440 con 0x7faabc003a50 2024-08-17T02:27:59.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.474+0000 7faade600640 1 -- 172.21.15.106:0/1441416943 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faabc003a50 msgr2=0x7faabc003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.474+0000 7faade600640 1 --2- 172.21.15.106:0/1441416943 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faabc003a50 0x7faabc003e60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faac8009a40 tx=0x7faac80090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.475+0000 7f3721e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3724144490 0x7f3724151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.475+0000 7f3721400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3724144860 0x7f3724151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.475+0000 7f3721400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3724144860 0x7f3724151870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:58454/0 (socket says 172.21.15.106:58454) 2024-08-17T02:27:59.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.475+0000 7f3721400640 1 -- 172.21.15.106:0/4119321789 learned_addr learned my addr 172.21.15.106:0/4119321789 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:59.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.475+0000 7faad7e00640 1 -- 172.21.15.106:0/1441416943 reap_dead start 2024-08-17T02:27:59.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.476+0000 7faade600640 1 -- 172.21.15.106:0/1441416943 shutdown_connections 2024-08-17T02:27:59.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.476+0000 7f3722800640 1 --2- 172.21.15.106:0/4119321789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37240b1f20 0x7f37240b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.476+0000 7f9c73e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f9c7406da20 0x7f9c74158890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39984/0 (socket says 172.21.15.106:39984) 2024-08-17T02:27:59.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.476+0000 7f9c7ae00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c740a9a10 con 0x7f9c7406da20 2024-08-17T02:27:59.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.476+0000 7f9c7ae00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c740a9cf0 con 0x7f9c74158fa0 2024-08-17T02:27:59.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.476+0000 7f9c7ae00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c740ac400 con 0x7f9c740aa7d0 2024-08-17T02:27:59.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.476+0000 7f9c73e00640 1 -- 172.21.15.106:0/1299906796 learned_addr learned my addr 172.21.15.106:0/1299906796 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:27:59.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.476+0000 7f3721e00640 1 -- 172.21.15.106:0/4119321789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37240b1f20 msgr2=0x7f37240b2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.476+0000 7f9c73400640 1 --2- 172.21.15.106:0/1299906796 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c740aa7d0 0x7f9c7406ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.476+0000 7faade600640 1 -- 172.21.15.106:0/1441416943 >> 172.21.15.106:0/1441416943 conn(0x7faad80cfde0 msgr2=0x7faad80d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.476+0000 7f3721e00640 1 --2- 172.21.15.106:0/4119321789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37240b1f20 0x7f37240b2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.476+0000 7f3721e00640 1 -- 172.21.15.106:0/4119321789 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3724144860 msgr2=0x7f3724151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.476+0000 7f3721e00640 1 --2- 172.21.15.106:0/4119321789 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3724144860 0x7f3724151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.476+0000 7f3721e00640 1 -- 172.21.15.106:0/4119321789 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3724157120 con 0x7f3724144490 2024-08-17T02:27:59.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.477+0000 7f9c72a00640 1 -- 172.21.15.106:0/1299906796 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3509219208 0 0) 0x7f9c740a9a10 con 0x7f9c7406da20 2024-08-17T02:27:59.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.477+0000 7f9c72a00640 1 -- 172.21.15.106:0/1299906796 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c580034e0 con 0x7f9c7406da20 2024-08-17T02:27:59.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.477+0000 7f3721e00640 1 --2- 172.21.15.106:0/4119321789 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3724144490 0x7f3724151330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f371c00b3c0 tx=0x7f371c009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.477+0000 7faade600640 1 -- 172.21.15.106:0/1441416943 shutdown_connections 2024-08-17T02:27:59.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.477+0000 7f9c72a00640 1 -- 172.21.15.106:0/1299906796 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291017938 0 0) 0x7f9c740a9cf0 con 0x7f9c74158fa0 2024-08-17T02:27:59.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.477+0000 7f9c72a00640 1 -- 172.21.15.106:0/1299906796 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c740a9a10 con 0x7f9c74158fa0 2024-08-17T02:27:59.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.477+0000 7faade600640 1 -- 172.21.15.106:0/1441416943 wait complete. 2024-08-17T02:27:59.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.477+0000 7f3719600640 1 -- 172.21.15.106:0/4119321789 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c017420 con 0x7f3724144490 2024-08-17T02:27:59.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.477+0000 7f3729200640 1 -- 172.21.15.106:0/4119321789 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3724157920 con 0x7f3724144490 2024-08-17T02:27:59.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.477+0000 7f3719600640 1 -- 172.21.15.106:0/4119321789 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371c017580 con 0x7f3724144490 2024-08-17T02:27:59.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.477+0000 7f9c72a00640 1 -- 172.21.15.106:0/1299906796 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1435971994 0 0) 0x7f9c580034e0 con 0x7f9c7406da20 2024-08-17T02:27:59.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.477+0000 7f9c72a00640 1 -- 172.21.15.106:0/1299906796 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c740aa7d0 msgr2=0x7f9c7406ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.477+0000 7f9c72a00640 1 --2- 172.21.15.106:0/1299906796 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c740aa7d0 0x7f9c7406ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.477+0000 7f9c72a00640 1 -- 172.21.15.106:0/1299906796 >> v1:172.21.15.171:6789/0 conn(0x7f9c74158fa0 legacy=0x7f9c740ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.477+0000 7f9c72a00640 1 -- 172.21.15.106:0/1299906796 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c740a9fd0 con 0x7f9c7406da20 2024-08-17T02:27:59.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.477+0000 7f9c72a00640 1 -- 172.21.15.106:0/1299906796 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7f9c64001470 con 0x7f9c7406da20 2024-08-17T02:27:59.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.478+0000 7fe21f200640 1 -- 172.21.15.106:0/363557531 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe218005320 con 0x7fe2180d86d0 2024-08-17T02:27:59.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.477+0000 7f9c72a00640 1 -- 172.21.15.106:0/1299906796 >> v1:172.21.15.106:6789/0 conn(0x7f9c7406da20 legacy=0x7f9c74158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.478+0000 7f9c72a00640 1 --2- 172.21.15.106:0/1299906796 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c58004bf0 0x7f9c58004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.478+0000 7f9c72a00640 1 --2- 172.21.15.106:0/1299906796 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c58003720 0x7f9c58003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.478+0000 7f9c72a00640 1 --2- 172.21.15.106:0/1299906796 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c580040d0 0x7f9c5800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.478+0000 7f9c72a00640 1 -- 172.21.15.106:0/1299906796 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c740ac400 con 0x7f9c58003720 2024-08-17T02:27:59.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.478+0000 7f9c72a00640 1 -- 172.21.15.106:0/1299906796 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5800c020 con 0x7f9c580040d0 2024-08-17T02:27:59.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.478+0000 7f9c72a00640 1 -- 172.21.15.106:0/1299906796 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5800c1e0 con 0x7f9c58004bf0 2024-08-17T02:27:59.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.477+0000 7f3719600640 1 -- 172.21.15.106:0/4119321789 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c017940 con 0x7f3724144490 2024-08-17T02:27:59.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.478+0000 7f3729200640 1 -- 172.21.15.106:0/4119321789 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37241553a0 con 0x7f3724144490 2024-08-17T02:27:59.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.479+0000 7f9c73e00640 1 --2- 172.21.15.106:0/1299906796 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c58004bf0 0x7f9c58004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.479+0000 7f9c78e00640 1 --2- 172.21.15.106:0/1299906796 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c580040d0 0x7f9c5800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.479+0000 7f9c73400640 1 --2- 172.21.15.106:0/1299906796 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c58003720 0x7f9c58003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.480+0000 7f9c73400640 1 -- 172.21.15.106:0/1299906796 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c58004bf0 msgr2=0x7f9c58004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.480+0000 7f9c73400640 1 --2- 172.21.15.106:0/1299906796 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c58004bf0 0x7f9c58004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.480+0000 7f9c73400640 1 -- 172.21.15.106:0/1299906796 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c580040d0 msgr2=0x7f9c5800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:27:59.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.480+0000 7f9c73400640 1 --2- 172.21.15.106:0/1299906796 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c580040d0 0x7f9c5800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.480+0000 7f9c73400640 1 -- 172.21.15.106:0/1299906796 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c740a9fd0 con 0x7f9c58003720 2024-08-17T02:27:59.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.481+0000 7f3719600640 1 -- 172.21.15.106:0/4119321789 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f371c015070 con 0x7f3724144490 2024-08-17T02:27:59.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.481+0000 7faade600640 1 Processor -- start 2024-08-17T02:27:59.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.482+0000 7f9c73400640 1 --2- 172.21.15.106:0/1299906796 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c58003720 0x7f9c58003b90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9c7406bc30 tx=0x7f9c600090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fdff734123e177f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.482+0000 7f3729200640 1 -- 172.21.15.106:0/4119321789 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3724064db0 con 0x7f3724144490 2024-08-17T02:27:59.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.482+0000 7f3719600640 1 --2- 172.21.15.106:0/4119321789 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f3700065200 0x7f37000676b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.482+0000 7f3719600640 1 -- 172.21.15.106:0/4119321789 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f371c082970 con 0x7f3724144490 2024-08-17T02:27:59.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.483+0000 7f3721400640 1 --2- 172.21.15.106:0/4119321789 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f3700065200 0x7f37000676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.484+0000 7f3721400640 1 --2- 172.21.15.106:0/4119321789 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f3700065200 0x7f37000676b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f37240aad80 tx=0x7f37140090f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.482+0000 7faade600640 1 -- start start 2024-08-17T02:27:59.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.483+0000 7faade600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faabc003a50 0x7faad80b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.484+0000 7faade600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faad8153b80 0x7faad813e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.484+0000 7faade600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faad8153fd0 0x7faad813e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.484+0000 7faade600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad81537c0 con 0x7faad8153b80 2024-08-17T02:27:59.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.484+0000 7faade600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad815a160 con 0x7faabc003a50 2024-08-17T02:27:59.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.484+0000 7faade600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad80b4bd0 con 0x7faad8153fd0 2024-08-17T02:27:59.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.484+0000 7faad7400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faabc003a50 0x7faad80b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.484+0000 7faad6a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faad8153b80 0x7faad813e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.484+0000 7faad7400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faabc003a50 0x7faad80b4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:58470/0 (socket says 172.21.15.106:58470) 2024-08-17T02:27:59.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.484+0000 7faad7400640 1 -- 172.21.15.106:0/116866779 learned_addr learned my addr 172.21.15.106:0/116866779 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:59.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.484+0000 7faad6a00640 1 -- 172.21.15.106:0/116866779 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faad8153fd0 msgr2=0x7faad813e5d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:27:59.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.484+0000 7faad6a00640 1 --2- 172.21.15.106:0/116866779 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faad8153fd0 0x7faad813e5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.484+0000 7faad6a00640 1 -- 172.21.15.106:0/116866779 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faabc003a50 msgr2=0x7faad80b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.485+0000 7faad6a00640 1 --2- 172.21.15.106:0/116866779 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faabc003a50 0x7faad80b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.485+0000 7faad6a00640 1 -- 172.21.15.106:0/116866779 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad80b4eb0 con 0x7faad8153b80 2024-08-17T02:27:59.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.486+0000 7faad6a00640 1 --2- 172.21.15.106:0/116866779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faad8153b80 0x7faad813e090 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faad80c6e20 tx=0x7faac4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.486+0000 7fe215600640 1 -- 172.21.15.106:0/363557531 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe22008fba0 con 0x7fe2180d86d0 2024-08-17T02:27:59.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.488+0000 7fe215600640 1 --2- 172.21.15.106:0/363557531 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe2000651d0 0x7fe200067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.488+0000 7fe215600640 1 -- 172.21.15.106:0/363557531 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe2200f91d0 con 0x7fe2180d86d0 2024-08-17T02:27:59.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.488+0000 7fe21de00640 1 --2- 172.21.15.106:0/363557531 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe2000651d0 0x7fe200067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.489+0000 7fe21de00640 1 --2- 172.21.15.106:0/363557531 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe2000651d0 0x7fe200067680 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe210007040 tx=0x7fe210007ea0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.490+0000 7faacea00640 1 -- 172.21.15.106:0/116866779 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac4007330 con 0x7faad8153b80 2024-08-17T02:27:59.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.490+0000 7fe215600640 1 -- 172.21.15.106:0/363557531 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe2200c7320 con 0x7fe2180d86d0 2024-08-17T02:27:59.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.491+0000 7faade600640 1 -- 172.21.15.106:0/116866779 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad80b5190 con 0x7faad8153b80 2024-08-17T02:27:59.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.491+0000 7faade600640 1 -- 172.21.15.106:0/116866779 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad815a640 con 0x7faad8153b80 2024-08-17T02:27:59.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.492+0000 7f9c72a00640 1 -- 172.21.15.106:0/1299906796 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6002aa50 con 0x7f9c58003720 2024-08-17T02:27:59.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.492+0000 7faade600640 1 -- 172.21.15.106:0/116866779 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad815a360 con 0x7faad8153b80 2024-08-17T02:27:59.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.499+0000 7f9c72a00640 1 -- 172.21.15.106:0/1299906796 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6002abb0 con 0x7f9c58003720 2024-08-17T02:27:59.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.499+0000 7f9c72a00640 1 -- 172.21.15.106:0/1299906796 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c60032440 con 0x7f9c58003720 2024-08-17T02:27:59.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.500+0000 7f9c7ae00640 1 -- 172.21.15.106:0/1299906796 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c58003720 msgr2=0x7f9c58003b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.500+0000 7f9c7ae00640 1 --2- 172.21.15.106:0/1299906796 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c58003720 0x7f9c58003b90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9c7406bc30 tx=0x7f9c600090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.501+0000 7f3719600640 1 -- 172.21.15.106:0/4119321789 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f371c01c080 con 0x7f3724144490 2024-08-17T02:27:59.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.501+0000 7f9c78e00640 1 -- 172.21.15.106:0/1299906796 reap_dead start 2024-08-17T02:27:59.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.502+0000 7f9c7ae00640 1 -- 172.21.15.106:0/1299906796 shutdown_connections 2024-08-17T02:27:59.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.502+0000 7f9c7ae00640 1 -- 172.21.15.106:0/1299906796 >> 172.21.15.106:0/1299906796 conn(0x7f9c740cb9b0 msgr2=0x7f9c740cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.502+0000 7f9c7ae00640 1 -- 172.21.15.106:0/1299906796 shutdown_connections 2024-08-17T02:27:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.502+0000 7f9c7ae00640 1 -- 172.21.15.106:0/1299906796 wait complete. 2024-08-17T02:27:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.503+0000 7faacea00640 1 -- 172.21.15.106:0/116866779 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac40076a0 con 0x7faad8153b80 2024-08-17T02:27:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.503+0000 7faacea00640 1 -- 172.21.15.106:0/116866779 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac400c7a0 con 0x7faad8153b80 2024-08-17T02:27:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.507+0000 7f9c7ae00640 1 Processor -- start 2024-08-17T02:27:59.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.508+0000 7f9c7ae00640 1 -- start start 2024-08-17T02:27:59.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.510+0000 7f9c7ae00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c58003720 0x7f9c740c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.510+0000 7f9c7ae00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c740ca930 0x7f9c741752c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.510+0000 7faacea00640 1 -- 172.21.15.106:0/116866779 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7faac400c920 con 0x7faad8153b80 2024-08-17T02:27:59.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.510+0000 7f9c7ae00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c74154fb0 0x7f9c741553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.511+0000 7f9c7ae00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c741594d0 con 0x7f9c74154fb0 2024-08-17T02:27:59.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.511+0000 7f9c7ae00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c74155920 con 0x7f9c740ca930 2024-08-17T02:27:59.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.511+0000 7f9c7ae00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c740ca4b0 con 0x7f9c58003720 2024-08-17T02:27:59.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.511+0000 7f9c73e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c58003720 0x7f9c740c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.512+0000 7f9c73e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c58003720 0x7f9c740c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:52666/0 (socket says 172.21.15.106:52666) 2024-08-17T02:27:59.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.512+0000 7f9c73e00640 1 -- 172.21.15.106:0/173975169 learned_addr learned my addr 172.21.15.106:0/173975169 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:27:59.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.511+0000 7f9c73400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c740ca930 0x7f9c741752c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.513+0000 7f9c73400640 1 -- 172.21.15.106:0/173975169 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c58003720 msgr2=0x7f9c740c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.513+0000 7f9c73400640 1 --2- 172.21.15.106:0/173975169 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c58003720 0x7f9c740c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.513+0000 7f9c73400640 1 -- 172.21.15.106:0/173975169 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c74154fb0 msgr2=0x7f9c741553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.513+0000 7f9c78e00640 1 --2- 172.21.15.106:0/173975169 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c74154fb0 0x7f9c741553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.514+0000 7f9c73400640 1 --2- 172.21.15.106:0/173975169 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c74154fb0 0x7f9c741553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.513+0000 7faacea00640 1 --2- 172.21.15.106:0/116866779 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7faab8065200 0x7faab80676b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.513+0000 7faacea00640 1 -- 172.21.15.106:0/116866779 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faac40822a0 con 0x7faad8153b80 2024-08-17T02:27:59.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.514+0000 7faacea00640 1 -- 172.21.15.106:0/116866779 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7faac4082690 con 0x7faad8153b80 2024-08-17T02:27:59.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.514+0000 7faad7400640 1 --2- 172.21.15.106:0/116866779 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7faab8065200 0x7faab80676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.514+0000 7f9c73400640 1 -- 172.21.15.106:0/173975169 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c740c8010 con 0x7f9c740ca930 2024-08-17T02:27:59.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.514+0000 7f9c78e00640 1 --2- 172.21.15.106:0/173975169 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c74154fb0 0x7f9c741553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:27:59.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.515+0000 7f9c73400640 1 --2- 172.21.15.106:0/173975169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c740ca930 0x7f9c741752c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9c60031000 tx=0x7f9c60032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.515+0000 7f9c6b400640 1 -- 172.21.15.106:0/173975169 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c60032440 con 0x7f9c740ca930 2024-08-17T02:27:59.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.515+0000 7f9c6b400640 1 -- 172.21.15.106:0/173975169 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c60031a60 con 0x7f9c740ca930 2024-08-17T02:27:59.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.515+0000 7f9c7ae00640 1 -- 172.21.15.106:0/173975169 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c740c92a0 con 0x7f9c740ca930 2024-08-17T02:27:59.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.516+0000 7f9c7ae00640 1 -- 172.21.15.106:0/173975169 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c740ca1d0 con 0x7f9c740ca930 2024-08-17T02:27:59.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.516+0000 7f9c6b400640 1 -- 172.21.15.106:0/173975169 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6002aa50 con 0x7f9c740ca930 2024-08-17T02:27:59.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.516+0000 7faad7400640 1 --2- 172.21.15.106:0/116866779 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7faab8065200 0x7faab80676b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faac8009130 tx=0x7faac8032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.518+0000 7f9c7ae00640 1 -- 172.21.15.106:0/173975169 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4c005210 con 0x7f9c740ca930 2024-08-17T02:27:59.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.519+0000 7f9c6b400640 1 -- 172.21.15.106:0/173975169 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9c6003c400 con 0x7f9c740ca930 2024-08-17T02:27:59.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.521+0000 7f9c6b400640 1 --2- 172.21.15.106:0/173975169 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9c540652a0 0x7f9c54067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:27:59.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.521+0000 7f9c6b400640 1 -- 172.21.15.106:0/173975169 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9c600a2450 con 0x7f9c740ca930 2024-08-17T02:27:59.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.522+0000 7f9c73e00640 1 --2- 172.21.15.106:0/173975169 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9c540652a0 0x7f9c54067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:27:59.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.523+0000 7f9c73e00640 1 --2- 172.21.15.106:0/173975169 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9c540652a0 0x7f9c54067750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9c64001ed0 tx=0x7f9c64007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:27:59.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.525+0000 7f9c6b400640 1 -- 172.21.15.106:0/173975169 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9c600705a0 con 0x7f9c740ca930 2024-08-17T02:27:59.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.756+0000 7fc64fe00640 1 -- 172.21.15.106:0/666090285 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc64800ea60 con 0x7fc648035d40 2024-08-17T02:27:59.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.756+0000 7fc646000640 1 -- 172.21.15.106:0/666090285 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc6500c9ce0 con 0x7fc648035d40 2024-08-17T02:27:59.759 INFO:teuthology.orchestra.run.smithi106.stdout:55834574853 2024-08-17T02:27:59.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.760+0000 7fc64fe00640 1 -- 172.21.15.106:0/666090285 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc6300651d0 msgr2=0x7fc630067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.760+0000 7fc64fe00640 1 --2- 172.21.15.106:0/666090285 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc6300651d0 0x7fc630067680 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc640006cd0 tx=0x7fc640032000 comp rx=0 tx=0).stop 2024-08-17T02:27:59.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.760+0000 7fc64fe00640 1 -- 172.21.15.106:0/666090285 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc648035d40 msgr2=0x7fc6480f0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.761+0000 7fc64fe00640 1 --2- 172.21.15.106:0/666090285 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc648035d40 0x7fc6480f0c40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc650060af0 tx=0x7fc65006f710 comp rx=0 tx=0).stop 2024-08-17T02:27:59.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.761+0000 7fc64fe00640 1 -- 172.21.15.106:0/666090285 shutdown_connections 2024-08-17T02:27:59.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.761+0000 7fc64fe00640 1 --2- 172.21.15.106:0/666090285 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc648035d40 0x7fc6480f0c40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.761+0000 7fc64fe00640 1 --2- 172.21.15.106:0/666090285 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc6300651d0 0x7fc630067680 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.761+0000 7fc64fe00640 1 --2- 172.21.15.106:0/666090285 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6480358c0 0x7fc6480dfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.761+0000 7fc64fe00640 1 --2- 172.21.15.106:0/666090285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc64800da90 0x7fc6480e2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.761+0000 7fc64fe00640 1 -- 172.21.15.106:0/666090285 >> 172.21.15.106:0/666090285 conn(0x7fc648057870 msgr2=0x7fc64804cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.762+0000 7fc64fe00640 1 -- 172.21.15.106:0/666090285 shutdown_connections 2024-08-17T02:27:59.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.762+0000 7fc64fe00640 1 -- 172.21.15.106:0/666090285 wait complete. 2024-08-17T02:27:59.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2024-08-17T02:27:59.792 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:59.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.841+0000 7faade600640 1 -- 172.21.15.106:0/116866779 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faad815a360 con 0x7faad8153b80 2024-08-17T02:27:59.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.842+0000 7faacea00640 1 -- 172.21.15.106:0/116866779 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faac4019020 con 0x7faad8153b80 2024-08-17T02:27:59.842 INFO:teuthology.orchestra.run.smithi106.stdout:55834574854 2024-08-17T02:27:59.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.844+0000 7faade600640 1 -- 172.21.15.106:0/116866779 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7faab8065200 msgr2=0x7faab80676b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.844+0000 7faade600640 1 --2- 172.21.15.106:0/116866779 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7faab8065200 0x7faab80676b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faac8009130 tx=0x7faac8032000 comp rx=0 tx=0).stop 2024-08-17T02:27:59.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.844+0000 7faade600640 1 -- 172.21.15.106:0/116866779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faad8153b80 msgr2=0x7faad813e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.844+0000 7faade600640 1 --2- 172.21.15.106:0/116866779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faad8153b80 0x7faad813e090 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faad80c6e20 tx=0x7faac4009040 comp rx=0 tx=0).stop 2024-08-17T02:27:59.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.844+0000 7faade600640 1 -- 172.21.15.106:0/116866779 shutdown_connections 2024-08-17T02:27:59.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.844+0000 7faade600640 1 --2- 172.21.15.106:0/116866779 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faad8153fd0 0x7faad813e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.844+0000 7faade600640 1 --2- 172.21.15.106:0/116866779 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7faab8065200 0x7faab80676b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.844+0000 7faade600640 1 --2- 172.21.15.106:0/116866779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faad8153b80 0x7faad813e090 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faad80c6e20 tx=0x7faac4009040 comp rx=0 tx=0).stop 2024-08-17T02:27:59.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.844+0000 7faade600640 1 --2- 172.21.15.106:0/116866779 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faabc003a50 0x7faad80b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.844+0000 7faade600640 1 -- 172.21.15.106:0/116866779 >> 172.21.15.106:0/116866779 conn(0x7faad80cfde0 msgr2=0x7faad8067d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.845+0000 7faade600640 1 -- 172.21.15.106:0/116866779 shutdown_connections 2024-08-17T02:27:59.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.845+0000 7faade600640 1 -- 172.21.15.106:0/116866779 wait complete. 2024-08-17T02:27:59.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-08-17T02:27:59.863 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:59.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.866+0000 7fa79b200640 1 -- 172.21.15.106:0/3183049849 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa7900dd1a0 con 0x7fa79000c040 2024-08-17T02:27:59.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.866+0000 7fa78d600640 1 -- 172.21.15.106:0/3183049849 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa788074840 con 0x7fa79000c040 2024-08-17T02:27:59.867 INFO:teuthology.orchestra.run.smithi106.stdout:55834574854 2024-08-17T02:27:59.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.870+0000 7fa79b200640 1 -- 172.21.15.106:0/3183049849 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa7780652a0 msgr2=0x7fa778067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.870+0000 7fa79b200640 1 --2- 172.21.15.106:0/3183049849 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa7780652a0 0x7fa778067750 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa784007fd0 tx=0x7fa784007b00 comp rx=0 tx=0).stop 2024-08-17T02:27:59.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.870+0000 7fa79b200640 1 -- 172.21.15.106:0/3183049849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa79000c040 msgr2=0x7fa7900c79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.870+0000 7fa79b200640 1 --2- 172.21.15.106:0/3183049849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa79000c040 0x7fa7900c79f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa790053c20 tx=0x7fa788032000 comp rx=0 tx=0).stop 2024-08-17T02:27:59.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.870+0000 7fa79b200640 1 -- 172.21.15.106:0/3183049849 shutdown_connections 2024-08-17T02:27:59.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.870+0000 7fa79b200640 1 --2- 172.21.15.106:0/3183049849 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa790053020 0x7fa7900d4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.870+0000 7fa79b200640 1 --2- 172.21.15.106:0/3183049849 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa7780652a0 0x7fa778067750 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.870+0000 7fa79b200640 1 --2- 172.21.15.106:0/3183049849 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7900502f0 0x7fa7900c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.870+0000 7fa79b200640 1 --2- 172.21.15.106:0/3183049849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa79000c040 0x7fa7900c79f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.870+0000 7fa79b200640 1 -- 172.21.15.106:0/3183049849 >> 172.21.15.106:0/3183049849 conn(0x7fa790009fa0 msgr2=0x7fa790006060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.870+0000 7fa79b200640 1 -- 172.21.15.106:0/3183049849 shutdown_connections 2024-08-17T02:27:59.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.871+0000 7fa79b200640 1 -- 172.21.15.106:0/3183049849 wait complete. 2024-08-17T02:27:59.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-08-17T02:27:59.889 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:59.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.890+0000 7fe21f200640 1 -- 172.21.15.106:0/363557531 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe218052f50 con 0x7fe2180d86d0 2024-08-17T02:27:59.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.890+0000 7fe215600640 1 -- 172.21.15.106:0/363557531 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe2200ca940 con 0x7fe2180d86d0 2024-08-17T02:27:59.891 INFO:teuthology.orchestra.run.smithi106.stdout:55834574854 2024-08-17T02:27:59.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.892+0000 7fcf37e00640 1 -- 172.21.15.106:0/2420570821 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcf4c0cc340 con 0x7fcf4c161480 2024-08-17T02:27:59.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.892+0000 7fcf42a00640 1 -- 172.21.15.106:0/2420570821 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcf44018020 con 0x7fcf4c161480 2024-08-17T02:27:59.893 INFO:teuthology.orchestra.run.smithi106.stdout:55834574854 2024-08-17T02:27:59.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.893+0000 7f770e800640 1 -- 172.21.15.106:0/2880841706 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f77080c8110 con 0x7f770814ef90 2024-08-17T02:27:59.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.894+0000 7fe21f200640 1 -- 172.21.15.106:0/363557531 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe2000651d0 msgr2=0x7fe200067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.894+0000 7fe21f200640 1 --2- 172.21.15.106:0/363557531 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe2000651d0 0x7fe200067680 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe210007040 tx=0x7fe210007ea0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.894+0000 7fe21f200640 1 -- 172.21.15.106:0/363557531 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2180d86d0 msgr2=0x7fe2180070f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.894+0000 7fe21f200640 1 --2- 172.21.15.106:0/363557531 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2180d86d0 0x7fe2180070f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe22004c0c0 tx=0x7fe22006f710 comp rx=0 tx=0).stop 2024-08-17T02:27:59.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.894+0000 7fe21f200640 1 -- 172.21.15.106:0/363557531 shutdown_connections 2024-08-17T02:27:59.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.894+0000 7fe21f200640 1 --2- 172.21.15.106:0/363557531 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe2000651d0 0x7fe200067680 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.894+0000 7fe21f200640 1 --2- 172.21.15.106:0/363557531 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2180d86d0 0x7fe2180070f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.894+0000 7fe21f200640 1 --2- 172.21.15.106:0/363557531 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2180504b0 0x7fe218006bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.894+0000 7fe21f200640 1 --2- 172.21.15.106:0/363557531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe21804f1d0 0x7fe2180d8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.894+0000 7fe21f200640 1 -- 172.21.15.106:0/363557531 >> 172.21.15.106:0/363557531 conn(0x7fe218051600 msgr2=0x7fe218036e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.894+0000 7fe21f200640 1 -- 172.21.15.106:0/363557531 shutdown_connections 2024-08-17T02:27:59.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.894+0000 7f76fea00640 1 -- 172.21.15.106:0/2880841706 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f76f4079730 con 0x7f770814ef90 2024-08-17T02:27:59.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.894+0000 7fe21f200640 1 -- 172.21.15.106:0/363557531 wait complete. 2024-08-17T02:27:59.896 INFO:teuthology.orchestra.run.smithi106.stdout:55834574854 2024-08-17T02:27:59.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.895+0000 7fcf37e00640 1 -- 172.21.15.106:0/2420570821 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcf2c0651b0 msgr2=0x7fcf2c067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.895+0000 7fcf37e00640 1 --2- 172.21.15.106:0/2420570821 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcf2c0651b0 0x7fcf2c067660 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c034000 tx=0x7fcf3c032000 comp rx=0 tx=0).stop 2024-08-17T02:27:59.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.895+0000 7fcf37e00640 1 -- 172.21.15.106:0/2420570821 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf4c161480 msgr2=0x7fcf4c0c9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.895+0000 7fcf37e00640 1 --2- 172.21.15.106:0/2420570821 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf4c161480 0x7fcf4c0c9170 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c161880 tx=0x7fcf4400b040 comp rx=0 tx=0).stop 2024-08-17T02:27:59.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.895+0000 7fcf37e00640 1 -- 172.21.15.106:0/2420570821 shutdown_connections 2024-08-17T02:27:59.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.895+0000 7fcf37e00640 1 --2- 172.21.15.106:0/2420570821 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcf2c0651b0 0x7fcf2c067660 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.895+0000 7fcf37e00640 1 --2- 172.21.15.106:0/2420570821 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf4c161480 0x7fcf4c0c9170 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.895+0000 7fcf37e00640 1 --2- 172.21.15.106:0/2420570821 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcf4c15af50 0x7fcf4c0c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.895+0000 7fcf37e00640 1 --2- 172.21.15.106:0/2420570821 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcf4c15ab80 0x7fcf4c15be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.895+0000 7fcf37e00640 1 -- 172.21.15.106:0/2420570821 >> 172.21.15.106:0/2420570821 conn(0x7fcf4c0cb790 msgr2=0x7fcf4c15fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.895+0000 7fcf37e00640 1 -- 172.21.15.106:0/2420570821 shutdown_connections 2024-08-17T02:27:59.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.895+0000 7fcf37e00640 1 -- 172.21.15.106:0/2420570821 wait complete. 2024-08-17T02:27:59.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.897+0000 7f770e800640 1 -- 172.21.15.106:0/2880841706 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f76e80652a0 msgr2=0x7f76e8067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.897+0000 7f770e800640 1 --2- 172.21.15.106:0/2880841706 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f76e80652a0 0x7f76e8067750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f76f8001ed0 tx=0x7f76f8009040 comp rx=0 tx=0).stop 2024-08-17T02:27:59.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.897+0000 7f770e800640 1 -- 172.21.15.106:0/2880841706 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f770814ef90 msgr2=0x7f770814b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.897+0000 7f770e800640 1 --2- 172.21.15.106:0/2880841706 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f770814ef90 0x7f770814b800 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f76f40333a0 tx=0x7f76f403b000 comp rx=0 tx=0).stop 2024-08-17T02:27:59.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.897+0000 7f770e800640 1 -- 172.21.15.106:0/2880841706 shutdown_connections 2024-08-17T02:27:59.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.897+0000 7f770e800640 1 --2- 172.21.15.106:0/2880841706 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f770814ef90 0x7f770814b800 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.897+0000 7f770e800640 1 --2- 172.21.15.106:0/2880841706 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f770814cfc0 0x7f770814ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.897+0000 7f770e800640 1 --2- 172.21.15.106:0/2880841706 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f76e80652a0 0x7f76e8067750 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.897+0000 7f770e800640 1 --2- 172.21.15.106:0/2880841706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7708159430 0x7f770815b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.897+0000 7f770e800640 1 -- 172.21.15.106:0/2880841706 >> 172.21.15.106:0/2880841706 conn(0x7f77080cfde0 msgr2=0x7f77080d03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.898+0000 7f770e800640 1 -- 172.21.15.106:0/2880841706 shutdown_connections 2024-08-17T02:27:59.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.898+0000 7f770e800640 1 -- 172.21.15.106:0/2880841706 wait complete. 2024-08-17T02:27:59.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.904+0000 7f9c7ae00640 1 -- 172.21.15.106:0/173975169 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9c4c0054c0 con 0x7f9c740ca930 2024-08-17T02:27:59.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.904+0000 7f9c6b400640 1 -- 172.21.15.106:0/173975169 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9c60073bc0 con 0x7f9c740ca930 2024-08-17T02:27:59.905 INFO:teuthology.orchestra.run.smithi106.stdout:55834574853 2024-08-17T02:27:59.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.907+0000 7f9c7ae00640 1 -- 172.21.15.106:0/173975169 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9c540652a0 msgr2=0x7f9c54067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.907+0000 7f9c7ae00640 1 --2- 172.21.15.106:0/173975169 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9c540652a0 0x7f9c54067750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9c64001ed0 tx=0x7f9c64007040 comp rx=0 tx=0).stop 2024-08-17T02:27:59.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.907+0000 7f9c7ae00640 1 -- 172.21.15.106:0/173975169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c740ca930 msgr2=0x7f9c741752c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.907+0000 7f9c7ae00640 1 --2- 172.21.15.106:0/173975169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c740ca930 0x7f9c741752c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9c60031000 tx=0x7f9c60032000 comp rx=0 tx=0).stop 2024-08-17T02:27:59.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.907+0000 7f9c7ae00640 1 -- 172.21.15.106:0/173975169 shutdown_connections 2024-08-17T02:27:59.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.907+0000 7f9c7ae00640 1 --2- 172.21.15.106:0/173975169 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9c540652a0 0x7f9c54067750 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.907+0000 7f9c7ae00640 1 --2- 172.21.15.106:0/173975169 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c74154fb0 0x7f9c741553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.907+0000 7f9c7ae00640 1 --2- 172.21.15.106:0/173975169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c740ca930 0x7f9c741752c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.907+0000 7f9c7ae00640 1 --2- 172.21.15.106:0/173975169 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c58003720 0x7f9c740c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.907+0000 7f9c7ae00640 1 -- 172.21.15.106:0/173975169 >> 172.21.15.106:0/173975169 conn(0x7f9c740cb9b0 msgr2=0x7f9c740b1730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.908+0000 7f9c7ae00640 1 -- 172.21.15.106:0/173975169 shutdown_connections 2024-08-17T02:27:59.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.908+0000 7f9c7ae00640 1 -- 172.21.15.106:0/173975169 wait complete. 2024-08-17T02:27:59.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.908+0000 7f3729200640 1 -- 172.21.15.106:0/4119321789 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f37240b04d0 con 0x7f3724144490 2024-08-17T02:27:59.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.909+0000 7f3719600640 1 -- 172.21.15.106:0/4119321789 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f371c0544d0 con 0x7f3724144490 2024-08-17T02:27:59.910 INFO:teuthology.orchestra.run.smithi106.stdout:55834574853 2024-08-17T02:27:59.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.911+0000 7f3729200640 1 -- 172.21.15.106:0/4119321789 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f3700065200 msgr2=0x7f37000676b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.911+0000 7f3729200640 1 --2- 172.21.15.106:0/4119321789 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f3700065200 0x7f37000676b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f37240aad80 tx=0x7f37140090f0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.911+0000 7f3729200640 1 -- 172.21.15.106:0/4119321789 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3724144490 msgr2=0x7f3724151330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:27:59.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.911+0000 7f3729200640 1 --2- 172.21.15.106:0/4119321789 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3724144490 0x7f3724151330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f371c00b3c0 tx=0x7f371c009810 comp rx=0 tx=0).stop 2024-08-17T02:27:59.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.911+0000 7f3729200640 1 -- 172.21.15.106:0/4119321789 shutdown_connections 2024-08-17T02:27:59.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.911+0000 7f3729200640 1 --2- 172.21.15.106:0/4119321789 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37240b1f20 0x7f37240b2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.911+0000 7f3729200640 1 --2- 172.21.15.106:0/4119321789 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3724144860 0x7f3724151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.912+0000 7f3729200640 1 --2- 172.21.15.106:0/4119321789 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f3700065200 0x7f37000676b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.912+0000 7f3729200640 1 --2- 172.21.15.106:0/4119321789 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3724144490 0x7f3724151330 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:27:59.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.912+0000 7f3729200640 1 -- 172.21.15.106:0/4119321789 >> 172.21.15.106:0/4119321789 conn(0x7f37240b3040 msgr2=0x7f37240b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:27:59.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.912+0000 7f3729200640 1 -- 172.21.15.106:0/4119321789 shutdown_connections 2024-08-17T02:27:59.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:27:59.912+0000 7f3729200640 1 -- 172.21.15.106:0/4119321789 wait complete. 2024-08-17T02:27:59.919 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-08-17T02:27:59.919 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:59.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2024-08-17T02:27:59.920 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:59.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-08-17T02:27:59.920 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:59.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2024-08-17T02:27:59.925 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:59.930 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-08-17T02:27:59.930 DEBUG:teuthology.parallel:result is None 2024-08-17T02:27:59.930 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:27:59.930 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:28:00.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.118+0000 7f8acb600640 1 Processor -- start 2024-08-17T02:28:00.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.118+0000 7f8acb600640 1 -- start start 2024-08-17T02:28:00.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.119+0000 7f8acb600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8ac40b1440 0x7f8ac40caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.119+0000 7f8acb600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ac4140580 0x7f8ac40c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.119+0000 7f8acb600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac40caa80 con 0x7f8ac41401b0 2024-08-17T02:28:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.119+0000 7f8acb600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ac40cb450 con 0x7f8ac40b1440 2024-08-17T02:28:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.119+0000 7f8acb600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac40c9e70 con 0x7f8ac4140580 2024-08-17T02:28:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.119+0000 7f8ac8c00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8ac41401b0 0x7f8ac40b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:46256/0 (socket says 172.21.15.106:46256) 2024-08-17T02:28:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.119+0000 7f8ac8c00640 1 -- 172.21.15.106:0/1296497051 learned_addr learned my addr 172.21.15.106:0/1296497051 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.120+0000 7f8ac3e00640 1 --2- 172.21.15.106:0/1296497051 >> v2:172.21.15.171:3300/0 conn(0x7f8ac40b1440 0x7f8ac40caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.120+0000 7f8ac9600640 1 --2- 172.21.15.106:0/1296497051 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ac4140580 0x7f8ac40c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.120+0000 7f8ac3400640 1 -- 172.21.15.106:0/1296497051 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3011745059 0 0) 0x7f8ac40caa80 con 0x7f8ac41401b0 2024-08-17T02:28:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.120+0000 7f8ac3400640 1 -- 172.21.15.106:0/1296497051 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aac0034e0 con 0x7f8ac41401b0 2024-08-17T02:28:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.120+0000 7f8ac3400640 1 -- 172.21.15.106:0/1296497051 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3787824486 0 0) 0x7f8aac0034e0 con 0x7f8ac41401b0 2024-08-17T02:28:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.120+0000 7f8ac3400640 1 -- 172.21.15.106:0/1296497051 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ac4140580 msgr2=0x7f8ac40c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.120+0000 7f8ac3400640 1 --2- 172.21.15.106:0/1296497051 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ac4140580 0x7f8ac40c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.120+0000 7f8ac3400640 1 -- 172.21.15.106:0/1296497051 >> v2:172.21.15.171:3300/0 conn(0x7f8ac40b1440 msgr2=0x7f8ac40caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.120+0000 7f8ac3400640 1 --2- 172.21.15.106:0/1296497051 >> v2:172.21.15.171:3300/0 conn(0x7f8ac40b1440 0x7f8ac40caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.120+0000 7f8ac3400640 1 -- 172.21.15.106:0/1296497051 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac40ca150 con 0x7f8ac41401b0 2024-08-17T02:28:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.120+0000 7f8ac3400640 1 -- 172.21.15.106:0/1296497051 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7f8ab8001470 con 0x7f8ac41401b0 2024-08-17T02:28:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.120+0000 7f8ac3400640 1 -- 172.21.15.106:0/1296497051 >> v1:172.21.15.106:6789/0 conn(0x7f8ac41401b0 legacy=0x7f8ac40b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.120+0000 7f8ac3400640 1 --2- 172.21.15.106:0/1296497051 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8aac0039d0 0x7f8aac003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.120+0000 7f8ac3400640 1 --2- 172.21.15.106:0/1296497051 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8aac004780 0x7f8aac004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.120+0000 7f8ac3400640 1 --2- 172.21.15.106:0/1296497051 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8aac005130 0x7f8aac00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.120+0000 7f8ac3400640 1 -- 172.21.15.106:0/1296497051 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac40cb450 con 0x7f8aac0039d0 2024-08-17T02:28:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.120+0000 7f8ac3400640 1 -- 172.21.15.106:0/1296497051 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac40c9e70 con 0x7f8aac004780 2024-08-17T02:28:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.120+0000 7f8ac3400640 1 -- 172.21.15.106:0/1296497051 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac00bf10 con 0x7f8aac005130 2024-08-17T02:28:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.120+0000 7f8ac9600640 1 --2- 172.21.15.106:0/1296497051 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8ac4140580 0x7f8ac40c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:00.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.120+0000 7f8ac8c00640 1 --2- 172.21.15.106:0/1296497051 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8aac0039d0 0x7f8aac003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.121+0000 7f8ac3e00640 1 --2- 172.21.15.106:0/1296497051 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8aac004780 0x7f8aac004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.121+0000 7f8ac9600640 1 --2- 172.21.15.106:0/1296497051 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8aac005130 0x7f8aac00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.121+0000 7f8ac8c00640 1 -- 172.21.15.106:0/1296497051 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8aac005130 msgr2=0x7f8aac00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:00.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.121+0000 7f8ac8c00640 1 --2- 172.21.15.106:0/1296497051 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8aac005130 0x7f8aac00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.121+0000 7f8ac8c00640 1 -- 172.21.15.106:0/1296497051 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8aac004780 msgr2=0x7f8aac004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:00.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.121+0000 7f8ac8c00640 1 --2- 172.21.15.106:0/1296497051 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8aac004780 0x7f8aac004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.121+0000 7f8ac8c00640 1 -- 172.21.15.106:0/1296497051 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac0034e0 con 0x7f8aac0039d0 2024-08-17T02:28:00.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.122+0000 7f8ac8c00640 1 --2- 172.21.15.106:0/1296497051 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8aac0039d0 0x7f8aac003de0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800c2a0 tx=0x7f8ab8001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3f28e05c2e0734 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.122+0000 7f8ac3400640 1 -- 172.21.15.106:0/1296497051 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8005890 con 0x7f8aac0039d0 2024-08-17T02:28:00.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.122+0000 7f8ac3400640 1 -- 172.21.15.106:0/1296497051 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab8005a30 con 0x7f8aac0039d0 2024-08-17T02:28:00.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.122+0000 7f8ac3400640 1 -- 172.21.15.106:0/1296497051 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8005e30 con 0x7f8aac0039d0 2024-08-17T02:28:00.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.122+0000 7f8acb600640 1 -- 172.21.15.106:0/1296497051 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8aac0039d0 msgr2=0x7f8aac003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.122+0000 7f8acb600640 1 --2- 172.21.15.106:0/1296497051 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8aac0039d0 0x7f8aac003de0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800c2a0 tx=0x7f8ab8001e90 comp rx=0 tx=0).stop 2024-08-17T02:28:00.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.122+0000 7f8ac9600640 1 -- 172.21.15.106:0/1296497051 reap_dead start 2024-08-17T02:28:00.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.123+0000 7f8acb600640 1 -- 172.21.15.106:0/1296497051 shutdown_connections 2024-08-17T02:28:00.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.123+0000 7f8acb600640 1 -- 172.21.15.106:0/1296497051 >> 172.21.15.106:0/1296497051 conn(0x7f8ac40cb9b0 msgr2=0x7f8ac40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:00.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.123+0000 7f8acb600640 1 -- 172.21.15.106:0/1296497051 shutdown_connections 2024-08-17T02:28:00.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.123+0000 7f8acb600640 1 -- 172.21.15.106:0/1296497051 wait complete. 2024-08-17T02:28:00.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.124+0000 7f8acb600640 1 Processor -- start 2024-08-17T02:28:00.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.124+0000 7f8acb600640 1 -- start start 2024-08-17T02:28:00.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.125+0000 7f8acb600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8aac0039d0 0x7f8ac40a88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.125+0000 7f8acb600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ac40a5ec0 0x7f8ac40a8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.125+0000 7f8acb600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ac40c6cd0 0x7f8ac40c7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.125+0000 7f8acb600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac40aa8d0 con 0x7f8ac40c6cd0 2024-08-17T02:28:00.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.125+0000 7f8acb600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac40a6430 con 0x7f8ac40a5ec0 2024-08-17T02:28:00.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.125+0000 7f8acb600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac40a6710 con 0x7f8aac0039d0 2024-08-17T02:28:00.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.125+0000 7f8ac9600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ac40c6cd0 0x7f8ac40c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.125+0000 7f8ac9600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ac40c6cd0 0x7f8ac40c7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53454/0 (socket says 172.21.15.106:53454) 2024-08-17T02:28:00.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.125+0000 7f8ac9600640 1 -- 172.21.15.106:0/2459550668 learned_addr learned my addr 172.21.15.106:0/2459550668 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:00.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.125+0000 7f8ac8c00640 1 --2- 172.21.15.106:0/2459550668 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8aac0039d0 0x7f8ac40a88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.125+0000 7f8ac3e00640 1 --2- 172.21.15.106:0/2459550668 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ac40a5ec0 0x7f8ac40a8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.126+0000 7f8ac9600640 1 -- 172.21.15.106:0/2459550668 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8aac0039d0 msgr2=0x7f8ac40a88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.126+0000 7f8ac9600640 1 --2- 172.21.15.106:0/2459550668 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8aac0039d0 0x7f8ac40a88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.126+0000 7f8ac9600640 1 -- 172.21.15.106:0/2459550668 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ac40a5ec0 msgr2=0x7f8ac40a8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.126+0000 7f8ac9600640 1 --2- 172.21.15.106:0/2459550668 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ac40a5ec0 0x7f8ac40a8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.126+0000 7f8ac9600640 1 -- 172.21.15.106:0/2459550668 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac40a69f0 con 0x7f8ac40c6cd0 2024-08-17T02:28:00.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.126+0000 7f8ac9600640 1 --2- 172.21.15.106:0/2459550668 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ac40c6cd0 0x7f8ac40c7170 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40cc900 tx=0x7f8abc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.126+0000 7f8ab7e00640 1 -- 172.21.15.106:0/2459550668 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc00e070 con 0x7f8ac40c6cd0 2024-08-17T02:28:00.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.126+0000 7f8ab7e00640 1 -- 172.21.15.106:0/2459550668 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8abc011750 con 0x7f8ac40c6cd0 2024-08-17T02:28:00.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.126+0000 7f8acb600640 1 -- 172.21.15.106:0/2459550668 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac40a6cd0 con 0x7f8ac40c6cd0 2024-08-17T02:28:00.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.126+0000 7f8ab7e00640 1 -- 172.21.15.106:0/2459550668 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc011b30 con 0x7f8ac40c6cd0 2024-08-17T02:28:00.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.126+0000 7f8acb600640 1 -- 172.21.15.106:0/2459550668 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac40c76b0 con 0x7f8ac40c6cd0 2024-08-17T02:28:00.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.127+0000 7f8acb600640 1 -- 172.21.15.106:0/2459550668 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac4064db0 con 0x7f8ac40c6cd0 2024-08-17T02:28:00.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.128+0000 7f8ab7e00640 1 -- 172.21.15.106:0/2459550668 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8abc016470 con 0x7f8ac40c6cd0 2024-08-17T02:28:00.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.129+0000 7f8ab7e00640 1 --2- 172.21.15.106:0/2459550668 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8aa4065200 0x7f8aa40676b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.129+0000 7f8ab7e00640 1 -- 172.21.15.106:0/2459550668 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8abc0829f0 con 0x7f8ac40c6cd0 2024-08-17T02:28:00.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.129+0000 7f8ac8c00640 1 --2- 172.21.15.106:0/2459550668 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8aa4065200 0x7f8aa40676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.130+0000 7f8ac8c00640 1 --2- 172.21.15.106:0/2459550668 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8aa4065200 0x7f8aa40676b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8033000 tx=0x7f8ab8034000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.133+0000 7f8ab7e00640 1 -- 172.21.15.106:0/2459550668 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8abc050ac0 con 0x7f8ac40c6cd0 2024-08-17T02:28:00.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.304+0000 7f8acb600640 1 -- 172.21.15.106:0/2459550668 --> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8ac406de50 con 0x7f8aa4065200 2024-08-17T02:28:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.311+0000 7f8ab7e00640 1 -- 172.21.15.106:0/2459550668 <== mgr.4107 v2:172.21.15.106:6832/36860 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264567 (secure 0 0 0) 0x7f8ac406de50 con 0x7f8aa4065200 2024-08-17T02:28:00.315 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-08-17T02:28:00.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.315+0000 7f8acb600640 1 -- 172.21.15.106:0/2459550668 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8aa4065200 msgr2=0x7f8aa40676b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.315+0000 7f8acb600640 1 --2- 172.21.15.106:0/2459550668 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8aa4065200 0x7f8aa40676b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8033000 tx=0x7f8ab8034000 comp rx=0 tx=0).stop 2024-08-17T02:28:00.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.315+0000 7f8acb600640 1 -- 172.21.15.106:0/2459550668 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ac40c6cd0 msgr2=0x7f8ac40c7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.315+0000 7f8acb600640 1 --2- 172.21.15.106:0/2459550668 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ac40c6cd0 0x7f8ac40c7170 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40cc900 tx=0x7f8abc00b040 comp rx=0 tx=0).stop 2024-08-17T02:28:00.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.315+0000 7f8acb600640 1 -- 172.21.15.106:0/2459550668 shutdown_connections 2024-08-17T02:28:00.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.315+0000 7f8acb600640 1 --2- 172.21.15.106:0/2459550668 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8aa4065200 0x7f8aa40676b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.315+0000 7f8acb600640 1 --2- 172.21.15.106:0/2459550668 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ac40c6cd0 0x7f8ac40c7170 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.315+0000 7f8acb600640 1 --2- 172.21.15.106:0/2459550668 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ac40a5ec0 0x7f8ac40a8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.315+0000 7f8acb600640 1 --2- 172.21.15.106:0/2459550668 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8aac0039d0 0x7f8ac40a88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.315+0000 7f8acb600640 1 -- 172.21.15.106:0/2459550668 >> 172.21.15.106:0/2459550668 conn(0x7f8ac40cb9b0 msgr2=0x7f8ac40aec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:00.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.315+0000 7f8acb600640 1 -- 172.21.15.106:0/2459550668 shutdown_connections 2024-08-17T02:28:00.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.315+0000 7f8acb600640 1 -- 172.21.15.106:0/2459550668 wait complete. 2024-08-17T02:28:00.330 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-08-17T02:27:59.877435+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381708,"kb_used_data":2824,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752593012,"statfs":{"total":773094113280,"available":770655244288,"internally_reserved":0,"allocated":2891776,"data_stored":1750644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.600865"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309577+0000","last_change":"2024-08-17T02:27:51.307275+0000","last_active":"2024-08-17T02:27:51.309577+0000","last_peered":"2024-08-17T02:27:51.309577+0000","last_clean":"2024-08-17T02:27:51.309577+0000","last_became_active":"2024-08-17T02:27:51.306981+0000","last_became_peered":"2024-08-17T02:27:51.306981+0000","last_unstale":"2024-08-17T02:27:51.309577+0000","last_undegraded":"2024-08-17T02:27:51.309577+0000","last_fullsized":"2024-08-17T02:27:51.309577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:34:53.506566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.293426+0000","last_change":"2024-08-17T02:27:51.289931+0000","last_active":"2024-08-17T02:27:51.293426+0000","last_peered":"2024-08-17T02:27:51.293426+0000","last_clean":"2024-08-17T02:27:51.293426+0000","last_became_active":"2024-08-17T02:27:51.289692+0000","last_became_peered":"2024-08-17T02:27:51.289692+0000","last_unstale":"2024-08-17T02:27:51.293426+0000","last_undegraded":"2024-08-17T02:27:51.293426+0000","last_fullsized":"2024-08-17T02:27:51.293426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:04:36.940627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.300228+0000","last_change":"2024-08-17T02:27:51.293123+0000","last_active":"2024-08-17T02:27:51.300228+0000","last_peered":"2024-08-17T02:27:51.300228+0000","last_clean":"2024-08-17T02:27:51.300228+0000","last_became_active":"2024-08-17T02:27:51.290362+0000","last_became_peered":"2024-08-17T02:27:51.290362+0000","last_unstale":"2024-08-17T02:27:51.300228+0000","last_undegraded":"2024-08-17T02:27:51.300228+0000","last_fullsized":"2024-08-17T02:27:51.300228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:31.950047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315815+0000","last_change":"2024-08-17T02:27:51.310784+0000","last_active":"2024-08-17T02:27:51.315815+0000","last_peered":"2024-08-17T02:27:51.315815+0000","last_clean":"2024-08-17T02:27:51.315815+0000","last_became_active":"2024-08-17T02:27:51.310504+0000","last_became_peered":"2024-08-17T02:27:51.310504+0000","last_unstale":"2024-08-17T02:27:51.315815+0000","last_undegraded":"2024-08-17T02:27:51.315815+0000","last_fullsized":"2024-08-17T02:27:51.315815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:34:53.506566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.304867+0000","last_change":"2024-08-17T02:27:51.300548+0000","last_active":"2024-08-17T02:27:51.304867+0000","last_peered":"2024-08-17T02:27:51.304867+0000","last_clean":"2024-08-17T02:27:51.304867+0000","last_became_active":"2024-08-17T02:27:51.298611+0000","last_became_peered":"2024-08-17T02:27:51.298611+0000","last_unstale":"2024-08-17T02:27:51.304867+0000","last_undegraded":"2024-08-17T02:27:51.304867+0000","last_fullsized":"2024-08-17T02:27:51.304867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:12:12.800070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315424+0000","last_change":"2024-08-17T02:27:51.309274+0000","last_active":"2024-08-17T02:27:51.315424+0000","last_peered":"2024-08-17T02:27:51.315424+0000","last_clean":"2024-08-17T02:27:51.315424+0000","last_became_active":"2024-08-17T02:27:51.309017+0000","last_became_peered":"2024-08-17T02:27:51.309017+0000","last_unstale":"2024-08-17T02:27:51.315424+0000","last_undegraded":"2024-08-17T02:27:51.315424+0000","last_fullsized":"2024-08-17T02:27:51.315424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:08.545557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.314077+0000","last_change":"2024-08-17T02:27:51.309089+0000","last_active":"2024-08-17T02:27:51.314077+0000","last_peered":"2024-08-17T02:27:51.314077+0000","last_clean":"2024-08-17T02:27:51.314077+0000","last_became_active":"2024-08-17T02:27:51.308817+0000","last_became_peered":"2024-08-17T02:27:51.308817+0000","last_unstale":"2024-08-17T02:27:51.314077+0000","last_undegraded":"2024-08-17T02:27:51.314077+0000","last_fullsized":"2024-08-17T02:27:51.314077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:22:54.682219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.305139+0000","last_change":"2024-08-17T02:27:51.301226+0000","last_active":"2024-08-17T02:27:51.305139+0000","last_peered":"2024-08-17T02:27:51.305139+0000","last_clean":"2024-08-17T02:27:51.305139+0000","last_became_active":"2024-08-17T02:27:51.300976+0000","last_became_peered":"2024-08-17T02:27:51.300976+0000","last_unstale":"2024-08-17T02:27:51.305139+0000","last_undegraded":"2024-08-17T02:27:51.305139+0000","last_fullsized":"2024-08-17T02:27:51.305139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:51:59.475864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.321818+0000","last_change":"2024-08-17T02:27:51.320367+0000","last_active":"2024-08-17T02:27:51.321818+0000","last_peered":"2024-08-17T02:27:51.321818+0000","last_clean":"2024-08-17T02:27:51.321818+0000","last_became_active":"2024-08-17T02:27:51.320044+0000","last_became_peered":"2024-08-17T02:27:51.320044+0000","last_unstale":"2024-08-17T02:27:51.321818+0000","last_undegraded":"2024-08-17T02:27:51.321818+0000","last_fullsized":"2024-08-17T02:27:51.321818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:03:57.699175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.316581+0000","last_change":"2024-08-17T02:27:51.311082+0000","last_active":"2024-08-17T02:27:51.316581+0000","last_peered":"2024-08-17T02:27:51.316581+0000","last_clean":"2024-08-17T02:27:51.316581+0000","last_became_active":"2024-08-17T02:27:51.309886+0000","last_became_peered":"2024-08-17T02:27:51.309886+0000","last_unstale":"2024-08-17T02:27:51.316581+0000","last_undegraded":"2024-08-17T02:27:51.316581+0000","last_fullsized":"2024-08-17T02:27:51.316581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:07.004040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.313062+0000","last_change":"2024-08-17T02:27:51.309574+0000","last_active":"2024-08-17T02:27:51.313062+0000","last_peered":"2024-08-17T02:27:51.313062+0000","last_clean":"2024-08-17T02:27:51.313062+0000","last_became_active":"2024-08-17T02:27:51.309291+0000","last_became_peered":"2024-08-17T02:27:51.309291+0000","last_unstale":"2024-08-17T02:27:51.313062+0000","last_undegraded":"2024-08-17T02:27:51.313062+0000","last_fullsized":"2024-08-17T02:27:51.313062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:26.379433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.308225+0000","last_change":"2024-08-17T02:27:51.305009+0000","last_active":"2024-08-17T02:27:51.308225+0000","last_peered":"2024-08-17T02:27:51.308225+0000","last_clean":"2024-08-17T02:27:51.308225+0000","last_became_active":"2024-08-17T02:27:51.303089+0000","last_became_peered":"2024-08-17T02:27:51.303089+0000","last_unstale":"2024-08-17T02:27:51.308225+0000","last_undegraded":"2024-08-17T02:27:51.308225+0000","last_fullsized":"2024-08-17T02:27:51.308225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:52:35.132297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.304722+0000","last_change":"2024-08-17T02:27:51.299987+0000","last_active":"2024-08-17T02:27:51.304722+0000","last_peered":"2024-08-17T02:27:51.304722+0000","last_clean":"2024-08-17T02:27:51.304722+0000","last_became_active":"2024-08-17T02:27:51.299700+0000","last_became_peered":"2024-08-17T02:27:51.299700+0000","last_unstale":"2024-08-17T02:27:51.304722+0000","last_undegraded":"2024-08-17T02:27:51.304722+0000","last_fullsized":"2024-08-17T02:27:51.304722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:23.747098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.289813+0000","last_change":"2024-08-17T02:27:51.287246+0000","last_active":"2024-08-17T02:27:51.289813+0000","last_peered":"2024-08-17T02:27:51.289813+0000","last_clean":"2024-08-17T02:27:51.289813+0000","last_became_active":"2024-08-17T02:27:51.287011+0000","last_became_peered":"2024-08-17T02:27:51.287011+0000","last_unstale":"2024-08-17T02:27:51.289813+0000","last_undegraded":"2024-08-17T02:27:51.289813+0000","last_fullsized":"2024-08-17T02:27:51.289813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:00.021420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.311602+0000","last_change":"2024-08-17T02:27:51.306642+0000","last_active":"2024-08-17T02:27:51.311602+0000","last_peered":"2024-08-17T02:27:51.311602+0000","last_clean":"2024-08-17T02:27:51.311602+0000","last_became_active":"2024-08-17T02:27:51.306324+0000","last_became_peered":"2024-08-17T02:27:51.306324+0000","last_unstale":"2024-08-17T02:27:51.311602+0000","last_undegraded":"2024-08-17T02:27:51.311602+0000","last_fullsized":"2024-08-17T02:27:51.311602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:45:24.383393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.311314+0000","last_change":"2024-08-17T02:27:51.307812+0000","last_active":"2024-08-17T02:27:51.311314+0000","last_peered":"2024-08-17T02:27:51.311314+0000","last_clean":"2024-08-17T02:27:51.311314+0000","last_became_active":"2024-08-17T02:27:51.307000+0000","last_became_peered":"2024-08-17T02:27:51.307000+0000","last_unstale":"2024-08-17T02:27:51.311314+0000","last_undegraded":"2024-08-17T02:27:51.311314+0000","last_fullsized":"2024-08-17T02:27:51.311314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:23.747098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315476+0000","last_change":"2024-08-17T02:27:51.313130+0000","last_active":"2024-08-17T02:27:51.315476+0000","last_peered":"2024-08-17T02:27:51.315476+0000","last_clean":"2024-08-17T02:27:51.315476+0000","last_became_active":"2024-08-17T02:27:51.312875+0000","last_became_peered":"2024-08-17T02:27:51.312875+0000","last_unstale":"2024-08-17T02:27:51.315476+0000","last_undegraded":"2024-08-17T02:27:51.315476+0000","last_fullsized":"2024-08-17T02:27:51.315476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:01.072889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309623+0000","last_change":"2024-08-17T02:27:51.302749+0000","last_active":"2024-08-17T02:27:51.309623+0000","last_peered":"2024-08-17T02:27:51.309623+0000","last_clean":"2024-08-17T02:27:51.309623+0000","last_became_active":"2024-08-17T02:27:51.302531+0000","last_became_peered":"2024-08-17T02:27:51.302531+0000","last_unstale":"2024-08-17T02:27:51.309623+0000","last_undegraded":"2024-08-17T02:27:51.309623+0000","last_fullsized":"2024-08-17T02:27:51.309623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:52:35.132297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.305870+0000","last_change":"2024-08-17T02:27:51.304533+0000","last_active":"2024-08-17T02:27:51.305870+0000","last_peered":"2024-08-17T02:27:51.305870+0000","last_clean":"2024-08-17T02:27:51.305870+0000","last_became_active":"2024-08-17T02:27:51.304274+0000","last_became_peered":"2024-08-17T02:27:51.304274+0000","last_unstale":"2024-08-17T02:27:51.305870+0000","last_undegraded":"2024-08-17T02:27:51.305870+0000","last_fullsized":"2024-08-17T02:27:51.305870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:23.159482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.314254+0000","last_change":"2024-08-17T02:27:51.307321+0000","last_active":"2024-08-17T02:27:51.314254+0000","last_peered":"2024-08-17T02:27:51.314254+0000","last_clean":"2024-08-17T02:27:51.314254+0000","last_became_active":"2024-08-17T02:27:51.306795+0000","last_became_peered":"2024-08-17T02:27:51.306795+0000","last_unstale":"2024-08-17T02:27:51.314254+0000","last_undegraded":"2024-08-17T02:27:51.314254+0000","last_fullsized":"2024-08-17T02:27:51.314254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:04:36.940627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.306021+0000","last_change":"2024-08-17T02:27:51.293229+0000","last_active":"2024-08-17T02:27:51.306021+0000","last_peered":"2024-08-17T02:27:51.306021+0000","last_clean":"2024-08-17T02:27:51.306021+0000","last_became_active":"2024-08-17T02:27:51.292455+0000","last_became_peered":"2024-08-17T02:27:51.292455+0000","last_unstale":"2024-08-17T02:27:51.306021+0000","last_undegraded":"2024-08-17T02:27:51.306021+0000","last_fullsized":"2024-08-17T02:27:51.306021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:04:36.940627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.310379+0000","last_change":"2024-08-17T02:27:51.302786+0000","last_active":"2024-08-17T02:27:51.310379+0000","last_peered":"2024-08-17T02:27:51.310379+0000","last_clean":"2024-08-17T02:27:51.310379+0000","last_became_active":"2024-08-17T02:27:51.302520+0000","last_became_peered":"2024-08-17T02:27:51.302520+0000","last_unstale":"2024-08-17T02:27:51.310379+0000","last_undegraded":"2024-08-17T02:27:51.310379+0000","last_fullsized":"2024-08-17T02:27:51.310379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:22:54.682219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.304491+0000","last_change":"2024-08-17T02:27:51.297406+0000","last_active":"2024-08-17T02:27:51.304491+0000","last_peered":"2024-08-17T02:27:51.304491+0000","last_clean":"2024-08-17T02:27:51.304491+0000","last_became_active":"2024-08-17T02:27:51.291804+0000","last_became_peered":"2024-08-17T02:27:51.291804+0000","last_unstale":"2024-08-17T02:27:51.304491+0000","last_undegraded":"2024-08-17T02:27:51.304491+0000","last_fullsized":"2024-08-17T02:27:51.304491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:22:54.682219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315495+0000","last_change":"2024-08-17T02:27:51.312012+0000","last_active":"2024-08-17T02:27:51.315495+0000","last_peered":"2024-08-17T02:27:51.315495+0000","last_clean":"2024-08-17T02:27:51.315495+0000","last_became_active":"2024-08-17T02:27:51.311735+0000","last_became_peered":"2024-08-17T02:27:51.311735+0000","last_unstale":"2024-08-17T02:27:51.315495+0000","last_undegraded":"2024-08-17T02:27:51.315495+0000","last_fullsized":"2024-08-17T02:27:51.315495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:47:22.647519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.304429+0000","last_change":"2024-08-17T02:27:51.294844+0000","last_active":"2024-08-17T02:27:51.304429+0000","last_peered":"2024-08-17T02:27:51.304429+0000","last_clean":"2024-08-17T02:27:51.304429+0000","last_became_active":"2024-08-17T02:27:51.294546+0000","last_became_peered":"2024-08-17T02:27:51.294546+0000","last_unstale":"2024-08-17T02:27:51.304429+0000","last_undegraded":"2024-08-17T02:27:51.304429+0000","last_fullsized":"2024-08-17T02:27:51.304429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:17:09.418523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309763+0000","last_change":"2024-08-17T02:27:51.301918+0000","last_active":"2024-08-17T02:27:51.309763+0000","last_peered":"2024-08-17T02:27:51.309763+0000","last_clean":"2024-08-17T02:27:51.309763+0000","last_became_active":"2024-08-17T02:27:51.301672+0000","last_became_peered":"2024-08-17T02:27:51.301672+0000","last_unstale":"2024-08-17T02:27:51.309763+0000","last_undegraded":"2024-08-17T02:27:51.309763+0000","last_fullsized":"2024-08-17T02:27:51.309763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:23.159482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309265+0000","last_change":"2024-08-17T02:27:51.305095+0000","last_active":"2024-08-17T02:27:51.309265+0000","last_peered":"2024-08-17T02:27:51.309265+0000","last_clean":"2024-08-17T02:27:51.309265+0000","last_became_active":"2024-08-17T02:27:51.304895+0000","last_became_peered":"2024-08-17T02:27:51.304895+0000","last_unstale":"2024-08-17T02:27:51.309265+0000","last_undegraded":"2024-08-17T02:27:51.309265+0000","last_fullsized":"2024-08-17T02:27:51.309265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:07.004040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.312124+0000","last_change":"2024-08-17T02:27:51.307625+0000","last_active":"2024-08-17T02:27:51.312124+0000","last_peered":"2024-08-17T02:27:51.312124+0000","last_clean":"2024-08-17T02:27:51.312124+0000","last_became_active":"2024-08-17T02:27:51.307052+0000","last_became_peered":"2024-08-17T02:27:51.307052+0000","last_unstale":"2024-08-17T02:27:51.312124+0000","last_undegraded":"2024-08-17T02:27:51.312124+0000","last_fullsized":"2024-08-17T02:27:51.312124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:08.545557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.308474+0000","last_change":"2024-08-17T02:27:51.305503+0000","last_active":"2024-08-17T02:27:51.308474+0000","last_peered":"2024-08-17T02:27:51.308474+0000","last_clean":"2024-08-17T02:27:51.308474+0000","last_became_active":"2024-08-17T02:27:51.302095+0000","last_became_peered":"2024-08-17T02:27:51.302095+0000","last_unstale":"2024-08-17T02:27:51.308474+0000","last_undegraded":"2024-08-17T02:27:51.308474+0000","last_fullsized":"2024-08-17T02:27:51.308474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:23.747098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315454+0000","last_change":"2024-08-17T02:27:51.309505+0000","last_active":"2024-08-17T02:27:51.315454+0000","last_peered":"2024-08-17T02:27:51.315454+0000","last_clean":"2024-08-17T02:27:51.315454+0000","last_became_active":"2024-08-17T02:27:51.309223+0000","last_became_peered":"2024-08-17T02:27:51.309223+0000","last_unstale":"2024-08-17T02:27:51.315454+0000","last_undegraded":"2024-08-17T02:27:51.315454+0000","last_fullsized":"2024-08-17T02:27:51.315454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:40.951641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309177+0000","last_change":"2024-08-17T02:27:51.302769+0000","last_active":"2024-08-17T02:27:51.309177+0000","last_peered":"2024-08-17T02:27:51.309177+0000","last_clean":"2024-08-17T02:27:51.309177+0000","last_became_active":"2024-08-17T02:27:51.300628+0000","last_became_peered":"2024-08-17T02:27:51.300628+0000","last_unstale":"2024-08-17T02:27:51.309177+0000","last_undegraded":"2024-08-17T02:27:51.309177+0000","last_fullsized":"2024-08-17T02:27:51.309177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:36:40.089843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.308015+0000","last_change":"2024-08-17T02:27:51.298088+0000","last_active":"2024-08-17T02:27:51.308015+0000","last_peered":"2024-08-17T02:27:51.308015+0000","last_clean":"2024-08-17T02:27:51.308015+0000","last_became_active":"2024-08-17T02:27:51.297755+0000","last_became_peered":"2024-08-17T02:27:51.297755+0000","last_unstale":"2024-08-17T02:27:51.308015+0000","last_undegraded":"2024-08-17T02:27:51.308015+0000","last_fullsized":"2024-08-17T02:27:51.308015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:52.916950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.291260+0000","last_change":"2024-08-17T02:27:51.287126+0000","last_active":"2024-08-17T02:27:51.291260+0000","last_peered":"2024-08-17T02:27:51.291260+0000","last_clean":"2024-08-17T02:27:51.291260+0000","last_became_active":"2024-08-17T02:27:51.286839+0000","last_became_peered":"2024-08-17T02:27:51.286839+0000","last_unstale":"2024-08-17T02:27:51.291260+0000","last_undegraded":"2024-08-17T02:27:51.291260+0000","last_fullsized":"2024-08-17T02:27:51.291260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:44.884519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.307938+0000","last_change":"2024-08-17T02:27:50.294440+0000","last_active":"2024-08-17T02:27:51.307938+0000","last_peered":"2024-08-17T02:27:51.307938+0000","last_clean":"2024-08-17T02:27:51.307938+0000","last_became_active":"2024-08-17T02:27:50.294141+0000","last_became_peered":"2024-08-17T02:27:50.294141+0000","last_unstale":"2024-08-17T02:27:51.307938+0000","last_undegraded":"2024-08-17T02:27:51.307938+0000","last_fullsized":"2024-08-17T02:27:51.307938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:30.074784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.302318+0000","last_change":"2024-08-17T02:27:51.295343+0000","last_active":"2024-08-17T02:27:51.302318+0000","last_peered":"2024-08-17T02:27:51.302318+0000","last_clean":"2024-08-17T02:27:51.302318+0000","last_became_active":"2024-08-17T02:27:51.293004+0000","last_became_peered":"2024-08-17T02:27:51.293004+0000","last_unstale":"2024-08-17T02:27:51.302318+0000","last_undegraded":"2024-08-17T02:27:51.302318+0000","last_fullsized":"2024-08-17T02:27:51.302318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:26.379433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.310422+0000","last_change":"2024-08-17T02:27:50.305041+0000","last_active":"2024-08-17T02:27:51.310422+0000","last_peered":"2024-08-17T02:27:51.310422+0000","last_clean":"2024-08-17T02:27:51.310422+0000","last_became_active":"2024-08-17T02:27:50.304359+0000","last_became_peered":"2024-08-17T02:27:50.304359+0000","last_unstale":"2024-08-17T02:27:51.310422+0000","last_undegraded":"2024-08-17T02:27:51.310422+0000","last_fullsized":"2024-08-17T02:27:51.310422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:23.849240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.286459+0000","last_change":"2024-08-17T02:27:50.304515+0000","last_active":"2024-08-17T02:27:51.286459+0000","last_peered":"2024-08-17T02:27:51.286459+0000","last_clean":"2024-08-17T02:27:51.286459+0000","last_became_active":"2024-08-17T02:27:50.304276+0000","last_became_peered":"2024-08-17T02:27:50.304276+0000","last_unstale":"2024-08-17T02:27:51.286459+0000","last_undegraded":"2024-08-17T02:27:51.286459+0000","last_fullsized":"2024-08-17T02:27:51.286459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:43.423994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.312129+0000","last_change":"2024-08-17T02:27:51.307787+0000","last_active":"2024-08-17T02:27:51.312129+0000","last_peered":"2024-08-17T02:27:51.312129+0000","last_clean":"2024-08-17T02:27:51.312129+0000","last_became_active":"2024-08-17T02:27:51.307539+0000","last_became_peered":"2024-08-17T02:27:51.307539+0000","last_unstale":"2024-08-17T02:27:51.312129+0000","last_undegraded":"2024-08-17T02:27:51.312129+0000","last_fullsized":"2024-08-17T02:27:51.312129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:52.916950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.295176+0000","last_change":"2024-08-17T02:27:50.285283+0000","last_active":"2024-08-17T02:27:51.295176+0000","last_peered":"2024-08-17T02:27:51.295176+0000","last_clean":"2024-08-17T02:27:51.295176+0000","last_became_active":"2024-08-17T02:27:50.284974+0000","last_became_peered":"2024-08-17T02:27:50.284974+0000","last_unstale":"2024-08-17T02:27:51.295176+0000","last_undegraded":"2024-08-17T02:27:51.295176+0000","last_fullsized":"2024-08-17T02:27:51.295176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:43.878005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309325+0000","last_change":"2024-08-17T02:27:51.306133+0000","last_active":"2024-08-17T02:27:51.309325+0000","last_peered":"2024-08-17T02:27:51.309325+0000","last_clean":"2024-08-17T02:27:51.309325+0000","last_became_active":"2024-08-17T02:27:51.305784+0000","last_became_peered":"2024-08-17T02:27:51.305784+0000","last_unstale":"2024-08-17T02:27:51.309325+0000","last_undegraded":"2024-08-17T02:27:51.309325+0000","last_fullsized":"2024-08-17T02:27:51.309325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:23.747098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.292192+0000","last_change":"2024-08-17T02:27:50.302699+0000","last_active":"2024-08-17T02:27:51.292192+0000","last_peered":"2024-08-17T02:27:51.292192+0000","last_clean":"2024-08-17T02:27:51.292192+0000","last_became_active":"2024-08-17T02:27:50.302324+0000","last_became_peered":"2024-08-17T02:27:50.302324+0000","last_unstale":"2024-08-17T02:27:51.292192+0000","last_undegraded":"2024-08-17T02:27:51.292192+0000","last_fullsized":"2024-08-17T02:27:51.292192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:43.878005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.319524+0000","last_change":"2024-08-17T02:27:51.317627+0000","last_active":"2024-08-17T02:27:51.319524+0000","last_peered":"2024-08-17T02:27:51.319524+0000","last_clean":"2024-08-17T02:27:51.319524+0000","last_became_active":"2024-08-17T02:27:51.317363+0000","last_became_peered":"2024-08-17T02:27:51.317363+0000","last_unstale":"2024-08-17T02:27:51.319524+0000","last_undegraded":"2024-08-17T02:27:51.319524+0000","last_fullsized":"2024-08-17T02:27:51.319524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:12:12.800070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.296163+0000","last_change":"2024-08-17T02:27:50.304899+0000","last_active":"2024-08-17T02:27:51.296163+0000","last_peered":"2024-08-17T02:27:51.296163+0000","last_clean":"2024-08-17T02:27:51.296163+0000","last_became_active":"2024-08-17T02:27:50.303335+0000","last_became_peered":"2024-08-17T02:27:50.303335+0000","last_unstale":"2024-08-17T02:27:51.296163+0000","last_undegraded":"2024-08-17T02:27:51.296163+0000","last_fullsized":"2024-08-17T02:27:51.296163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:23.849240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.312556+0000","last_change":"2024-08-17T02:27:51.311088+0000","last_active":"2024-08-17T02:27:51.312556+0000","last_peered":"2024-08-17T02:27:51.312556+0000","last_clean":"2024-08-17T02:27:51.312556+0000","last_became_active":"2024-08-17T02:27:51.310514+0000","last_became_peered":"2024-08-17T02:27:51.310514+0000","last_unstale":"2024-08-17T02:27:51.312556+0000","last_undegraded":"2024-08-17T02:27:51.312556+0000","last_fullsized":"2024-08-17T02:27:51.312556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:45:24.383393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.318886+0000","last_change":"2024-08-17T02:27:50.295951+0000","last_active":"2024-08-17T02:27:51.318886+0000","last_peered":"2024-08-17T02:27:51.318886+0000","last_clean":"2024-08-17T02:27:51.318886+0000","last_became_active":"2024-08-17T02:27:50.295351+0000","last_became_peered":"2024-08-17T02:27:50.295351+0000","last_unstale":"2024-08-17T02:27:51.318886+0000","last_undegraded":"2024-08-17T02:27:51.318886+0000","last_fullsized":"2024-08-17T02:27:51.318886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:57.534676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.308207+0000","last_change":"2024-08-17T02:27:51.303007+0000","last_active":"2024-08-17T02:27:51.308207+0000","last_peered":"2024-08-17T02:27:51.308207+0000","last_clean":"2024-08-17T02:27:51.308207+0000","last_became_active":"2024-08-17T02:27:51.300357+0000","last_became_peered":"2024-08-17T02:27:51.300357+0000","last_unstale":"2024-08-17T02:27:51.308207+0000","last_undegraded":"2024-08-17T02:27:51.308207+0000","last_fullsized":"2024-08-17T02:27:51.308207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:36:40.089843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.318657+0000","last_change":"2024-08-17T02:27:50.304133+0000","last_active":"2024-08-17T02:27:51.318657+0000","last_peered":"2024-08-17T02:27:51.318657+0000","last_clean":"2024-08-17T02:27:51.318657+0000","last_became_active":"2024-08-17T02:27:50.302755+0000","last_became_peered":"2024-08-17T02:27:50.302755+0000","last_unstale":"2024-08-17T02:27:51.318657+0000","last_undegraded":"2024-08-17T02:27:51.318657+0000","last_fullsized":"2024-08-17T02:27:51.318657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:02:06.007638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.313981+0000","last_change":"2024-08-17T02:27:51.310016+0000","last_active":"2024-08-17T02:27:51.313981+0000","last_peered":"2024-08-17T02:27:51.313981+0000","last_clean":"2024-08-17T02:27:51.313981+0000","last_became_active":"2024-08-17T02:27:51.309632+0000","last_became_peered":"2024-08-17T02:27:51.309632+0000","last_unstale":"2024-08-17T02:27:51.313981+0000","last_undegraded":"2024-08-17T02:27:51.313981+0000","last_fullsized":"2024-08-17T02:27:51.313981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:40.951641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.318739+0000","last_change":"2024-08-17T02:27:50.300858+0000","last_active":"2024-08-17T02:27:51.318739+0000","last_peered":"2024-08-17T02:27:51.318739+0000","last_clean":"2024-08-17T02:27:51.318739+0000","last_became_active":"2024-08-17T02:27:50.300575+0000","last_became_peered":"2024-08-17T02:27:50.300575+0000","last_unstale":"2024-08-17T02:27:51.318739+0000","last_undegraded":"2024-08-17T02:27:51.318739+0000","last_fullsized":"2024-08-17T02:27:51.318739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:30.074784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.301773+0000","last_change":"2024-08-17T02:27:51.295142+0000","last_active":"2024-08-17T02:27:51.301773+0000","last_peered":"2024-08-17T02:27:51.301773+0000","last_clean":"2024-08-17T02:27:51.301773+0000","last_became_active":"2024-08-17T02:27:51.294912+0000","last_became_peered":"2024-08-17T02:27:51.294912+0000","last_unstale":"2024-08-17T02:27:51.301773+0000","last_undegraded":"2024-08-17T02:27:51.301773+0000","last_fullsized":"2024-08-17T02:27:51.301773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:23.159482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.293032+0000","last_change":"2024-08-17T02:27:50.298640+0000","last_active":"2024-08-17T02:27:51.293032+0000","last_peered":"2024-08-17T02:27:51.293032+0000","last_clean":"2024-08-17T02:27:51.293032+0000","last_became_active":"2024-08-17T02:27:50.298355+0000","last_became_peered":"2024-08-17T02:27:50.298355+0000","last_unstale":"2024-08-17T02:27:51.293032+0000","last_undegraded":"2024-08-17T02:27:51.293032+0000","last_fullsized":"2024-08-17T02:27:51.293032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:43:01.783598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.320291+0000","last_change":"2024-08-17T02:27:51.318860+0000","last_active":"2024-08-17T02:27:51.320291+0000","last_peered":"2024-08-17T02:27:51.320291+0000","last_clean":"2024-08-17T02:27:51.320291+0000","last_became_active":"2024-08-17T02:27:51.317220+0000","last_became_peered":"2024-08-17T02:27:51.317220+0000","last_unstale":"2024-08-17T02:27:51.320291+0000","last_undegraded":"2024-08-17T02:27:51.320291+0000","last_fullsized":"2024-08-17T02:27:51.320291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:47:22.647519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.286902+0000","last_change":"2024-08-17T02:27:50.304030+0000","last_active":"2024-08-17T02:27:51.286902+0000","last_peered":"2024-08-17T02:27:51.286902+0000","last_clean":"2024-08-17T02:27:51.286902+0000","last_became_active":"2024-08-17T02:27:50.303575+0000","last_became_peered":"2024-08-17T02:27:50.303575+0000","last_unstale":"2024-08-17T02:27:51.286902+0000","last_undegraded":"2024-08-17T02:27:51.286902+0000","last_fullsized":"2024-08-17T02:27:51.286902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:01.529714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.307995+0000","last_change":"2024-08-17T02:27:51.297859+0000","last_active":"2024-08-17T02:27:51.307995+0000","last_peered":"2024-08-17T02:27:51.307995+0000","last_clean":"2024-08-17T02:27:51.307995+0000","last_became_active":"2024-08-17T02:27:51.297542+0000","last_became_peered":"2024-08-17T02:27:51.297542+0000","last_unstale":"2024-08-17T02:27:51.307995+0000","last_undegraded":"2024-08-17T02:27:51.307995+0000","last_fullsized":"2024-08-17T02:27:51.307995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:17:09.418523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.307003+0000","last_change":"2024-08-17T02:27:50.289491+0000","last_active":"2024-08-17T02:27:51.307003+0000","last_peered":"2024-08-17T02:27:51.307003+0000","last_clean":"2024-08-17T02:27:51.307003+0000","last_became_active":"2024-08-17T02:27:50.287407+0000","last_became_peered":"2024-08-17T02:27:50.287407+0000","last_unstale":"2024-08-17T02:27:51.307003+0000","last_undegraded":"2024-08-17T02:27:51.307003+0000","last_fullsized":"2024-08-17T02:27:51.307003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:02:06.007638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.314370+0000","last_change":"2024-08-17T02:27:51.311648+0000","last_active":"2024-08-17T02:27:51.314370+0000","last_peered":"2024-08-17T02:27:51.314370+0000","last_clean":"2024-08-17T02:27:51.314370+0000","last_became_active":"2024-08-17T02:27:51.311419+0000","last_became_peered":"2024-08-17T02:27:51.311419+0000","last_unstale":"2024-08-17T02:27:51.314370+0000","last_undegraded":"2024-08-17T02:27:51.314370+0000","last_fullsized":"2024-08-17T02:27:51.314370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:56:03.462179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.311272+0000","last_change":"2024-08-17T02:27:50.290855+0000","last_active":"2024-08-17T02:27:51.311272+0000","last_peered":"2024-08-17T02:27:51.311272+0000","last_clean":"2024-08-17T02:27:51.311272+0000","last_became_active":"2024-08-17T02:27:50.289943+0000","last_became_peered":"2024-08-17T02:27:50.289943+0000","last_unstale":"2024-08-17T02:27:51.311272+0000","last_undegraded":"2024-08-17T02:27:51.311272+0000","last_fullsized":"2024-08-17T02:27:51.311272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:52:17.225404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.314398+0000","last_change":"2024-08-17T02:27:51.311333+0000","last_active":"2024-08-17T02:27:51.314398+0000","last_peered":"2024-08-17T02:27:51.314398+0000","last_clean":"2024-08-17T02:27:51.314398+0000","last_became_active":"2024-08-17T02:27:51.311078+0000","last_became_peered":"2024-08-17T02:27:51.311078+0000","last_unstale":"2024-08-17T02:27:51.314398+0000","last_undegraded":"2024-08-17T02:27:51.314398+0000","last_fullsized":"2024-08-17T02:27:51.314398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:01.072889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309026+0000","last_change":"2024-08-17T02:27:50.301645+0000","last_active":"2024-08-17T02:27:51.309026+0000","last_peered":"2024-08-17T02:27:51.309026+0000","last_clean":"2024-08-17T02:27:51.309026+0000","last_became_active":"2024-08-17T02:27:50.301348+0000","last_became_peered":"2024-08-17T02:27:50.301348+0000","last_unstale":"2024-08-17T02:27:51.309026+0000","last_undegraded":"2024-08-17T02:27:51.309026+0000","last_fullsized":"2024-08-17T02:27:51.309026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:43.423994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.317741+0000","last_change":"2024-08-17T02:27:51.315762+0000","last_active":"2024-08-17T02:27:51.317741+0000","last_peered":"2024-08-17T02:27:51.317741+0000","last_clean":"2024-08-17T02:27:51.317741+0000","last_became_active":"2024-08-17T02:27:51.315472+0000","last_became_peered":"2024-08-17T02:27:51.315472+0000","last_unstale":"2024-08-17T02:27:51.317741+0000","last_undegraded":"2024-08-17T02:27:51.317741+0000","last_fullsized":"2024-08-17T02:27:51.317741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:59:59.342696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.308888+0000","last_change":"2024-08-17T02:27:50.296190+0000","last_active":"2024-08-17T02:27:51.308888+0000","last_peered":"2024-08-17T02:27:51.308888+0000","last_clean":"2024-08-17T02:27:51.308888+0000","last_became_active":"2024-08-17T02:27:50.295362+0000","last_became_peered":"2024-08-17T02:27:50.295362+0000","last_unstale":"2024-08-17T02:27:51.308888+0000","last_undegraded":"2024-08-17T02:27:51.308888+0000","last_fullsized":"2024-08-17T02:27:51.308888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:23.849240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315799+0000","last_change":"2024-08-17T02:27:51.310706+0000","last_active":"2024-08-17T02:27:51.315799+0000","last_peered":"2024-08-17T02:27:51.315799+0000","last_clean":"2024-08-17T02:27:51.315799+0000","last_became_active":"2024-08-17T02:27:51.310451+0000","last_became_peered":"2024-08-17T02:27:51.310451+0000","last_unstale":"2024-08-17T02:27:51.315799+0000","last_undegraded":"2024-08-17T02:27:51.315799+0000","last_fullsized":"2024-08-17T02:27:51.315799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:59:59.342696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.285945+0000","last_change":"2024-08-17T02:27:50.289792+0000","last_active":"2024-08-17T02:27:51.285945+0000","last_peered":"2024-08-17T02:27:51.285945+0000","last_clean":"2024-08-17T02:27:51.285945+0000","last_became_active":"2024-08-17T02:27:50.288900+0000","last_became_peered":"2024-08-17T02:27:50.288900+0000","last_unstale":"2024-08-17T02:27:51.285945+0000","last_undegraded":"2024-08-17T02:27:51.285945+0000","last_fullsized":"2024-08-17T02:27:51.285945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:01.529714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.305748+0000","last_change":"2024-08-17T02:27:51.303771+0000","last_active":"2024-08-17T02:27:51.305748+0000","last_peered":"2024-08-17T02:27:51.305748+0000","last_clean":"2024-08-17T02:27:51.305748+0000","last_became_active":"2024-08-17T02:27:51.303503+0000","last_became_peered":"2024-08-17T02:27:51.303503+0000","last_unstale":"2024-08-17T02:27:51.305748+0000","last_undegraded":"2024-08-17T02:27:51.305748+0000","last_fullsized":"2024-08-17T02:27:51.305748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:08.545557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.286581+0000","last_change":"2024-08-17T02:27:39.552321+0000","last_active":"2024-08-17T02:27:51.286581+0000","last_peered":"2024-08-17T02:27:51.286581+0000","last_clean":"2024-08-17T02:27:51.286581+0000","last_became_active":"2024-08-17T02:27:39.551203+0000","last_became_peered":"2024-08-17T02:27:39.551203+0000","last_unstale":"2024-08-17T02:27:51.286581+0000","last_undegraded":"2024-08-17T02:27:51.286581+0000","last_fullsized":"2024-08-17T02:27:51.286581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.155679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.155679+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.155679+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:02.785032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.292505+0000","last_change":"2024-08-17T02:27:50.289453+0000","last_active":"2024-08-17T02:27:51.292505+0000","last_peered":"2024-08-17T02:27:51.292505+0000","last_clean":"2024-08-17T02:27:51.292505+0000","last_became_active":"2024-08-17T02:27:50.289066+0000","last_became_peered":"2024-08-17T02:27:50.289066+0000","last_unstale":"2024-08-17T02:27:51.292505+0000","last_undegraded":"2024-08-17T02:27:51.292505+0000","last_fullsized":"2024-08-17T02:27:51.292505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:01.529714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.307760+0000","last_change":"2024-08-17T02:27:51.302543+0000","last_active":"2024-08-17T02:27:51.307760+0000","last_peered":"2024-08-17T02:27:51.307760+0000","last_clean":"2024-08-17T02:27:51.307760+0000","last_became_active":"2024-08-17T02:27:51.302282+0000","last_became_peered":"2024-08-17T02:27:51.302282+0000","last_unstale":"2024-08-17T02:27:51.307760+0000","last_undegraded":"2024-08-17T02:27:51.307760+0000","last_fullsized":"2024-08-17T02:27:51.307760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:07.004040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.286496+0000","last_change":"2024-08-17T02:27:50.305660+0000","last_active":"2024-08-17T02:27:51.286496+0000","last_peered":"2024-08-17T02:27:51.286496+0000","last_clean":"2024-08-17T02:27:51.286496+0000","last_became_active":"2024-08-17T02:27:50.305076+0000","last_became_peered":"2024-08-17T02:27:50.305076+0000","last_unstale":"2024-08-17T02:27:51.286496+0000","last_undegraded":"2024-08-17T02:27:51.286496+0000","last_fullsized":"2024-08-17T02:27:51.286496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:36:39.083329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.299771+0000","last_change":"2024-08-17T02:27:51.291775+0000","last_active":"2024-08-17T02:27:51.299771+0000","last_peered":"2024-08-17T02:27:51.299771+0000","last_clean":"2024-08-17T02:27:51.299771+0000","last_became_active":"2024-08-17T02:27:51.291502+0000","last_became_peered":"2024-08-17T02:27:51.291502+0000","last_unstale":"2024-08-17T02:27:51.299771+0000","last_undegraded":"2024-08-17T02:27:51.299771+0000","last_fullsized":"2024-08-17T02:27:51.299771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:52.916950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.285821+0000","last_change":"2024-08-17T02:27:50.294544+0000","last_active":"2024-08-17T02:27:51.285821+0000","last_peered":"2024-08-17T02:27:51.285821+0000","last_clean":"2024-08-17T02:27:51.285821+0000","last_became_active":"2024-08-17T02:27:50.293620+0000","last_became_peered":"2024-08-17T02:27:50.293620+0000","last_unstale":"2024-08-17T02:27:51.285821+0000","last_undegraded":"2024-08-17T02:27:51.285821+0000","last_fullsized":"2024-08-17T02:27:51.285821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:43:01.783598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.296255+0000","last_change":"2024-08-17T02:27:51.292285+0000","last_active":"2024-08-17T02:27:51.296255+0000","last_peered":"2024-08-17T02:27:51.296255+0000","last_clean":"2024-08-17T02:27:51.296255+0000","last_became_active":"2024-08-17T02:27:51.292028+0000","last_became_peered":"2024-08-17T02:27:51.292028+0000","last_unstale":"2024-08-17T02:27:51.296255+0000","last_undegraded":"2024-08-17T02:27:51.296255+0000","last_fullsized":"2024-08-17T02:27:51.296255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:00.021420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.295539+0000","last_change":"2024-08-17T02:27:50.300081+0000","last_active":"2024-08-17T02:27:51.295539+0000","last_peered":"2024-08-17T02:27:51.295539+0000","last_clean":"2024-08-17T02:27:51.295539+0000","last_became_active":"2024-08-17T02:27:50.299745+0000","last_became_peered":"2024-08-17T02:27:50.299745+0000","last_unstale":"2024-08-17T02:27:51.295539+0000","last_undegraded":"2024-08-17T02:27:51.295539+0000","last_fullsized":"2024-08-17T02:27:51.295539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:57.534676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.306324+0000","last_change":"2024-08-17T02:27:51.291025+0000","last_active":"2024-08-17T02:27:51.306324+0000","last_peered":"2024-08-17T02:27:51.306324+0000","last_clean":"2024-08-17T02:27:51.306324+0000","last_became_active":"2024-08-17T02:27:51.290690+0000","last_became_peered":"2024-08-17T02:27:51.290690+0000","last_unstale":"2024-08-17T02:27:51.306324+0000","last_undegraded":"2024-08-17T02:27:51.306324+0000","last_fullsized":"2024-08-17T02:27:51.306324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:58.541189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.284142+0000","last_change":"2024-08-17T02:27:50.299597+0000","last_active":"2024-08-17T02:27:51.284142+0000","last_peered":"2024-08-17T02:27:51.284142+0000","last_clean":"2024-08-17T02:27:51.284142+0000","last_became_active":"2024-08-17T02:27:50.298486+0000","last_became_peered":"2024-08-17T02:27:50.298486+0000","last_unstale":"2024-08-17T02:27:51.284142+0000","last_undegraded":"2024-08-17T02:27:51.284142+0000","last_fullsized":"2024-08-17T02:27:51.284142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:43:01.783598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315535+0000","last_change":"2024-08-17T02:27:51.311899+0000","last_active":"2024-08-17T02:27:51.315535+0000","last_peered":"2024-08-17T02:27:51.315535+0000","last_clean":"2024-08-17T02:27:51.315535+0000","last_became_active":"2024-08-17T02:27:51.311615+0000","last_became_peered":"2024-08-17T02:27:51.311615+0000","last_unstale":"2024-08-17T02:27:51.315535+0000","last_undegraded":"2024-08-17T02:27:51.315535+0000","last_fullsized":"2024-08-17T02:27:51.315535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:56:03.462179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.297244+0000","last_change":"2024-08-17T02:27:50.302154+0000","last_active":"2024-08-17T02:27:51.297244+0000","last_peered":"2024-08-17T02:27:51.297244+0000","last_clean":"2024-08-17T02:27:51.297244+0000","last_became_active":"2024-08-17T02:27:50.301832+0000","last_became_peered":"2024-08-17T02:27:50.301832+0000","last_unstale":"2024-08-17T02:27:51.297244+0000","last_undegraded":"2024-08-17T02:27:51.297244+0000","last_fullsized":"2024-08-17T02:27:51.297244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:57.534676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.296467+0000","last_change":"2024-08-17T02:27:51.292360+0000","last_active":"2024-08-17T02:27:51.296467+0000","last_peered":"2024-08-17T02:27:51.296467+0000","last_clean":"2024-08-17T02:27:51.296467+0000","last_became_active":"2024-08-17T02:27:51.292122+0000","last_became_peered":"2024-08-17T02:27:51.292122+0000","last_unstale":"2024-08-17T02:27:51.296467+0000","last_undegraded":"2024-08-17T02:27:51.296467+0000","last_fullsized":"2024-08-17T02:27:51.296467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:52.916950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:52.292254+0000","last_change":"2024-08-17T02:27:50.302427+0000","last_active":"2024-08-17T02:27:52.292254+0000","last_peered":"2024-08-17T02:27:52.292254+0000","last_clean":"2024-08-17T02:27:52.292254+0000","last_became_active":"2024-08-17T02:27:50.301894+0000","last_became_peered":"2024-08-17T02:27:50.301894+0000","last_unstale":"2024-08-17T02:27:52.292254+0000","last_undegraded":"2024-08-17T02:27:52.292254+0000","last_fullsized":"2024-08-17T02:27:52.292254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:52:34.125784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.304786+0000","last_change":"2024-08-17T02:27:51.300754+0000","last_active":"2024-08-17T02:27:51.304786+0000","last_peered":"2024-08-17T02:27:51.304786+0000","last_clean":"2024-08-17T02:27:51.304786+0000","last_became_active":"2024-08-17T02:27:51.300516+0000","last_became_peered":"2024-08-17T02:27:51.300516+0000","last_unstale":"2024-08-17T02:27:51.304786+0000","last_undegraded":"2024-08-17T02:27:51.304786+0000","last_fullsized":"2024-08-17T02:27:51.304786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:23.159482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.313066+0000","last_change":"2024-08-17T02:27:50.300734+0000","last_active":"2024-08-17T02:27:51.313066+0000","last_peered":"2024-08-17T02:27:51.313066+0000","last_clean":"2024-08-17T02:27:51.313066+0000","last_became_active":"2024-08-17T02:27:50.300458+0000","last_became_peered":"2024-08-17T02:27:50.300458+0000","last_unstale":"2024-08-17T02:27:51.313066+0000","last_undegraded":"2024-08-17T02:27:51.313066+0000","last_fullsized":"2024-08-17T02:27:51.313066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:43:01.783598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.298374+0000","last_change":"2024-08-17T02:27:51.290195+0000","last_active":"2024-08-17T02:27:51.298374+0000","last_peered":"2024-08-17T02:27:51.298374+0000","last_clean":"2024-08-17T02:27:51.298374+0000","last_became_active":"2024-08-17T02:27:51.287748+0000","last_became_peered":"2024-08-17T02:27:51.287748+0000","last_unstale":"2024-08-17T02:27:51.298374+0000","last_undegraded":"2024-08-17T02:27:51.298374+0000","last_fullsized":"2024-08-17T02:27:51.298374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:44.789170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.286398+0000","last_change":"2024-08-17T02:27:50.302235+0000","last_active":"2024-08-17T02:27:51.286398+0000","last_peered":"2024-08-17T02:27:51.286398+0000","last_clean":"2024-08-17T02:27:51.286398+0000","last_became_active":"2024-08-17T02:27:50.301967+0000","last_became_peered":"2024-08-17T02:27:50.301967+0000","last_unstale":"2024-08-17T02:27:51.286398+0000","last_undegraded":"2024-08-17T02:27:51.286398+0000","last_fullsized":"2024-08-17T02:27:51.286398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:43.878005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.304815+0000","last_change":"2024-08-17T02:27:51.293997+0000","last_active":"2024-08-17T02:27:51.304815+0000","last_peered":"2024-08-17T02:27:51.304815+0000","last_clean":"2024-08-17T02:27:51.304815+0000","last_became_active":"2024-08-17T02:27:51.293661+0000","last_became_peered":"2024-08-17T02:27:51.293661+0000","last_unstale":"2024-08-17T02:27:51.304815+0000","last_undegraded":"2024-08-17T02:27:51.304815+0000","last_fullsized":"2024-08-17T02:27:51.304815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:24.855754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.285393+0000","last_change":"2024-08-17T02:27:50.297434+0000","last_active":"2024-08-17T02:27:51.285393+0000","last_peered":"2024-08-17T02:27:51.285393+0000","last_clean":"2024-08-17T02:27:51.285393+0000","last_became_active":"2024-08-17T02:27:50.297160+0000","last_became_peered":"2024-08-17T02:27:50.297160+0000","last_unstale":"2024-08-17T02:27:51.285393+0000","last_undegraded":"2024-08-17T02:27:51.285393+0000","last_fullsized":"2024-08-17T02:27:51.285393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:43.878005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.304392+0000","last_change":"2024-08-17T02:27:51.294170+0000","last_active":"2024-08-17T02:27:51.304392+0000","last_peered":"2024-08-17T02:27:51.304392+0000","last_clean":"2024-08-17T02:27:51.304392+0000","last_became_active":"2024-08-17T02:27:51.293090+0000","last_became_peered":"2024-08-17T02:27:51.293090+0000","last_unstale":"2024-08-17T02:27:51.304392+0000","last_undegraded":"2024-08-17T02:27:51.304392+0000","last_fullsized":"2024-08-17T02:27:51.304392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:26.379433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.283605+0000","last_change":"2024-08-17T02:27:50.298748+0000","last_active":"2024-08-17T02:27:51.283605+0000","last_peered":"2024-08-17T02:27:51.283605+0000","last_clean":"2024-08-17T02:27:51.283605+0000","last_became_active":"2024-08-17T02:27:50.298203+0000","last_became_peered":"2024-08-17T02:27:50.298203+0000","last_unstale":"2024-08-17T02:27:51.283605+0000","last_undegraded":"2024-08-17T02:27:51.283605+0000","last_fullsized":"2024-08-17T02:27:51.283605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:36:39.083329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.312250+0000","last_change":"2024-08-17T02:27:51.308188+0000","last_active":"2024-08-17T02:27:51.312250+0000","last_peered":"2024-08-17T02:27:51.312250+0000","last_clean":"2024-08-17T02:27:51.312250+0000","last_became_active":"2024-08-17T02:27:51.307669+0000","last_became_peered":"2024-08-17T02:27:51.307669+0000","last_unstale":"2024-08-17T02:27:51.312250+0000","last_undegraded":"2024-08-17T02:27:51.312250+0000","last_fullsized":"2024-08-17T02:27:51.312250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:44.789170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.317269+0000","last_change":"2024-08-17T02:27:50.305833+0000","last_active":"2024-08-17T02:27:51.317269+0000","last_peered":"2024-08-17T02:27:51.317269+0000","last_clean":"2024-08-17T02:27:51.317269+0000","last_became_active":"2024-08-17T02:27:50.304646+0000","last_became_peered":"2024-08-17T02:27:50.304646+0000","last_unstale":"2024-08-17T02:27:51.317269+0000","last_undegraded":"2024-08-17T02:27:51.317269+0000","last_fullsized":"2024-08-17T02:27:51.317269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:39:03.039409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.316273+0000","last_change":"2024-08-17T02:27:51.310592+0000","last_active":"2024-08-17T02:27:51.316273+0000","last_peered":"2024-08-17T02:27:51.316273+0000","last_clean":"2024-08-17T02:27:51.316273+0000","last_became_active":"2024-08-17T02:27:51.310246+0000","last_became_peered":"2024-08-17T02:27:51.310246+0000","last_unstale":"2024-08-17T02:27:51.316273+0000","last_undegraded":"2024-08-17T02:27:51.316273+0000","last_fullsized":"2024-08-17T02:27:51.316273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:23.747098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.316539+0000","last_change":"2024-08-17T02:27:51.315083+0000","last_active":"2024-08-17T02:27:51.316539+0000","last_peered":"2024-08-17T02:27:51.316539+0000","last_clean":"2024-08-17T02:27:51.316539+0000","last_became_active":"2024-08-17T02:27:51.314854+0000","last_became_peered":"2024-08-17T02:27:51.314854+0000","last_unstale":"2024-08-17T02:27:51.316539+0000","last_undegraded":"2024-08-17T02:27:51.316539+0000","last_fullsized":"2024-08-17T02:27:51.316539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:51:59.475864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.306255+0000","last_change":"2024-08-17T02:27:50.303023+0000","last_active":"2024-08-17T02:27:51.306255+0000","last_peered":"2024-08-17T02:27:51.306255+0000","last_clean":"2024-08-17T02:27:51.306255+0000","last_became_active":"2024-08-17T02:27:50.302104+0000","last_became_peered":"2024-08-17T02:27:50.302104+0000","last_unstale":"2024-08-17T02:27:51.306255+0000","last_undegraded":"2024-08-17T02:27:51.306255+0000","last_fullsized":"2024-08-17T02:27:51.306255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:23.849240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.316569+0000","last_change":"2024-08-17T02:27:51.315498+0000","last_active":"2024-08-17T02:27:51.316569+0000","last_peered":"2024-08-17T02:27:51.316569+0000","last_clean":"2024-08-17T02:27:51.316569+0000","last_became_active":"2024-08-17T02:27:51.315126+0000","last_became_peered":"2024-08-17T02:27:51.315126+0000","last_unstale":"2024-08-17T02:27:51.316569+0000","last_undegraded":"2024-08-17T02:27:51.316569+0000","last_fullsized":"2024-08-17T02:27:51.316569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:07.004040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.313049+0000","last_change":"2024-08-17T02:27:50.308330+0000","last_active":"2024-08-17T02:27:51.313049+0000","last_peered":"2024-08-17T02:27:51.313049+0000","last_clean":"2024-08-17T02:27:51.313049+0000","last_became_active":"2024-08-17T02:27:50.307213+0000","last_became_peered":"2024-08-17T02:27:50.307213+0000","last_unstale":"2024-08-17T02:27:51.313049+0000","last_undegraded":"2024-08-17T02:27:51.313049+0000","last_fullsized":"2024-08-17T02:27:51.313049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:52:34.125784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.312570+0000","last_change":"2024-08-17T02:27:51.311099+0000","last_active":"2024-08-17T02:27:51.312570+0000","last_peered":"2024-08-17T02:27:51.312570+0000","last_clean":"2024-08-17T02:27:51.312570+0000","last_became_active":"2024-08-17T02:27:51.310841+0000","last_became_peered":"2024-08-17T02:27:51.310841+0000","last_unstale":"2024-08-17T02:27:51.312570+0000","last_undegraded":"2024-08-17T02:27:51.312570+0000","last_fullsized":"2024-08-17T02:27:51.312570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:17:09.418523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.307309+0000","last_change":"2024-08-17T02:27:50.299166+0000","last_active":"2024-08-17T02:27:51.307309+0000","last_peered":"2024-08-17T02:27:51.307309+0000","last_clean":"2024-08-17T02:27:51.307309+0000","last_became_active":"2024-08-17T02:27:50.297610+0000","last_became_peered":"2024-08-17T02:27:50.297610+0000","last_unstale":"2024-08-17T02:27:51.307309+0000","last_undegraded":"2024-08-17T02:27:51.307309+0000","last_fullsized":"2024-08-17T02:27:51.307309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:29.138877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.304474+0000","last_change":"2024-08-17T02:27:51.295869+0000","last_active":"2024-08-17T02:27:51.304474+0000","last_peered":"2024-08-17T02:27:51.304474+0000","last_clean":"2024-08-17T02:27:51.304474+0000","last_became_active":"2024-08-17T02:27:51.295671+0000","last_became_peered":"2024-08-17T02:27:51.295671+0000","last_unstale":"2024-08-17T02:27:51.304474+0000","last_undegraded":"2024-08-17T02:27:51.304474+0000","last_fullsized":"2024-08-17T02:27:51.304474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:04:36.940627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.321899+0000","last_change":"2024-08-17T02:27:50.298314+0000","last_active":"2024-08-17T02:27:51.321899+0000","last_peered":"2024-08-17T02:27:51.321899+0000","last_clean":"2024-08-17T02:27:51.321899+0000","last_became_active":"2024-08-17T02:27:50.298019+0000","last_became_peered":"2024-08-17T02:27:50.298019+0000","last_unstale":"2024-08-17T02:27:51.321899+0000","last_undegraded":"2024-08-17T02:27:51.321899+0000","last_fullsized":"2024-08-17T02:27:51.321899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:29.138877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298148,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073692,"statfs":{"total":96636764160,"available":96331460608,"internally_reserved":0,"allocated":802816,"data_stored":661592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297564,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074276,"statfs":{"total":96636764160,"available":96332058624,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297564,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074276,"statfs":{"total":96636764160,"available":96332058624,"internally_reserved":0,"allocated":204800,"data_stored":70654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298148,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073692,"statfs":{"total":96636764160,"available":96331460608,"internally_reserved":0,"allocated":811008,"data_stored":661648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:28:00.334 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:28:00.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.518+0000 7f3f7ae00640 1 Processor -- start 2024-08-17T02:28:00.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.519+0000 7f3f7ae00640 1 -- start start 2024-08-17T02:28:00.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.520+0000 7f3f7ae00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f740ce8a0 0x7f3f740ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.520+0000 7f3f7ae00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3f740c5c40 0x7f3f740cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.520+0000 7f3f7ae00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f740cc890 con 0x7f3f740aed50 2024-08-17T02:28:00.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.520+0000 7f3f7ae00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f740cb230 con 0x7f3f740c5c40 2024-08-17T02:28:00.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.520+0000 7f3f7ae00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f740cb4c0 con 0x7f3f740ce8a0 2024-08-17T02:28:00.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.520+0000 7f3f79000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f740ce8a0 0x7f3f740ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.520+0000 7f3f7a400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3f740c5c40 0x7f3f740cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.520+0000 7f3f79000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f740ce8a0 0x7f3f740ca7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:38876/0 (socket says 172.21.15.106:38876) 2024-08-17T02:28:00.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.520+0000 7f3f79000640 1 -- 172.21.15.106:0/3372885757 learned_addr learned my addr 172.21.15.106:0/3372885757 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:00.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.520+0000 7f3f7a400640 1 --2- 172.21.15.106:0/3372885757 >> v2:172.21.15.171:3300/0 conn(0x7f3f740c5c40 0x7f3f740cacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:52186/0 (socket says 172.21.15.106:52186) 2024-08-17T02:28:00.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.520+0000 7f3f79a00640 1 --1- 172.21.15.106:0/3372885757 >> v1:172.21.15.171:6789/0 conn(0x7f3f740aed50 0x7f3f740ce190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:47642/0 (socket says 172.21.15.106:47642) 2024-08-17T02:28:00.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.521+0000 7f3f79000640 1 -- 172.21.15.106:0/3372885757 >> v2:172.21.15.171:3300/0 conn(0x7f3f740c5c40 msgr2=0x7f3f740cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:00.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.521+0000 7f3f79000640 1 --2- 172.21.15.106:0/3372885757 >> v2:172.21.15.171:3300/0 conn(0x7f3f740c5c40 0x7f3f740cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.521+0000 7f3f79000640 1 -- 172.21.15.106:0/3372885757 >> v1:172.21.15.171:6789/0 conn(0x7f3f740aed50 legacy=0x7f3f740ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.521+0000 7f3f79000640 1 -- 172.21.15.106:0/3372885757 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f740cb7a0 con 0x7f3f740ce8a0 2024-08-17T02:28:00.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.521+0000 7f3f7a400640 1 --2- 172.21.15.106:0/3372885757 >> v2:172.21.15.171:3300/0 conn(0x7f3f740c5c40 0x7f3f740cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:00.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.522+0000 7f3f79000640 1 --2- 172.21.15.106:0/3372885757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f740ce8a0 0x7f3f740ca7b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3f60009910 tx=0x7f3f600091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79e2810ea385c09b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.522+0000 7f3f73e00640 1 -- 172.21.15.106:0/3372885757 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6002ae40 con 0x7f3f740ce8a0 2024-08-17T02:28:00.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.522+0000 7f3f73e00640 1 -- 172.21.15.106:0/3372885757 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f60032440 con 0x7f3f740ce8a0 2024-08-17T02:28:00.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.522+0000 7f3f73e00640 1 -- 172.21.15.106:0/3372885757 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f60032820 con 0x7f3f740ce8a0 2024-08-17T02:28:00.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.523+0000 7f3f7ae00640 1 -- 172.21.15.106:0/3372885757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f740ce8a0 msgr2=0x7f3f740ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.523+0000 7f3f7ae00640 1 --2- 172.21.15.106:0/3372885757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f740ce8a0 0x7f3f740ca7b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3f60009910 tx=0x7f3f600091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.523+0000 7f3f7ae00640 1 -- 172.21.15.106:0/3372885757 shutdown_connections 2024-08-17T02:28:00.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.523+0000 7f3f7ae00640 1 --2- 172.21.15.106:0/3372885757 >> v2:172.21.15.171:3300/0 conn(0x7f3f740c5c40 0x7f3f740cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.523+0000 7f3f7ae00640 1 --2- 172.21.15.106:0/3372885757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f740ce8a0 0x7f3f740ca7b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.523+0000 7f3f7ae00640 1 -- 172.21.15.106:0/3372885757 >> 172.21.15.106:0/3372885757 conn(0x7f3f74098e30 msgr2=0x7f3f7406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:00.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.523+0000 7f3f7ae00640 1 -- 172.21.15.106:0/3372885757 shutdown_connections 2024-08-17T02:28:00.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.523+0000 7f3f7ae00640 1 -- 172.21.15.106:0/3372885757 wait complete. 2024-08-17T02:28:00.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.524+0000 7f3f7ae00640 1 Processor -- start 2024-08-17T02:28:00.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.524+0000 7f3f7ae00640 1 -- start start 2024-08-17T02:28:00.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.525+0000 7f3f7ae00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f740aed50 0x7f3f740b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.525+0000 7f3f7ae00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3f740c5c40 0x7f3f740af120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.525+0000 7f3f7ae00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f740ce8a0 0x7f3f740af660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.525+0000 7f3f7ae00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f740b30d0 con 0x7f3f740aed50 2024-08-17T02:28:00.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.525+0000 7f3f7ae00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f740b5840 con 0x7f3f740c5c40 2024-08-17T02:28:00.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.525+0000 7f3f7ae00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f740b5560 con 0x7f3f740ce8a0 2024-08-17T02:28:00.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.525+0000 7f3f79a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f740aed50 0x7f3f740b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.525+0000 7f3f79a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f740aed50 0x7f3f740b01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53468/0 (socket says 172.21.15.106:53468) 2024-08-17T02:28:00.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.525+0000 7f3f79a00640 1 -- 172.21.15.106:0/1264804150 learned_addr learned my addr 172.21.15.106:0/1264804150 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:00.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.525+0000 7f3f7a400640 1 --2- 172.21.15.106:0/1264804150 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f740ce8a0 0x7f3f740af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.525+0000 7f3f79000640 1 --2- 172.21.15.106:0/1264804150 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3f740c5c40 0x7f3f740af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.526+0000 7f3f79a00640 1 -- 172.21.15.106:0/1264804150 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f740ce8a0 msgr2=0x7f3f740af660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.526+0000 7f3f79a00640 1 --2- 172.21.15.106:0/1264804150 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f740ce8a0 0x7f3f740af660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.526+0000 7f3f79a00640 1 -- 172.21.15.106:0/1264804150 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3f740c5c40 msgr2=0x7f3f740af120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.526+0000 7f3f79a00640 1 --2- 172.21.15.106:0/1264804150 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3f740c5c40 0x7f3f740af120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.526+0000 7f3f79a00640 1 -- 172.21.15.106:0/1264804150 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6c009a20 con 0x7f3f740aed50 2024-08-17T02:28:00.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.526+0000 7f3f79a00640 1 --2- 172.21.15.106:0/1264804150 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f740aed50 0x7f3f740b01a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800c510 tx=0x7f3f68007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.526+0000 7f3f70c00640 1 -- 172.21.15.106:0/1264804150 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f680072e0 con 0x7f3f740aed50 2024-08-17T02:28:00.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.526+0000 7f3f70c00640 1 -- 172.21.15.106:0/1264804150 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f68007440 con 0x7f3f740aed50 2024-08-17T02:28:00.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.526+0000 7f3f7ae00640 1 -- 172.21.15.106:0/1264804150 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f60009450 con 0x7f3f740aed50 2024-08-17T02:28:00.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.526+0000 7f3f70c00640 1 -- 172.21.15.106:0/1264804150 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f680047a0 con 0x7f3f740aed50 2024-08-17T02:28:00.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.526+0000 7f3f7ae00640 1 -- 172.21.15.106:0/1264804150 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f740b2de0 con 0x7f3f740aed50 2024-08-17T02:28:00.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.527+0000 7f3f7ae00640 1 -- 172.21.15.106:0/1264804150 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f74071050 con 0x7f3f740aed50 2024-08-17T02:28:00.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.528+0000 7f3f70c00640 1 -- 172.21.15.106:0/1264804150 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3f68004bd0 con 0x7f3f740aed50 2024-08-17T02:28:00.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.529+0000 7f3f70c00640 1 --2- 172.21.15.106:0/1264804150 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f3f54065150 0x7f3f54067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.529+0000 7f3f70c00640 1 -- 172.21.15.106:0/1264804150 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3f68081c40 con 0x7f3f740aed50 2024-08-17T02:28:00.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.529+0000 7f3f79000640 1 --2- 172.21.15.106:0/1264804150 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f3f54065150 0x7f3f54067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.530+0000 7f3f79000640 1 --2- 172.21.15.106:0/1264804150 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f3f54065150 0x7f3f54067600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3f60034000 tx=0x7f3f60032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.533+0000 7f3f70c00640 1 -- 172.21.15.106:0/1264804150 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3f6804fc60 con 0x7f3f740aed50 2024-08-17T02:28:00.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.701+0000 7f3f7ae00640 1 -- 172.21.15.106:0/1264804150 --> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3f740cd940 con 0x7f3f54065150 2024-08-17T02:28:00.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.707+0000 7f3f70c00640 1 -- 172.21.15.106:0/1264804150 <== mgr.4107 v2:172.21.15.106:6832/36860 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264567 (secure 0 0 0) 0x7f3f740cd940 con 0x7f3f54065150 2024-08-17T02:28:00.711 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:00.712 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-08-17T02:28:00.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.712+0000 7f3f7ae00640 1 -- 172.21.15.106:0/1264804150 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f3f54065150 msgr2=0x7f3f54067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.712+0000 7f3f7ae00640 1 --2- 172.21.15.106:0/1264804150 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f3f54065150 0x7f3f54067600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3f60034000 tx=0x7f3f60032000 comp rx=0 tx=0).stop 2024-08-17T02:28:00.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.712+0000 7f3f7ae00640 1 -- 172.21.15.106:0/1264804150 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f740aed50 msgr2=0x7f3f740b01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.712+0000 7f3f7ae00640 1 --2- 172.21.15.106:0/1264804150 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f740aed50 0x7f3f740b01a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800c510 tx=0x7f3f68007ee0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.712+0000 7f3f7ae00640 1 -- 172.21.15.106:0/1264804150 shutdown_connections 2024-08-17T02:28:00.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.712+0000 7f3f7ae00640 1 --2- 172.21.15.106:0/1264804150 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3f740ce8a0 0x7f3f740af660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.712+0000 7f3f7ae00640 1 --2- 172.21.15.106:0/1264804150 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3f740c5c40 0x7f3f740af120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.712+0000 7f3f7ae00640 1 --2- 172.21.15.106:0/1264804150 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f3f54065150 0x7f3f54067600 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.712+0000 7f3f7ae00640 1 --2- 172.21.15.106:0/1264804150 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f740aed50 0x7f3f740b01a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.712+0000 7f3f7ae00640 1 -- 172.21.15.106:0/1264804150 >> 172.21.15.106:0/1264804150 conn(0x7f3f74098e30 msgr2=0x7f3f740c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:00.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.712+0000 7f3f7ae00640 1 -- 172.21.15.106:0/1264804150 shutdown_connections 2024-08-17T02:28:00.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.712+0000 7f3f7ae00640 1 -- 172.21.15.106:0/1264804150 wait complete. 2024-08-17T02:28:00.727 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-08-17T02:27:59.877435+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381708,"kb_used_data":2824,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752593012,"statfs":{"total":773094113280,"available":770655244288,"internally_reserved":0,"allocated":2891776,"data_stored":1750644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.600865"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309577+0000","last_change":"2024-08-17T02:27:51.307275+0000","last_active":"2024-08-17T02:27:51.309577+0000","last_peered":"2024-08-17T02:27:51.309577+0000","last_clean":"2024-08-17T02:27:51.309577+0000","last_became_active":"2024-08-17T02:27:51.306981+0000","last_became_peered":"2024-08-17T02:27:51.306981+0000","last_unstale":"2024-08-17T02:27:51.309577+0000","last_undegraded":"2024-08-17T02:27:51.309577+0000","last_fullsized":"2024-08-17T02:27:51.309577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:34:53.506566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.293426+0000","last_change":"2024-08-17T02:27:51.289931+0000","last_active":"2024-08-17T02:27:51.293426+0000","last_peered":"2024-08-17T02:27:51.293426+0000","last_clean":"2024-08-17T02:27:51.293426+0000","last_became_active":"2024-08-17T02:27:51.289692+0000","last_became_peered":"2024-08-17T02:27:51.289692+0000","last_unstale":"2024-08-17T02:27:51.293426+0000","last_undegraded":"2024-08-17T02:27:51.293426+0000","last_fullsized":"2024-08-17T02:27:51.293426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:04:36.940627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.300228+0000","last_change":"2024-08-17T02:27:51.293123+0000","last_active":"2024-08-17T02:27:51.300228+0000","last_peered":"2024-08-17T02:27:51.300228+0000","last_clean":"2024-08-17T02:27:51.300228+0000","last_became_active":"2024-08-17T02:27:51.290362+0000","last_became_peered":"2024-08-17T02:27:51.290362+0000","last_unstale":"2024-08-17T02:27:51.300228+0000","last_undegraded":"2024-08-17T02:27:51.300228+0000","last_fullsized":"2024-08-17T02:27:51.300228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:31.950047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315815+0000","last_change":"2024-08-17T02:27:51.310784+0000","last_active":"2024-08-17T02:27:51.315815+0000","last_peered":"2024-08-17T02:27:51.315815+0000","last_clean":"2024-08-17T02:27:51.315815+0000","last_became_active":"2024-08-17T02:27:51.310504+0000","last_became_peered":"2024-08-17T02:27:51.310504+0000","last_unstale":"2024-08-17T02:27:51.315815+0000","last_undegraded":"2024-08-17T02:27:51.315815+0000","last_fullsized":"2024-08-17T02:27:51.315815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:34:53.506566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.304867+0000","last_change":"2024-08-17T02:27:51.300548+0000","last_active":"2024-08-17T02:27:51.304867+0000","last_peered":"2024-08-17T02:27:51.304867+0000","last_clean":"2024-08-17T02:27:51.304867+0000","last_became_active":"2024-08-17T02:27:51.298611+0000","last_became_peered":"2024-08-17T02:27:51.298611+0000","last_unstale":"2024-08-17T02:27:51.304867+0000","last_undegraded":"2024-08-17T02:27:51.304867+0000","last_fullsized":"2024-08-17T02:27:51.304867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:12:12.800070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315424+0000","last_change":"2024-08-17T02:27:51.309274+0000","last_active":"2024-08-17T02:27:51.315424+0000","last_peered":"2024-08-17T02:27:51.315424+0000","last_clean":"2024-08-17T02:27:51.315424+0000","last_became_active":"2024-08-17T02:27:51.309017+0000","last_became_peered":"2024-08-17T02:27:51.309017+0000","last_unstale":"2024-08-17T02:27:51.315424+0000","last_undegraded":"2024-08-17T02:27:51.315424+0000","last_fullsized":"2024-08-17T02:27:51.315424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:08.545557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.314077+0000","last_change":"2024-08-17T02:27:51.309089+0000","last_active":"2024-08-17T02:27:51.314077+0000","last_peered":"2024-08-17T02:27:51.314077+0000","last_clean":"2024-08-17T02:27:51.314077+0000","last_became_active":"2024-08-17T02:27:51.308817+0000","last_became_peered":"2024-08-17T02:27:51.308817+0000","last_unstale":"2024-08-17T02:27:51.314077+0000","last_undegraded":"2024-08-17T02:27:51.314077+0000","last_fullsized":"2024-08-17T02:27:51.314077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:22:54.682219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.305139+0000","last_change":"2024-08-17T02:27:51.301226+0000","last_active":"2024-08-17T02:27:51.305139+0000","last_peered":"2024-08-17T02:27:51.305139+0000","last_clean":"2024-08-17T02:27:51.305139+0000","last_became_active":"2024-08-17T02:27:51.300976+0000","last_became_peered":"2024-08-17T02:27:51.300976+0000","last_unstale":"2024-08-17T02:27:51.305139+0000","last_undegraded":"2024-08-17T02:27:51.305139+0000","last_fullsized":"2024-08-17T02:27:51.305139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:51:59.475864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.321818+0000","last_change":"2024-08-17T02:27:51.320367+0000","last_active":"2024-08-17T02:27:51.321818+0000","last_peered":"2024-08-17T02:27:51.321818+0000","last_clean":"2024-08-17T02:27:51.321818+0000","last_became_active":"2024-08-17T02:27:51.320044+0000","last_became_peered":"2024-08-17T02:27:51.320044+0000","last_unstale":"2024-08-17T02:27:51.321818+0000","last_undegraded":"2024-08-17T02:27:51.321818+0000","last_fullsized":"2024-08-17T02:27:51.321818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:03:57.699175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.316581+0000","last_change":"2024-08-17T02:27:51.311082+0000","last_active":"2024-08-17T02:27:51.316581+0000","last_peered":"2024-08-17T02:27:51.316581+0000","last_clean":"2024-08-17T02:27:51.316581+0000","last_became_active":"2024-08-17T02:27:51.309886+0000","last_became_peered":"2024-08-17T02:27:51.309886+0000","last_unstale":"2024-08-17T02:27:51.316581+0000","last_undegraded":"2024-08-17T02:27:51.316581+0000","last_fullsized":"2024-08-17T02:27:51.316581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:07.004040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.313062+0000","last_change":"2024-08-17T02:27:51.309574+0000","last_active":"2024-08-17T02:27:51.313062+0000","last_peered":"2024-08-17T02:27:51.313062+0000","last_clean":"2024-08-17T02:27:51.313062+0000","last_became_active":"2024-08-17T02:27:51.309291+0000","last_became_peered":"2024-08-17T02:27:51.309291+0000","last_unstale":"2024-08-17T02:27:51.313062+0000","last_undegraded":"2024-08-17T02:27:51.313062+0000","last_fullsized":"2024-08-17T02:27:51.313062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:26.379433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.308225+0000","last_change":"2024-08-17T02:27:51.305009+0000","last_active":"2024-08-17T02:27:51.308225+0000","last_peered":"2024-08-17T02:27:51.308225+0000","last_clean":"2024-08-17T02:27:51.308225+0000","last_became_active":"2024-08-17T02:27:51.303089+0000","last_became_peered":"2024-08-17T02:27:51.303089+0000","last_unstale":"2024-08-17T02:27:51.308225+0000","last_undegraded":"2024-08-17T02:27:51.308225+0000","last_fullsized":"2024-08-17T02:27:51.308225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:52:35.132297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.304722+0000","last_change":"2024-08-17T02:27:51.299987+0000","last_active":"2024-08-17T02:27:51.304722+0000","last_peered":"2024-08-17T02:27:51.304722+0000","last_clean":"2024-08-17T02:27:51.304722+0000","last_became_active":"2024-08-17T02:27:51.299700+0000","last_became_peered":"2024-08-17T02:27:51.299700+0000","last_unstale":"2024-08-17T02:27:51.304722+0000","last_undegraded":"2024-08-17T02:27:51.304722+0000","last_fullsized":"2024-08-17T02:27:51.304722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:23.747098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.289813+0000","last_change":"2024-08-17T02:27:51.287246+0000","last_active":"2024-08-17T02:27:51.289813+0000","last_peered":"2024-08-17T02:27:51.289813+0000","last_clean":"2024-08-17T02:27:51.289813+0000","last_became_active":"2024-08-17T02:27:51.287011+0000","last_became_peered":"2024-08-17T02:27:51.287011+0000","last_unstale":"2024-08-17T02:27:51.289813+0000","last_undegraded":"2024-08-17T02:27:51.289813+0000","last_fullsized":"2024-08-17T02:27:51.289813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:00.021420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.311602+0000","last_change":"2024-08-17T02:27:51.306642+0000","last_active":"2024-08-17T02:27:51.311602+0000","last_peered":"2024-08-17T02:27:51.311602+0000","last_clean":"2024-08-17T02:27:51.311602+0000","last_became_active":"2024-08-17T02:27:51.306324+0000","last_became_peered":"2024-08-17T02:27:51.306324+0000","last_unstale":"2024-08-17T02:27:51.311602+0000","last_undegraded":"2024-08-17T02:27:51.311602+0000","last_fullsized":"2024-08-17T02:27:51.311602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:45:24.383393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.311314+0000","last_change":"2024-08-17T02:27:51.307812+0000","last_active":"2024-08-17T02:27:51.311314+0000","last_peered":"2024-08-17T02:27:51.311314+0000","last_clean":"2024-08-17T02:27:51.311314+0000","last_became_active":"2024-08-17T02:27:51.307000+0000","last_became_peered":"2024-08-17T02:27:51.307000+0000","last_unstale":"2024-08-17T02:27:51.311314+0000","last_undegraded":"2024-08-17T02:27:51.311314+0000","last_fullsized":"2024-08-17T02:27:51.311314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:23.747098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315476+0000","last_change":"2024-08-17T02:27:51.313130+0000","last_active":"2024-08-17T02:27:51.315476+0000","last_peered":"2024-08-17T02:27:51.315476+0000","last_clean":"2024-08-17T02:27:51.315476+0000","last_became_active":"2024-08-17T02:27:51.312875+0000","last_became_peered":"2024-08-17T02:27:51.312875+0000","last_unstale":"2024-08-17T02:27:51.315476+0000","last_undegraded":"2024-08-17T02:27:51.315476+0000","last_fullsized":"2024-08-17T02:27:51.315476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:01.072889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309623+0000","last_change":"2024-08-17T02:27:51.302749+0000","last_active":"2024-08-17T02:27:51.309623+0000","last_peered":"2024-08-17T02:27:51.309623+0000","last_clean":"2024-08-17T02:27:51.309623+0000","last_became_active":"2024-08-17T02:27:51.302531+0000","last_became_peered":"2024-08-17T02:27:51.302531+0000","last_unstale":"2024-08-17T02:27:51.309623+0000","last_undegraded":"2024-08-17T02:27:51.309623+0000","last_fullsized":"2024-08-17T02:27:51.309623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:52:35.132297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.305870+0000","last_change":"2024-08-17T02:27:51.304533+0000","last_active":"2024-08-17T02:27:51.305870+0000","last_peered":"2024-08-17T02:27:51.305870+0000","last_clean":"2024-08-17T02:27:51.305870+0000","last_became_active":"2024-08-17T02:27:51.304274+0000","last_became_peered":"2024-08-17T02:27:51.304274+0000","last_unstale":"2024-08-17T02:27:51.305870+0000","last_undegraded":"2024-08-17T02:27:51.305870+0000","last_fullsized":"2024-08-17T02:27:51.305870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:23.159482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.314254+0000","last_change":"2024-08-17T02:27:51.307321+0000","last_active":"2024-08-17T02:27:51.314254+0000","last_peered":"2024-08-17T02:27:51.314254+0000","last_clean":"2024-08-17T02:27:51.314254+0000","last_became_active":"2024-08-17T02:27:51.306795+0000","last_became_peered":"2024-08-17T02:27:51.306795+0000","last_unstale":"2024-08-17T02:27:51.314254+0000","last_undegraded":"2024-08-17T02:27:51.314254+0000","last_fullsized":"2024-08-17T02:27:51.314254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:04:36.940627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.306021+0000","last_change":"2024-08-17T02:27:51.293229+0000","last_active":"2024-08-17T02:27:51.306021+0000","last_peered":"2024-08-17T02:27:51.306021+0000","last_clean":"2024-08-17T02:27:51.306021+0000","last_became_active":"2024-08-17T02:27:51.292455+0000","last_became_peered":"2024-08-17T02:27:51.292455+0000","last_unstale":"2024-08-17T02:27:51.306021+0000","last_undegraded":"2024-08-17T02:27:51.306021+0000","last_fullsized":"2024-08-17T02:27:51.306021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:04:36.940627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.310379+0000","last_change":"2024-08-17T02:27:51.302786+0000","last_active":"2024-08-17T02:27:51.310379+0000","last_peered":"2024-08-17T02:27:51.310379+0000","last_clean":"2024-08-17T02:27:51.310379+0000","last_became_active":"2024-08-17T02:27:51.302520+0000","last_became_peered":"2024-08-17T02:27:51.302520+0000","last_unstale":"2024-08-17T02:27:51.310379+0000","last_undegraded":"2024-08-17T02:27:51.310379+0000","last_fullsized":"2024-08-17T02:27:51.310379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:22:54.682219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.304491+0000","last_change":"2024-08-17T02:27:51.297406+0000","last_active":"2024-08-17T02:27:51.304491+0000","last_peered":"2024-08-17T02:27:51.304491+0000","last_clean":"2024-08-17T02:27:51.304491+0000","last_became_active":"2024-08-17T02:27:51.291804+0000","last_became_peered":"2024-08-17T02:27:51.291804+0000","last_unstale":"2024-08-17T02:27:51.304491+0000","last_undegraded":"2024-08-17T02:27:51.304491+0000","last_fullsized":"2024-08-17T02:27:51.304491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:22:54.682219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315495+0000","last_change":"2024-08-17T02:27:51.312012+0000","last_active":"2024-08-17T02:27:51.315495+0000","last_peered":"2024-08-17T02:27:51.315495+0000","last_clean":"2024-08-17T02:27:51.315495+0000","last_became_active":"2024-08-17T02:27:51.311735+0000","last_became_peered":"2024-08-17T02:27:51.311735+0000","last_unstale":"2024-08-17T02:27:51.315495+0000","last_undegraded":"2024-08-17T02:27:51.315495+0000","last_fullsized":"2024-08-17T02:27:51.315495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:47:22.647519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.304429+0000","last_change":"2024-08-17T02:27:51.294844+0000","last_active":"2024-08-17T02:27:51.304429+0000","last_peered":"2024-08-17T02:27:51.304429+0000","last_clean":"2024-08-17T02:27:51.304429+0000","last_became_active":"2024-08-17T02:27:51.294546+0000","last_became_peered":"2024-08-17T02:27:51.294546+0000","last_unstale":"2024-08-17T02:27:51.304429+0000","last_undegraded":"2024-08-17T02:27:51.304429+0000","last_fullsized":"2024-08-17T02:27:51.304429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:17:09.418523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309763+0000","last_change":"2024-08-17T02:27:51.301918+0000","last_active":"2024-08-17T02:27:51.309763+0000","last_peered":"2024-08-17T02:27:51.309763+0000","last_clean":"2024-08-17T02:27:51.309763+0000","last_became_active":"2024-08-17T02:27:51.301672+0000","last_became_peered":"2024-08-17T02:27:51.301672+0000","last_unstale":"2024-08-17T02:27:51.309763+0000","last_undegraded":"2024-08-17T02:27:51.309763+0000","last_fullsized":"2024-08-17T02:27:51.309763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:23.159482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309265+0000","last_change":"2024-08-17T02:27:51.305095+0000","last_active":"2024-08-17T02:27:51.309265+0000","last_peered":"2024-08-17T02:27:51.309265+0000","last_clean":"2024-08-17T02:27:51.309265+0000","last_became_active":"2024-08-17T02:27:51.304895+0000","last_became_peered":"2024-08-17T02:27:51.304895+0000","last_unstale":"2024-08-17T02:27:51.309265+0000","last_undegraded":"2024-08-17T02:27:51.309265+0000","last_fullsized":"2024-08-17T02:27:51.309265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:07.004040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.312124+0000","last_change":"2024-08-17T02:27:51.307625+0000","last_active":"2024-08-17T02:27:51.312124+0000","last_peered":"2024-08-17T02:27:51.312124+0000","last_clean":"2024-08-17T02:27:51.312124+0000","last_became_active":"2024-08-17T02:27:51.307052+0000","last_became_peered":"2024-08-17T02:27:51.307052+0000","last_unstale":"2024-08-17T02:27:51.312124+0000","last_undegraded":"2024-08-17T02:27:51.312124+0000","last_fullsized":"2024-08-17T02:27:51.312124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:08.545557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.308474+0000","last_change":"2024-08-17T02:27:51.305503+0000","last_active":"2024-08-17T02:27:51.308474+0000","last_peered":"2024-08-17T02:27:51.308474+0000","last_clean":"2024-08-17T02:27:51.308474+0000","last_became_active":"2024-08-17T02:27:51.302095+0000","last_became_peered":"2024-08-17T02:27:51.302095+0000","last_unstale":"2024-08-17T02:27:51.308474+0000","last_undegraded":"2024-08-17T02:27:51.308474+0000","last_fullsized":"2024-08-17T02:27:51.308474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:23.747098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315454+0000","last_change":"2024-08-17T02:27:51.309505+0000","last_active":"2024-08-17T02:27:51.315454+0000","last_peered":"2024-08-17T02:27:51.315454+0000","last_clean":"2024-08-17T02:27:51.315454+0000","last_became_active":"2024-08-17T02:27:51.309223+0000","last_became_peered":"2024-08-17T02:27:51.309223+0000","last_unstale":"2024-08-17T02:27:51.315454+0000","last_undegraded":"2024-08-17T02:27:51.315454+0000","last_fullsized":"2024-08-17T02:27:51.315454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:40.951641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309177+0000","last_change":"2024-08-17T02:27:51.302769+0000","last_active":"2024-08-17T02:27:51.309177+0000","last_peered":"2024-08-17T02:27:51.309177+0000","last_clean":"2024-08-17T02:27:51.309177+0000","last_became_active":"2024-08-17T02:27:51.300628+0000","last_became_peered":"2024-08-17T02:27:51.300628+0000","last_unstale":"2024-08-17T02:27:51.309177+0000","last_undegraded":"2024-08-17T02:27:51.309177+0000","last_fullsized":"2024-08-17T02:27:51.309177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:36:40.089843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.308015+0000","last_change":"2024-08-17T02:27:51.298088+0000","last_active":"2024-08-17T02:27:51.308015+0000","last_peered":"2024-08-17T02:27:51.308015+0000","last_clean":"2024-08-17T02:27:51.308015+0000","last_became_active":"2024-08-17T02:27:51.297755+0000","last_became_peered":"2024-08-17T02:27:51.297755+0000","last_unstale":"2024-08-17T02:27:51.308015+0000","last_undegraded":"2024-08-17T02:27:51.308015+0000","last_fullsized":"2024-08-17T02:27:51.308015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:52.916950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.291260+0000","last_change":"2024-08-17T02:27:51.287126+0000","last_active":"2024-08-17T02:27:51.291260+0000","last_peered":"2024-08-17T02:27:51.291260+0000","last_clean":"2024-08-17T02:27:51.291260+0000","last_became_active":"2024-08-17T02:27:51.286839+0000","last_became_peered":"2024-08-17T02:27:51.286839+0000","last_unstale":"2024-08-17T02:27:51.291260+0000","last_undegraded":"2024-08-17T02:27:51.291260+0000","last_fullsized":"2024-08-17T02:27:51.291260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:44.884519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.307938+0000","last_change":"2024-08-17T02:27:50.294440+0000","last_active":"2024-08-17T02:27:51.307938+0000","last_peered":"2024-08-17T02:27:51.307938+0000","last_clean":"2024-08-17T02:27:51.307938+0000","last_became_active":"2024-08-17T02:27:50.294141+0000","last_became_peered":"2024-08-17T02:27:50.294141+0000","last_unstale":"2024-08-17T02:27:51.307938+0000","last_undegraded":"2024-08-17T02:27:51.307938+0000","last_fullsized":"2024-08-17T02:27:51.307938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:30.074784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.302318+0000","last_change":"2024-08-17T02:27:51.295343+0000","last_active":"2024-08-17T02:27:51.302318+0000","last_peered":"2024-08-17T02:27:51.302318+0000","last_clean":"2024-08-17T02:27:51.302318+0000","last_became_active":"2024-08-17T02:27:51.293004+0000","last_became_peered":"2024-08-17T02:27:51.293004+0000","last_unstale":"2024-08-17T02:27:51.302318+0000","last_undegraded":"2024-08-17T02:27:51.302318+0000","last_fullsized":"2024-08-17T02:27:51.302318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:26.379433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.310422+0000","last_change":"2024-08-17T02:27:50.305041+0000","last_active":"2024-08-17T02:27:51.310422+0000","last_peered":"2024-08-17T02:27:51.310422+0000","last_clean":"2024-08-17T02:27:51.310422+0000","last_became_active":"2024-08-17T02:27:50.304359+0000","last_became_peered":"2024-08-17T02:27:50.304359+0000","last_unstale":"2024-08-17T02:27:51.310422+0000","last_undegraded":"2024-08-17T02:27:51.310422+0000","last_fullsized":"2024-08-17T02:27:51.310422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:23.849240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.286459+0000","last_change":"2024-08-17T02:27:50.304515+0000","last_active":"2024-08-17T02:27:51.286459+0000","last_peered":"2024-08-17T02:27:51.286459+0000","last_clean":"2024-08-17T02:27:51.286459+0000","last_became_active":"2024-08-17T02:27:50.304276+0000","last_became_peered":"2024-08-17T02:27:50.304276+0000","last_unstale":"2024-08-17T02:27:51.286459+0000","last_undegraded":"2024-08-17T02:27:51.286459+0000","last_fullsized":"2024-08-17T02:27:51.286459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:43.423994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.312129+0000","last_change":"2024-08-17T02:27:51.307787+0000","last_active":"2024-08-17T02:27:51.312129+0000","last_peered":"2024-08-17T02:27:51.312129+0000","last_clean":"2024-08-17T02:27:51.312129+0000","last_became_active":"2024-08-17T02:27:51.307539+0000","last_became_peered":"2024-08-17T02:27:51.307539+0000","last_unstale":"2024-08-17T02:27:51.312129+0000","last_undegraded":"2024-08-17T02:27:51.312129+0000","last_fullsized":"2024-08-17T02:27:51.312129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:52.916950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.295176+0000","last_change":"2024-08-17T02:27:50.285283+0000","last_active":"2024-08-17T02:27:51.295176+0000","last_peered":"2024-08-17T02:27:51.295176+0000","last_clean":"2024-08-17T02:27:51.295176+0000","last_became_active":"2024-08-17T02:27:50.284974+0000","last_became_peered":"2024-08-17T02:27:50.284974+0000","last_unstale":"2024-08-17T02:27:51.295176+0000","last_undegraded":"2024-08-17T02:27:51.295176+0000","last_fullsized":"2024-08-17T02:27:51.295176+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:43.878005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309325+0000","last_change":"2024-08-17T02:27:51.306133+0000","last_active":"2024-08-17T02:27:51.309325+0000","last_peered":"2024-08-17T02:27:51.309325+0000","last_clean":"2024-08-17T02:27:51.309325+0000","last_became_active":"2024-08-17T02:27:51.305784+0000","last_became_peered":"2024-08-17T02:27:51.305784+0000","last_unstale":"2024-08-17T02:27:51.309325+0000","last_undegraded":"2024-08-17T02:27:51.309325+0000","last_fullsized":"2024-08-17T02:27:51.309325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:23.747098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.292192+0000","last_change":"2024-08-17T02:27:50.302699+0000","last_active":"2024-08-17T02:27:51.292192+0000","last_peered":"2024-08-17T02:27:51.292192+0000","last_clean":"2024-08-17T02:27:51.292192+0000","last_became_active":"2024-08-17T02:27:50.302324+0000","last_became_peered":"2024-08-17T02:27:50.302324+0000","last_unstale":"2024-08-17T02:27:51.292192+0000","last_undegraded":"2024-08-17T02:27:51.292192+0000","last_fullsized":"2024-08-17T02:27:51.292192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:43.878005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.319524+0000","last_change":"2024-08-17T02:27:51.317627+0000","last_active":"2024-08-17T02:27:51.319524+0000","last_peered":"2024-08-17T02:27:51.319524+0000","last_clean":"2024-08-17T02:27:51.319524+0000","last_became_active":"2024-08-17T02:27:51.317363+0000","last_became_peered":"2024-08-17T02:27:51.317363+0000","last_unstale":"2024-08-17T02:27:51.319524+0000","last_undegraded":"2024-08-17T02:27:51.319524+0000","last_fullsized":"2024-08-17T02:27:51.319524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:12:12.800070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.296163+0000","last_change":"2024-08-17T02:27:50.304899+0000","last_active":"2024-08-17T02:27:51.296163+0000","last_peered":"2024-08-17T02:27:51.296163+0000","last_clean":"2024-08-17T02:27:51.296163+0000","last_became_active":"2024-08-17T02:27:50.303335+0000","last_became_peered":"2024-08-17T02:27:50.303335+0000","last_unstale":"2024-08-17T02:27:51.296163+0000","last_undegraded":"2024-08-17T02:27:51.296163+0000","last_fullsized":"2024-08-17T02:27:51.296163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:23.849240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.312556+0000","last_change":"2024-08-17T02:27:51.311088+0000","last_active":"2024-08-17T02:27:51.312556+0000","last_peered":"2024-08-17T02:27:51.312556+0000","last_clean":"2024-08-17T02:27:51.312556+0000","last_became_active":"2024-08-17T02:27:51.310514+0000","last_became_peered":"2024-08-17T02:27:51.310514+0000","last_unstale":"2024-08-17T02:27:51.312556+0000","last_undegraded":"2024-08-17T02:27:51.312556+0000","last_fullsized":"2024-08-17T02:27:51.312556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:45:24.383393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.318886+0000","last_change":"2024-08-17T02:27:50.295951+0000","last_active":"2024-08-17T02:27:51.318886+0000","last_peered":"2024-08-17T02:27:51.318886+0000","last_clean":"2024-08-17T02:27:51.318886+0000","last_became_active":"2024-08-17T02:27:50.295351+0000","last_became_peered":"2024-08-17T02:27:50.295351+0000","last_unstale":"2024-08-17T02:27:51.318886+0000","last_undegraded":"2024-08-17T02:27:51.318886+0000","last_fullsized":"2024-08-17T02:27:51.318886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:57.534676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.308207+0000","last_change":"2024-08-17T02:27:51.303007+0000","last_active":"2024-08-17T02:27:51.308207+0000","last_peered":"2024-08-17T02:27:51.308207+0000","last_clean":"2024-08-17T02:27:51.308207+0000","last_became_active":"2024-08-17T02:27:51.300357+0000","last_became_peered":"2024-08-17T02:27:51.300357+0000","last_unstale":"2024-08-17T02:27:51.308207+0000","last_undegraded":"2024-08-17T02:27:51.308207+0000","last_fullsized":"2024-08-17T02:27:51.308207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:36:40.089843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.318657+0000","last_change":"2024-08-17T02:27:50.304133+0000","last_active":"2024-08-17T02:27:51.318657+0000","last_peered":"2024-08-17T02:27:51.318657+0000","last_clean":"2024-08-17T02:27:51.318657+0000","last_became_active":"2024-08-17T02:27:50.302755+0000","last_became_peered":"2024-08-17T02:27:50.302755+0000","last_unstale":"2024-08-17T02:27:51.318657+0000","last_undegraded":"2024-08-17T02:27:51.318657+0000","last_fullsized":"2024-08-17T02:27:51.318657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:02:06.007638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.313981+0000","last_change":"2024-08-17T02:27:51.310016+0000","last_active":"2024-08-17T02:27:51.313981+0000","last_peered":"2024-08-17T02:27:51.313981+0000","last_clean":"2024-08-17T02:27:51.313981+0000","last_became_active":"2024-08-17T02:27:51.309632+0000","last_became_peered":"2024-08-17T02:27:51.309632+0000","last_unstale":"2024-08-17T02:27:51.313981+0000","last_undegraded":"2024-08-17T02:27:51.313981+0000","last_fullsized":"2024-08-17T02:27:51.313981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:29:40.951641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.318739+0000","last_change":"2024-08-17T02:27:50.300858+0000","last_active":"2024-08-17T02:27:51.318739+0000","last_peered":"2024-08-17T02:27:51.318739+0000","last_clean":"2024-08-17T02:27:51.318739+0000","last_became_active":"2024-08-17T02:27:50.300575+0000","last_became_peered":"2024-08-17T02:27:50.300575+0000","last_unstale":"2024-08-17T02:27:51.318739+0000","last_undegraded":"2024-08-17T02:27:51.318739+0000","last_fullsized":"2024-08-17T02:27:51.318739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:36:30.074784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.301773+0000","last_change":"2024-08-17T02:27:51.295142+0000","last_active":"2024-08-17T02:27:51.301773+0000","last_peered":"2024-08-17T02:27:51.301773+0000","last_clean":"2024-08-17T02:27:51.301773+0000","last_became_active":"2024-08-17T02:27:51.294912+0000","last_became_peered":"2024-08-17T02:27:51.294912+0000","last_unstale":"2024-08-17T02:27:51.301773+0000","last_undegraded":"2024-08-17T02:27:51.301773+0000","last_fullsized":"2024-08-17T02:27:51.301773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:23.159482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.293032+0000","last_change":"2024-08-17T02:27:50.298640+0000","last_active":"2024-08-17T02:27:51.293032+0000","last_peered":"2024-08-17T02:27:51.293032+0000","last_clean":"2024-08-17T02:27:51.293032+0000","last_became_active":"2024-08-17T02:27:50.298355+0000","last_became_peered":"2024-08-17T02:27:50.298355+0000","last_unstale":"2024-08-17T02:27:51.293032+0000","last_undegraded":"2024-08-17T02:27:51.293032+0000","last_fullsized":"2024-08-17T02:27:51.293032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:43:01.783598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.320291+0000","last_change":"2024-08-17T02:27:51.318860+0000","last_active":"2024-08-17T02:27:51.320291+0000","last_peered":"2024-08-17T02:27:51.320291+0000","last_clean":"2024-08-17T02:27:51.320291+0000","last_became_active":"2024-08-17T02:27:51.317220+0000","last_became_peered":"2024-08-17T02:27:51.317220+0000","last_unstale":"2024-08-17T02:27:51.320291+0000","last_undegraded":"2024-08-17T02:27:51.320291+0000","last_fullsized":"2024-08-17T02:27:51.320291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:47:22.647519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.286902+0000","last_change":"2024-08-17T02:27:50.304030+0000","last_active":"2024-08-17T02:27:51.286902+0000","last_peered":"2024-08-17T02:27:51.286902+0000","last_clean":"2024-08-17T02:27:51.286902+0000","last_became_active":"2024-08-17T02:27:50.303575+0000","last_became_peered":"2024-08-17T02:27:50.303575+0000","last_unstale":"2024-08-17T02:27:51.286902+0000","last_undegraded":"2024-08-17T02:27:51.286902+0000","last_fullsized":"2024-08-17T02:27:51.286902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:01.529714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.307995+0000","last_change":"2024-08-17T02:27:51.297859+0000","last_active":"2024-08-17T02:27:51.307995+0000","last_peered":"2024-08-17T02:27:51.307995+0000","last_clean":"2024-08-17T02:27:51.307995+0000","last_became_active":"2024-08-17T02:27:51.297542+0000","last_became_peered":"2024-08-17T02:27:51.297542+0000","last_unstale":"2024-08-17T02:27:51.307995+0000","last_undegraded":"2024-08-17T02:27:51.307995+0000","last_fullsized":"2024-08-17T02:27:51.307995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:17:09.418523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.307003+0000","last_change":"2024-08-17T02:27:50.289491+0000","last_active":"2024-08-17T02:27:51.307003+0000","last_peered":"2024-08-17T02:27:51.307003+0000","last_clean":"2024-08-17T02:27:51.307003+0000","last_became_active":"2024-08-17T02:27:50.287407+0000","last_became_peered":"2024-08-17T02:27:50.287407+0000","last_unstale":"2024-08-17T02:27:51.307003+0000","last_undegraded":"2024-08-17T02:27:51.307003+0000","last_fullsized":"2024-08-17T02:27:51.307003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:02:06.007638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.314370+0000","last_change":"2024-08-17T02:27:51.311648+0000","last_active":"2024-08-17T02:27:51.314370+0000","last_peered":"2024-08-17T02:27:51.314370+0000","last_clean":"2024-08-17T02:27:51.314370+0000","last_became_active":"2024-08-17T02:27:51.311419+0000","last_became_peered":"2024-08-17T02:27:51.311419+0000","last_unstale":"2024-08-17T02:27:51.314370+0000","last_undegraded":"2024-08-17T02:27:51.314370+0000","last_fullsized":"2024-08-17T02:27:51.314370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:56:03.462179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.311272+0000","last_change":"2024-08-17T02:27:50.290855+0000","last_active":"2024-08-17T02:27:51.311272+0000","last_peered":"2024-08-17T02:27:51.311272+0000","last_clean":"2024-08-17T02:27:51.311272+0000","last_became_active":"2024-08-17T02:27:50.289943+0000","last_became_peered":"2024-08-17T02:27:50.289943+0000","last_unstale":"2024-08-17T02:27:51.311272+0000","last_undegraded":"2024-08-17T02:27:51.311272+0000","last_fullsized":"2024-08-17T02:27:51.311272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:52:17.225404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.314398+0000","last_change":"2024-08-17T02:27:51.311333+0000","last_active":"2024-08-17T02:27:51.314398+0000","last_peered":"2024-08-17T02:27:51.314398+0000","last_clean":"2024-08-17T02:27:51.314398+0000","last_became_active":"2024-08-17T02:27:51.311078+0000","last_became_peered":"2024-08-17T02:27:51.311078+0000","last_unstale":"2024-08-17T02:27:51.314398+0000","last_undegraded":"2024-08-17T02:27:51.314398+0000","last_fullsized":"2024-08-17T02:27:51.314398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:06:01.072889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.309026+0000","last_change":"2024-08-17T02:27:50.301645+0000","last_active":"2024-08-17T02:27:51.309026+0000","last_peered":"2024-08-17T02:27:51.309026+0000","last_clean":"2024-08-17T02:27:51.309026+0000","last_became_active":"2024-08-17T02:27:50.301348+0000","last_became_peered":"2024-08-17T02:27:50.301348+0000","last_unstale":"2024-08-17T02:27:51.309026+0000","last_undegraded":"2024-08-17T02:27:51.309026+0000","last_fullsized":"2024-08-17T02:27:51.309026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:02:43.423994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.317741+0000","last_change":"2024-08-17T02:27:51.315762+0000","last_active":"2024-08-17T02:27:51.317741+0000","last_peered":"2024-08-17T02:27:51.317741+0000","last_clean":"2024-08-17T02:27:51.317741+0000","last_became_active":"2024-08-17T02:27:51.315472+0000","last_became_peered":"2024-08-17T02:27:51.315472+0000","last_unstale":"2024-08-17T02:27:51.317741+0000","last_undegraded":"2024-08-17T02:27:51.317741+0000","last_fullsized":"2024-08-17T02:27:51.317741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:59:59.342696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.308888+0000","last_change":"2024-08-17T02:27:50.296190+0000","last_active":"2024-08-17T02:27:51.308888+0000","last_peered":"2024-08-17T02:27:51.308888+0000","last_clean":"2024-08-17T02:27:51.308888+0000","last_became_active":"2024-08-17T02:27:50.295362+0000","last_became_peered":"2024-08-17T02:27:50.295362+0000","last_unstale":"2024-08-17T02:27:51.308888+0000","last_undegraded":"2024-08-17T02:27:51.308888+0000","last_fullsized":"2024-08-17T02:27:51.308888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:23.849240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315799+0000","last_change":"2024-08-17T02:27:51.310706+0000","last_active":"2024-08-17T02:27:51.315799+0000","last_peered":"2024-08-17T02:27:51.315799+0000","last_clean":"2024-08-17T02:27:51.315799+0000","last_became_active":"2024-08-17T02:27:51.310451+0000","last_became_peered":"2024-08-17T02:27:51.310451+0000","last_unstale":"2024-08-17T02:27:51.315799+0000","last_undegraded":"2024-08-17T02:27:51.315799+0000","last_fullsized":"2024-08-17T02:27:51.315799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:59:59.342696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.285945+0000","last_change":"2024-08-17T02:27:50.289792+0000","last_active":"2024-08-17T02:27:51.285945+0000","last_peered":"2024-08-17T02:27:51.285945+0000","last_clean":"2024-08-17T02:27:51.285945+0000","last_became_active":"2024-08-17T02:27:50.288900+0000","last_became_peered":"2024-08-17T02:27:50.288900+0000","last_unstale":"2024-08-17T02:27:51.285945+0000","last_undegraded":"2024-08-17T02:27:51.285945+0000","last_fullsized":"2024-08-17T02:27:51.285945+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:01.529714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.305748+0000","last_change":"2024-08-17T02:27:51.303771+0000","last_active":"2024-08-17T02:27:51.305748+0000","last_peered":"2024-08-17T02:27:51.305748+0000","last_clean":"2024-08-17T02:27:51.305748+0000","last_became_active":"2024-08-17T02:27:51.303503+0000","last_became_peered":"2024-08-17T02:27:51.303503+0000","last_unstale":"2024-08-17T02:27:51.305748+0000","last_undegraded":"2024-08-17T02:27:51.305748+0000","last_fullsized":"2024-08-17T02:27:51.305748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:57:08.545557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.286581+0000","last_change":"2024-08-17T02:27:39.552321+0000","last_active":"2024-08-17T02:27:51.286581+0000","last_peered":"2024-08-17T02:27:51.286581+0000","last_clean":"2024-08-17T02:27:51.286581+0000","last_became_active":"2024-08-17T02:27:39.551203+0000","last_became_peered":"2024-08-17T02:27:39.551203+0000","last_unstale":"2024-08-17T02:27:51.286581+0000","last_undegraded":"2024-08-17T02:27:51.286581+0000","last_fullsized":"2024-08-17T02:27:51.286581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.155679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.155679+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.155679+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:02.785032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.292505+0000","last_change":"2024-08-17T02:27:50.289453+0000","last_active":"2024-08-17T02:27:51.292505+0000","last_peered":"2024-08-17T02:27:51.292505+0000","last_clean":"2024-08-17T02:27:51.292505+0000","last_became_active":"2024-08-17T02:27:50.289066+0000","last_became_peered":"2024-08-17T02:27:50.289066+0000","last_unstale":"2024-08-17T02:27:51.292505+0000","last_undegraded":"2024-08-17T02:27:51.292505+0000","last_fullsized":"2024-08-17T02:27:51.292505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:35:01.529714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.307760+0000","last_change":"2024-08-17T02:27:51.302543+0000","last_active":"2024-08-17T02:27:51.307760+0000","last_peered":"2024-08-17T02:27:51.307760+0000","last_clean":"2024-08-17T02:27:51.307760+0000","last_became_active":"2024-08-17T02:27:51.302282+0000","last_became_peered":"2024-08-17T02:27:51.302282+0000","last_unstale":"2024-08-17T02:27:51.307760+0000","last_undegraded":"2024-08-17T02:27:51.307760+0000","last_fullsized":"2024-08-17T02:27:51.307760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:07.004040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.286496+0000","last_change":"2024-08-17T02:27:50.305660+0000","last_active":"2024-08-17T02:27:51.286496+0000","last_peered":"2024-08-17T02:27:51.286496+0000","last_clean":"2024-08-17T02:27:51.286496+0000","last_became_active":"2024-08-17T02:27:50.305076+0000","last_became_peered":"2024-08-17T02:27:50.305076+0000","last_unstale":"2024-08-17T02:27:51.286496+0000","last_undegraded":"2024-08-17T02:27:51.286496+0000","last_fullsized":"2024-08-17T02:27:51.286496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:36:39.083329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.299771+0000","last_change":"2024-08-17T02:27:51.291775+0000","last_active":"2024-08-17T02:27:51.299771+0000","last_peered":"2024-08-17T02:27:51.299771+0000","last_clean":"2024-08-17T02:27:51.299771+0000","last_became_active":"2024-08-17T02:27:51.291502+0000","last_became_peered":"2024-08-17T02:27:51.291502+0000","last_unstale":"2024-08-17T02:27:51.299771+0000","last_undegraded":"2024-08-17T02:27:51.299771+0000","last_fullsized":"2024-08-17T02:27:51.299771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:52.916950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.285821+0000","last_change":"2024-08-17T02:27:50.294544+0000","last_active":"2024-08-17T02:27:51.285821+0000","last_peered":"2024-08-17T02:27:51.285821+0000","last_clean":"2024-08-17T02:27:51.285821+0000","last_became_active":"2024-08-17T02:27:50.293620+0000","last_became_peered":"2024-08-17T02:27:50.293620+0000","last_unstale":"2024-08-17T02:27:51.285821+0000","last_undegraded":"2024-08-17T02:27:51.285821+0000","last_fullsized":"2024-08-17T02:27:51.285821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:43:01.783598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.296255+0000","last_change":"2024-08-17T02:27:51.292285+0000","last_active":"2024-08-17T02:27:51.296255+0000","last_peered":"2024-08-17T02:27:51.296255+0000","last_clean":"2024-08-17T02:27:51.296255+0000","last_became_active":"2024-08-17T02:27:51.292028+0000","last_became_peered":"2024-08-17T02:27:51.292028+0000","last_unstale":"2024-08-17T02:27:51.296255+0000","last_undegraded":"2024-08-17T02:27:51.296255+0000","last_fullsized":"2024-08-17T02:27:51.296255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:00.021420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.295539+0000","last_change":"2024-08-17T02:27:50.300081+0000","last_active":"2024-08-17T02:27:51.295539+0000","last_peered":"2024-08-17T02:27:51.295539+0000","last_clean":"2024-08-17T02:27:51.295539+0000","last_became_active":"2024-08-17T02:27:50.299745+0000","last_became_peered":"2024-08-17T02:27:50.299745+0000","last_unstale":"2024-08-17T02:27:51.295539+0000","last_undegraded":"2024-08-17T02:27:51.295539+0000","last_fullsized":"2024-08-17T02:27:51.295539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:57.534676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.306324+0000","last_change":"2024-08-17T02:27:51.291025+0000","last_active":"2024-08-17T02:27:51.306324+0000","last_peered":"2024-08-17T02:27:51.306324+0000","last_clean":"2024-08-17T02:27:51.306324+0000","last_became_active":"2024-08-17T02:27:51.290690+0000","last_became_peered":"2024-08-17T02:27:51.290690+0000","last_unstale":"2024-08-17T02:27:51.306324+0000","last_undegraded":"2024-08-17T02:27:51.306324+0000","last_fullsized":"2024-08-17T02:27:51.306324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:58.541189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.284142+0000","last_change":"2024-08-17T02:27:50.299597+0000","last_active":"2024-08-17T02:27:51.284142+0000","last_peered":"2024-08-17T02:27:51.284142+0000","last_clean":"2024-08-17T02:27:51.284142+0000","last_became_active":"2024-08-17T02:27:50.298486+0000","last_became_peered":"2024-08-17T02:27:50.298486+0000","last_unstale":"2024-08-17T02:27:51.284142+0000","last_undegraded":"2024-08-17T02:27:51.284142+0000","last_fullsized":"2024-08-17T02:27:51.284142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:43:01.783598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.315535+0000","last_change":"2024-08-17T02:27:51.311899+0000","last_active":"2024-08-17T02:27:51.315535+0000","last_peered":"2024-08-17T02:27:51.315535+0000","last_clean":"2024-08-17T02:27:51.315535+0000","last_became_active":"2024-08-17T02:27:51.311615+0000","last_became_peered":"2024-08-17T02:27:51.311615+0000","last_unstale":"2024-08-17T02:27:51.315535+0000","last_undegraded":"2024-08-17T02:27:51.315535+0000","last_fullsized":"2024-08-17T02:27:51.315535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:56:03.462179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.297244+0000","last_change":"2024-08-17T02:27:50.302154+0000","last_active":"2024-08-17T02:27:51.297244+0000","last_peered":"2024-08-17T02:27:51.297244+0000","last_clean":"2024-08-17T02:27:51.297244+0000","last_became_active":"2024-08-17T02:27:50.301832+0000","last_became_peered":"2024-08-17T02:27:50.301832+0000","last_unstale":"2024-08-17T02:27:51.297244+0000","last_undegraded":"2024-08-17T02:27:51.297244+0000","last_fullsized":"2024-08-17T02:27:51.297244+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:18:57.534676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.296467+0000","last_change":"2024-08-17T02:27:51.292360+0000","last_active":"2024-08-17T02:27:51.296467+0000","last_peered":"2024-08-17T02:27:51.296467+0000","last_clean":"2024-08-17T02:27:51.296467+0000","last_became_active":"2024-08-17T02:27:51.292122+0000","last_became_peered":"2024-08-17T02:27:51.292122+0000","last_unstale":"2024-08-17T02:27:51.296467+0000","last_undegraded":"2024-08-17T02:27:51.296467+0000","last_fullsized":"2024-08-17T02:27:51.296467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:52.916950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:27:52.292254+0000","last_change":"2024-08-17T02:27:50.302427+0000","last_active":"2024-08-17T02:27:52.292254+0000","last_peered":"2024-08-17T02:27:52.292254+0000","last_clean":"2024-08-17T02:27:52.292254+0000","last_became_active":"2024-08-17T02:27:50.301894+0000","last_became_peered":"2024-08-17T02:27:50.301894+0000","last_unstale":"2024-08-17T02:27:52.292254+0000","last_undegraded":"2024-08-17T02:27:52.292254+0000","last_fullsized":"2024-08-17T02:27:52.292254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:52:34.125784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.304786+0000","last_change":"2024-08-17T02:27:51.300754+0000","last_active":"2024-08-17T02:27:51.304786+0000","last_peered":"2024-08-17T02:27:51.304786+0000","last_clean":"2024-08-17T02:27:51.304786+0000","last_became_active":"2024-08-17T02:27:51.300516+0000","last_became_peered":"2024-08-17T02:27:51.300516+0000","last_unstale":"2024-08-17T02:27:51.304786+0000","last_undegraded":"2024-08-17T02:27:51.304786+0000","last_fullsized":"2024-08-17T02:27:51.304786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:59:23.159482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.313066+0000","last_change":"2024-08-17T02:27:50.300734+0000","last_active":"2024-08-17T02:27:51.313066+0000","last_peered":"2024-08-17T02:27:51.313066+0000","last_clean":"2024-08-17T02:27:51.313066+0000","last_became_active":"2024-08-17T02:27:50.300458+0000","last_became_peered":"2024-08-17T02:27:50.300458+0000","last_unstale":"2024-08-17T02:27:51.313066+0000","last_undegraded":"2024-08-17T02:27:51.313066+0000","last_fullsized":"2024-08-17T02:27:51.313066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:43:01.783598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.298374+0000","last_change":"2024-08-17T02:27:51.290195+0000","last_active":"2024-08-17T02:27:51.298374+0000","last_peered":"2024-08-17T02:27:51.298374+0000","last_clean":"2024-08-17T02:27:51.298374+0000","last_became_active":"2024-08-17T02:27:51.287748+0000","last_became_peered":"2024-08-17T02:27:51.287748+0000","last_unstale":"2024-08-17T02:27:51.298374+0000","last_undegraded":"2024-08-17T02:27:51.298374+0000","last_fullsized":"2024-08-17T02:27:51.298374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:44.789170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.286398+0000","last_change":"2024-08-17T02:27:50.302235+0000","last_active":"2024-08-17T02:27:51.286398+0000","last_peered":"2024-08-17T02:27:51.286398+0000","last_clean":"2024-08-17T02:27:51.286398+0000","last_became_active":"2024-08-17T02:27:50.301967+0000","last_became_peered":"2024-08-17T02:27:50.301967+0000","last_unstale":"2024-08-17T02:27:51.286398+0000","last_undegraded":"2024-08-17T02:27:51.286398+0000","last_fullsized":"2024-08-17T02:27:51.286398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:43.878005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.304815+0000","last_change":"2024-08-17T02:27:51.293997+0000","last_active":"2024-08-17T02:27:51.304815+0000","last_peered":"2024-08-17T02:27:51.304815+0000","last_clean":"2024-08-17T02:27:51.304815+0000","last_became_active":"2024-08-17T02:27:51.293661+0000","last_became_peered":"2024-08-17T02:27:51.293661+0000","last_unstale":"2024-08-17T02:27:51.304815+0000","last_undegraded":"2024-08-17T02:27:51.304815+0000","last_fullsized":"2024-08-17T02:27:51.304815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:24.855754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.285393+0000","last_change":"2024-08-17T02:27:50.297434+0000","last_active":"2024-08-17T02:27:51.285393+0000","last_peered":"2024-08-17T02:27:51.285393+0000","last_clean":"2024-08-17T02:27:51.285393+0000","last_became_active":"2024-08-17T02:27:50.297160+0000","last_became_peered":"2024-08-17T02:27:50.297160+0000","last_unstale":"2024-08-17T02:27:51.285393+0000","last_undegraded":"2024-08-17T02:27:51.285393+0000","last_fullsized":"2024-08-17T02:27:51.285393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:44:43.878005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.304392+0000","last_change":"2024-08-17T02:27:51.294170+0000","last_active":"2024-08-17T02:27:51.304392+0000","last_peered":"2024-08-17T02:27:51.304392+0000","last_clean":"2024-08-17T02:27:51.304392+0000","last_became_active":"2024-08-17T02:27:51.293090+0000","last_became_peered":"2024-08-17T02:27:51.293090+0000","last_unstale":"2024-08-17T02:27:51.304392+0000","last_undegraded":"2024-08-17T02:27:51.304392+0000","last_fullsized":"2024-08-17T02:27:51.304392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:44:26.379433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.283605+0000","last_change":"2024-08-17T02:27:50.298748+0000","last_active":"2024-08-17T02:27:51.283605+0000","last_peered":"2024-08-17T02:27:51.283605+0000","last_clean":"2024-08-17T02:27:51.283605+0000","last_became_active":"2024-08-17T02:27:50.298203+0000","last_became_peered":"2024-08-17T02:27:50.298203+0000","last_unstale":"2024-08-17T02:27:51.283605+0000","last_undegraded":"2024-08-17T02:27:51.283605+0000","last_fullsized":"2024-08-17T02:27:51.283605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:36:39.083329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.312250+0000","last_change":"2024-08-17T02:27:51.308188+0000","last_active":"2024-08-17T02:27:51.312250+0000","last_peered":"2024-08-17T02:27:51.312250+0000","last_clean":"2024-08-17T02:27:51.312250+0000","last_became_active":"2024-08-17T02:27:51.307669+0000","last_became_peered":"2024-08-17T02:27:51.307669+0000","last_unstale":"2024-08-17T02:27:51.312250+0000","last_undegraded":"2024-08-17T02:27:51.312250+0000","last_fullsized":"2024-08-17T02:27:51.312250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:12:44.789170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.317269+0000","last_change":"2024-08-17T02:27:50.305833+0000","last_active":"2024-08-17T02:27:51.317269+0000","last_peered":"2024-08-17T02:27:51.317269+0000","last_clean":"2024-08-17T02:27:51.317269+0000","last_became_active":"2024-08-17T02:27:50.304646+0000","last_became_peered":"2024-08-17T02:27:50.304646+0000","last_unstale":"2024-08-17T02:27:51.317269+0000","last_undegraded":"2024-08-17T02:27:51.317269+0000","last_fullsized":"2024-08-17T02:27:51.317269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:39:03.039409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.316273+0000","last_change":"2024-08-17T02:27:51.310592+0000","last_active":"2024-08-17T02:27:51.316273+0000","last_peered":"2024-08-17T02:27:51.316273+0000","last_clean":"2024-08-17T02:27:51.316273+0000","last_became_active":"2024-08-17T02:27:51.310246+0000","last_became_peered":"2024-08-17T02:27:51.310246+0000","last_unstale":"2024-08-17T02:27:51.316273+0000","last_undegraded":"2024-08-17T02:27:51.316273+0000","last_fullsized":"2024-08-17T02:27:51.316273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:23.747098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.316539+0000","last_change":"2024-08-17T02:27:51.315083+0000","last_active":"2024-08-17T02:27:51.316539+0000","last_peered":"2024-08-17T02:27:51.316539+0000","last_clean":"2024-08-17T02:27:51.316539+0000","last_became_active":"2024-08-17T02:27:51.314854+0000","last_became_peered":"2024-08-17T02:27:51.314854+0000","last_unstale":"2024-08-17T02:27:51.316539+0000","last_undegraded":"2024-08-17T02:27:51.316539+0000","last_fullsized":"2024-08-17T02:27:51.316539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:51:59.475864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.306255+0000","last_change":"2024-08-17T02:27:50.303023+0000","last_active":"2024-08-17T02:27:51.306255+0000","last_peered":"2024-08-17T02:27:51.306255+0000","last_clean":"2024-08-17T02:27:51.306255+0000","last_became_active":"2024-08-17T02:27:50.302104+0000","last_became_peered":"2024-08-17T02:27:50.302104+0000","last_unstale":"2024-08-17T02:27:51.306255+0000","last_undegraded":"2024-08-17T02:27:51.306255+0000","last_fullsized":"2024-08-17T02:27:51.306255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:37:23.849240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.316569+0000","last_change":"2024-08-17T02:27:51.315498+0000","last_active":"2024-08-17T02:27:51.316569+0000","last_peered":"2024-08-17T02:27:51.316569+0000","last_clean":"2024-08-17T02:27:51.316569+0000","last_became_active":"2024-08-17T02:27:51.315126+0000","last_became_peered":"2024-08-17T02:27:51.315126+0000","last_unstale":"2024-08-17T02:27:51.316569+0000","last_undegraded":"2024-08-17T02:27:51.316569+0000","last_fullsized":"2024-08-17T02:27:51.316569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:46:07.004040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.313049+0000","last_change":"2024-08-17T02:27:50.308330+0000","last_active":"2024-08-17T02:27:51.313049+0000","last_peered":"2024-08-17T02:27:51.313049+0000","last_clean":"2024-08-17T02:27:51.313049+0000","last_became_active":"2024-08-17T02:27:50.307213+0000","last_became_peered":"2024-08-17T02:27:50.307213+0000","last_unstale":"2024-08-17T02:27:51.313049+0000","last_undegraded":"2024-08-17T02:27:51.313049+0000","last_fullsized":"2024-08-17T02:27:51.313049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:52:34.125784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.312570+0000","last_change":"2024-08-17T02:27:51.311099+0000","last_active":"2024-08-17T02:27:51.312570+0000","last_peered":"2024-08-17T02:27:51.312570+0000","last_clean":"2024-08-17T02:27:51.312570+0000","last_became_active":"2024-08-17T02:27:51.310841+0000","last_became_peered":"2024-08-17T02:27:51.310841+0000","last_unstale":"2024-08-17T02:27:51.312570+0000","last_undegraded":"2024-08-17T02:27:51.312570+0000","last_fullsized":"2024-08-17T02:27:51.312570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:17:09.418523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.307309+0000","last_change":"2024-08-17T02:27:50.299166+0000","last_active":"2024-08-17T02:27:51.307309+0000","last_peered":"2024-08-17T02:27:51.307309+0000","last_clean":"2024-08-17T02:27:51.307309+0000","last_became_active":"2024-08-17T02:27:50.297610+0000","last_became_peered":"2024-08-17T02:27:50.297610+0000","last_unstale":"2024-08-17T02:27:51.307309+0000","last_undegraded":"2024-08-17T02:27:51.307309+0000","last_fullsized":"2024-08-17T02:27:51.307309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:29.138877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.304474+0000","last_change":"2024-08-17T02:27:51.295869+0000","last_active":"2024-08-17T02:27:51.304474+0000","last_peered":"2024-08-17T02:27:51.304474+0000","last_clean":"2024-08-17T02:27:51.304474+0000","last_became_active":"2024-08-17T02:27:51.295671+0000","last_became_peered":"2024-08-17T02:27:51.295671+0000","last_unstale":"2024-08-17T02:27:51.304474+0000","last_undegraded":"2024-08-17T02:27:51.304474+0000","last_fullsized":"2024-08-17T02:27:51.304474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:50.266618+0000","last_clean_scrub_stamp":"2024-08-17T02:27:50.266618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:04:36.940627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:27:51.321899+0000","last_change":"2024-08-17T02:27:50.298314+0000","last_active":"2024-08-17T02:27:51.321899+0000","last_peered":"2024-08-17T02:27:51.321899+0000","last_clean":"2024-08-17T02:27:51.321899+0000","last_became_active":"2024-08-17T02:27:50.298019+0000","last_became_peered":"2024-08-17T02:27:50.298019+0000","last_unstale":"2024-08-17T02:27:51.321899+0000","last_undegraded":"2024-08-17T02:27:51.321899+0000","last_fullsized":"2024-08-17T02:27:51.321899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:49.260104+0000","last_clean_scrub_stamp":"2024-08-17T02:27:49.260104+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:29.138877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298148,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073692,"statfs":{"total":96636764160,"available":96331460608,"internally_reserved":0,"allocated":802816,"data_stored":661592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297564,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074276,"statfs":{"total":96636764160,"available":96332058624,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297564,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074276,"statfs":{"total":96636764160,"available":96332058624,"internally_reserved":0,"allocated":204800,"data_stored":70654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298148,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073692,"statfs":{"total":96636764160,"available":96331460608,"internally_reserved":0,"allocated":811008,"data_stored":661648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:28:00.731 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:28:00.731 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-17T02:28:00.732 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-17T02:28:00.732 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-17T02:28:00.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.913+0000 7faad0e00640 1 Processor -- start 2024-08-17T02:28:00.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.913+0000 7faad0e00640 1 -- start start 2024-08-17T02:28:00.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.914+0000 7faad0e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faacc06df00 0x7faacc0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.914+0000 7faad0e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faacc156670 con 0x7faacc155df0 2024-08-17T02:28:00.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.914+0000 7faad0e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faacc06e5e0 con 0x7faacc155a20 2024-08-17T02:28:00.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.914+0000 7faad0e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faacc0b0350 con 0x7faacc06df00 2024-08-17T02:28:00.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.914+0000 7faaca800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7faacc155df0 0x7faacc156b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:46268/0 (socket says 172.21.15.106:46268) 2024-08-17T02:28:00.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.914+0000 7faaca800640 1 -- 172.21.15.106:0/962147463 learned_addr learned my addr 172.21.15.106:0/962147463 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:00.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.915+0000 7faac9400640 1 --2- 172.21.15.106:0/962147463 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faacc06df00 0x7faacc0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.915+0000 7faac8a00640 1 -- 172.21.15.106:0/962147463 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554016664 0 0) 0x7faacc156670 con 0x7faacc155df0 2024-08-17T02:28:00.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.915+0000 7faac8a00640 1 -- 172.21.15.106:0/962147463 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faab00034e0 con 0x7faacc155df0 2024-08-17T02:28:00.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.915+0000 7faac8a00640 1 -- 172.21.15.106:0/962147463 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 898254903 0 0) 0x7faacc06e5e0 con 0x7faacc155a20 2024-08-17T02:28:00.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.915+0000 7faac8a00640 1 -- 172.21.15.106:0/962147463 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faacc156670 con 0x7faacc155a20 2024-08-17T02:28:00.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.915+0000 7faac9400640 1 -- 172.21.15.106:0/962147463 >> v1:172.21.15.171:6789/0 conn(0x7faacc155a20 legacy=0x7faacc06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.915+0000 7faac9400640 1 -- 172.21.15.106:0/962147463 >> v1:172.21.15.106:6789/0 conn(0x7faacc155df0 legacy=0x7faacc156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.915+0000 7faac9400640 1 -- 172.21.15.106:0/962147463 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faacc06e8c0 con 0x7faacc06df00 2024-08-17T02:28:00.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.916+0000 7faac9400640 1 --2- 172.21.15.106:0/962147463 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faacc06df00 0x7faacc0adf10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faab8009880 tx=0x7faab80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=653fe41df634fac6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.916+0000 7faac8a00640 1 -- 172.21.15.106:0/962147463 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab802ae20 con 0x7faacc06df00 2024-08-17T02:28:00.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.916+0000 7faac8a00640 1 -- 172.21.15.106:0/962147463 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab8032440 con 0x7faacc06df00 2024-08-17T02:28:00.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.916+0000 7faac8a00640 1 -- 172.21.15.106:0/962147463 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab80327e0 con 0x7faacc06df00 2024-08-17T02:28:00.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.917+0000 7faad0e00640 1 -- 172.21.15.106:0/962147463 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faacc06df00 msgr2=0x7faacc0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.917+0000 7faad0e00640 1 --2- 172.21.15.106:0/962147463 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faacc06df00 0x7faacc0adf10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faab8009880 tx=0x7faab80090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.917+0000 7faad0e00640 1 -- 172.21.15.106:0/962147463 shutdown_connections 2024-08-17T02:28:00.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.917+0000 7faad0e00640 1 --2- 172.21.15.106:0/962147463 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faacc06df00 0x7faacc0adf10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.917+0000 7faad0e00640 1 -- 172.21.15.106:0/962147463 >> 172.21.15.106:0/962147463 conn(0x7faacc0cb9b0 msgr2=0x7faacc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:00.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.917+0000 7faad0e00640 1 -- 172.21.15.106:0/962147463 shutdown_connections 2024-08-17T02:28:00.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.917+0000 7faad0e00640 1 -- 172.21.15.106:0/962147463 wait complete. 2024-08-17T02:28:00.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.918+0000 7faad0e00640 1 Processor -- start 2024-08-17T02:28:00.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.919+0000 7faad0e00640 1 -- start start 2024-08-17T02:28:00.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.919+0000 7faad0e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faacc06df00 0x7faacc157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.919+0000 7faad0e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faacc155a20 0x7faacc0cae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.919+0000 7faad0e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faacc155df0 0x7faacc0cb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.919+0000 7faad0e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faacc143d20 con 0x7faacc155a20 2024-08-17T02:28:00.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.919+0000 7faad0e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faacc143fb0 con 0x7faacc06df00 2024-08-17T02:28:00.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.919+0000 7faad0e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faacc16d2d0 con 0x7faacc155df0 2024-08-17T02:28:00.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.920+0000 7faac9400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faacc155a20 0x7faacc0cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.920+0000 7faac9400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faacc155a20 0x7faacc0cae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53476/0 (socket says 172.21.15.106:53476) 2024-08-17T02:28:00.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.920+0000 7faac9400640 1 -- 172.21.15.106:0/2578643188 learned_addr learned my addr 172.21.15.106:0/2578643188 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:00.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.920+0000 7faaca800640 1 --2- 172.21.15.106:0/2578643188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faacc155df0 0x7faacc0cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.920+0000 7faac9e00640 1 --2- 172.21.15.106:0/2578643188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faacc06df00 0x7faacc157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.920+0000 7faac9400640 1 -- 172.21.15.106:0/2578643188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faacc155df0 msgr2=0x7faacc0cb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.920+0000 7faac9400640 1 --2- 172.21.15.106:0/2578643188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faacc155df0 0x7faacc0cb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.920+0000 7faac9400640 1 -- 172.21.15.106:0/2578643188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faacc06df00 msgr2=0x7faacc157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:00.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.920+0000 7faac9400640 1 --2- 172.21.15.106:0/2578643188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faacc06df00 0x7faacc157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:00.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.920+0000 7faac9400640 1 -- 172.21.15.106:0/2578643188 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab8009390 con 0x7faacc155a20 2024-08-17T02:28:00.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.920+0000 7faac9e00640 1 --2- 172.21.15.106:0/2578643188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faacc06df00 0x7faacc157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:00.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.920+0000 7faac9400640 1 --2- 172.21.15.106:0/2578643188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faacc155a20 0x7faacc0cae20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faab8009880 tx=0x7faab8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.921+0000 7faac1600640 1 -- 172.21.15.106:0/2578643188 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab8000c40 con 0x7faacc155a20 2024-08-17T02:28:00.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.921+0000 7faac1600640 1 -- 172.21.15.106:0/2578643188 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab8031a60 con 0x7faacc155a20 2024-08-17T02:28:00.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.921+0000 7faac1600640 1 -- 172.21.15.106:0/2578643188 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab8031e20 con 0x7faacc155a20 2024-08-17T02:28:00.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.921+0000 7faad0e00640 1 -- 172.21.15.106:0/2578643188 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faacc0a9f10 con 0x7faacc155a20 2024-08-17T02:28:00.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.921+0000 7faad0e00640 1 -- 172.21.15.106:0/2578643188 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faacc0aa4d0 con 0x7faacc155a20 2024-08-17T02:28:00.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.922+0000 7faad0e00640 1 -- 172.21.15.106:0/2578643188 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faacc064db0 con 0x7faacc155a20 2024-08-17T02:28:00.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.922+0000 7faac1600640 1 -- 172.21.15.106:0/2578643188 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7faab8039040 con 0x7faacc155a20 2024-08-17T02:28:00.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.923+0000 7faac1600640 1 --2- 172.21.15.106:0/2578643188 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7faaac065150 0x7faaac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:00.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.923+0000 7faac1600640 1 -- 172.21.15.106:0/2578643188 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faab80a1f20 con 0x7faacc155a20 2024-08-17T02:28:00.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.923+0000 7faac9e00640 1 --2- 172.21.15.106:0/2578643188 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7faaac065150 0x7faaac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:00.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.924+0000 7faac9e00640 1 --2- 172.21.15.106:0/2578643188 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7faaac065150 0x7faaac067600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faabc003900 tx=0x7faabc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:00.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:00.927+0000 7faac1600640 1 -- 172.21.15.106:0/2578643188 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7faab806fff0 con 0x7faacc155a20 2024-08-17T02:28:01.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.137+0000 7faad0e00640 1 -- 172.21.15.106:0/2578643188 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7faacc154500 con 0x7faacc155a20 2024-08-17T02:28:01.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.137+0000 7faac1600640 1 -- 172.21.15.106:0/2578643188 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7faab8073610 con 0x7faacc155a20 2024-08-17T02:28:01.138 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:01.138 INFO:teuthology.orchestra.run.smithi106.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-17T02:28:01.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.139+0000 7faad0e00640 1 -- 172.21.15.106:0/2578643188 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7faaac065150 msgr2=0x7faaac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.139+0000 7faad0e00640 1 --2- 172.21.15.106:0/2578643188 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7faaac065150 0x7faaac067600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faabc003900 tx=0x7faabc009040 comp rx=0 tx=0).stop 2024-08-17T02:28:01.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.139+0000 7faad0e00640 1 -- 172.21.15.106:0/2578643188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faacc155a20 msgr2=0x7faacc0cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.139+0000 7faad0e00640 1 --2- 172.21.15.106:0/2578643188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faacc155a20 0x7faacc0cae20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faab8009880 tx=0x7faab8032000 comp rx=0 tx=0).stop 2024-08-17T02:28:01.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.140+0000 7faad0e00640 1 -- 172.21.15.106:0/2578643188 shutdown_connections 2024-08-17T02:28:01.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.140+0000 7faad0e00640 1 --2- 172.21.15.106:0/2578643188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faacc155df0 0x7faacc0cb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.140+0000 7faad0e00640 1 --2- 172.21.15.106:0/2578643188 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7faaac065150 0x7faaac067600 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.140+0000 7faad0e00640 1 --2- 172.21.15.106:0/2578643188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faacc155a20 0x7faacc0cae20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.140+0000 7faad0e00640 1 --2- 172.21.15.106:0/2578643188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faacc06df00 0x7faacc157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.140+0000 7faad0e00640 1 -- 172.21.15.106:0/2578643188 >> 172.21.15.106:0/2578643188 conn(0x7faacc0cb9b0 msgr2=0x7faacc154d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:01.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.140+0000 7faad0e00640 1 -- 172.21.15.106:0/2578643188 shutdown_connections 2024-08-17T02:28:01.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.140+0000 7faad0e00640 1 -- 172.21.15.106:0/2578643188 wait complete. 2024-08-17T02:28:01.154 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-17T02:28:01.155 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:01.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.301+0000 7fa18d800640 1 Processor -- start 2024-08-17T02:28:01.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.301+0000 7fa18d800640 1 -- start start 2024-08-17T02:28:01.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.302+0000 7fa18d800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa1881401b0 0x7fa1880caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.303+0000 7fa18d800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1880caa80 con 0x7fa188140580 2024-08-17T02:28:01.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.303+0000 7fa18d800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1880c9e70 con 0x7fa1880b1440 2024-08-17T02:28:01.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.303+0000 7fa18d800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1880cb450 con 0x7fa1881401b0 2024-08-17T02:28:01.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.303+0000 7fa17e000640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa188140580 0x7fa1880b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:46280/0 (socket says 172.21.15.106:46280) 2024-08-17T02:28:01.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.303+0000 7fa17e000640 1 -- 172.21.15.106:0/2405923573 learned_addr learned my addr 172.21.15.106:0/2405923573 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:01.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.303+0000 7fa186a00640 1 --2- 172.21.15.106:0/2405923573 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa1881401b0 0x7fa1880caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.303+0000 7fa186000640 1 -- 172.21.15.106:0/2405923573 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 20879641 0 0) 0x7fa1880caa80 con 0x7fa188140580 2024-08-17T02:28:01.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.303+0000 7fa186000640 1 -- 172.21.15.106:0/2405923573 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa16c0034e0 con 0x7fa188140580 2024-08-17T02:28:01.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.303+0000 7fa186000640 1 -- 172.21.15.106:0/2405923573 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1051867977 0 0) 0x7fa1880c9e70 con 0x7fa1880b1440 2024-08-17T02:28:01.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.303+0000 7fa186000640 1 -- 172.21.15.106:0/2405923573 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1880caa80 con 0x7fa1880b1440 2024-08-17T02:28:01.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.303+0000 7fa186a00640 1 -- 172.21.15.106:0/2405923573 >> v1:172.21.15.171:6789/0 conn(0x7fa1880b1440 legacy=0x7fa1880c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.303+0000 7fa186a00640 1 -- 172.21.15.106:0/2405923573 >> v1:172.21.15.106:6789/0 conn(0x7fa188140580 legacy=0x7fa1880b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.303+0000 7fa186a00640 1 -- 172.21.15.106:0/2405923573 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1880ca150 con 0x7fa1881401b0 2024-08-17T02:28:01.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.305+0000 7fa186a00640 1 --2- 172.21.15.106:0/2405923573 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa1881401b0 0x7fa1880caf10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa178009880 tx=0x7fa1780090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a6e2ca1c4b08c10 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.305+0000 7fa186000640 1 -- 172.21.15.106:0/2405923573 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17802ad80 con 0x7fa1881401b0 2024-08-17T02:28:01.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.305+0000 7fa186000640 1 -- 172.21.15.106:0/2405923573 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa178032440 con 0x7fa1881401b0 2024-08-17T02:28:01.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.305+0000 7fa186000640 1 -- 172.21.15.106:0/2405923573 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1780327e0 con 0x7fa1881401b0 2024-08-17T02:28:01.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.305+0000 7fa18d800640 1 -- 172.21.15.106:0/2405923573 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa1881401b0 msgr2=0x7fa1880caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.305+0000 7fa18d800640 1 --2- 172.21.15.106:0/2405923573 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa1881401b0 0x7fa1880caf10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa178009880 tx=0x7fa1780090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.305+0000 7fa18d800640 1 -- 172.21.15.106:0/2405923573 shutdown_connections 2024-08-17T02:28:01.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.305+0000 7fa18d800640 1 --2- 172.21.15.106:0/2405923573 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa1881401b0 0x7fa1880caf10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.305+0000 7fa18d800640 1 -- 172.21.15.106:0/2405923573 >> 172.21.15.106:0/2405923573 conn(0x7fa1880cb9b0 msgr2=0x7fa1880cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:01.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.306+0000 7fa18d800640 1 -- 172.21.15.106:0/2405923573 shutdown_connections 2024-08-17T02:28:01.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.306+0000 7fa18d800640 1 -- 172.21.15.106:0/2405923573 wait complete. 2024-08-17T02:28:01.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.307+0000 7fa18d800640 1 Processor -- start 2024-08-17T02:28:01.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.307+0000 7fa18d800640 1 -- start start 2024-08-17T02:28:01.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.308+0000 7fa18d800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1880b1440 0x7fa188156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.308+0000 7fa18d800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1881401b0 0x7fa18815d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.308+0000 7fa18d800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa188140580 0x7fa18815dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.308+0000 7fa18d800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa188131770 con 0x7fa1880b1440 2024-08-17T02:28:01.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.308+0000 7fa18d800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa188130b60 con 0x7fa1881401b0 2024-08-17T02:28:01.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.308+0000 7fa18d800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa188130e40 con 0x7fa188140580 2024-08-17T02:28:01.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.308+0000 7fa186a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1880b1440 0x7fa188156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.308+0000 7fa186a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1880b1440 0x7fa188156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53482/0 (socket says 172.21.15.106:53482) 2024-08-17T02:28:01.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.308+0000 7fa186a00640 1 -- 172.21.15.106:0/470751429 learned_addr learned my addr 172.21.15.106:0/470751429 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:01.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.308+0000 7fa187400640 1 --2- 172.21.15.106:0/470751429 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa188140580 0x7fa18815dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.308+0000 7fa17e000640 1 --2- 172.21.15.106:0/470751429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1881401b0 0x7fa18815d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.308+0000 7fa186a00640 1 -- 172.21.15.106:0/470751429 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa188140580 msgr2=0x7fa18815dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.308+0000 7fa186a00640 1 --2- 172.21.15.106:0/470751429 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa188140580 0x7fa18815dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.308+0000 7fa186a00640 1 -- 172.21.15.106:0/470751429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1881401b0 msgr2=0x7fa18815d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.308+0000 7fa186a00640 1 --2- 172.21.15.106:0/470751429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1881401b0 0x7fa18815d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.308+0000 7fa186a00640 1 -- 172.21.15.106:0/470751429 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa178009390 con 0x7fa1880b1440 2024-08-17T02:28:01.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.309+0000 7fa17e000640 1 --2- 172.21.15.106:0/470751429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1881401b0 0x7fa18815d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:01.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.309+0000 7fa186a00640 1 --2- 172.21.15.106:0/470751429 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1880b1440 0x7fa188156170 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa1780097d0 tx=0x7fa178032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.309+0000 7fa17ea00640 1 -- 172.21.15.106:0/470751429 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa178000c40 con 0x7fa1880b1440 2024-08-17T02:28:01.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.309+0000 7fa17ea00640 1 -- 172.21.15.106:0/470751429 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa178031a60 con 0x7fa1880b1440 2024-08-17T02:28:01.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.309+0000 7fa18d800640 1 -- 172.21.15.106:0/470751429 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa188131120 con 0x7fa1880b1440 2024-08-17T02:28:01.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.309+0000 7fa17ea00640 1 -- 172.21.15.106:0/470751429 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa178031de0 con 0x7fa1880b1440 2024-08-17T02:28:01.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.309+0000 7fa18d800640 1 -- 172.21.15.106:0/470751429 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa188169090 con 0x7fa1880b1440 2024-08-17T02:28:01.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.310+0000 7fa18d800640 1 -- 172.21.15.106:0/470751429 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa188064db0 con 0x7fa1880b1440 2024-08-17T02:28:01.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.311+0000 7fa17ea00640 1 -- 172.21.15.106:0/470751429 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa178039040 con 0x7fa1880b1440 2024-08-17T02:28:01.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.312+0000 7fa17ea00640 1 --2- 172.21.15.106:0/470751429 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa164065150 0x7fa164067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.312+0000 7fa17ea00640 1 -- 172.21.15.106:0/470751429 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa1780a23c0 con 0x7fa1880b1440 2024-08-17T02:28:01.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.312+0000 7fa17e000640 1 --2- 172.21.15.106:0/470751429 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa164065150 0x7fa164067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.313+0000 7fa17e000640 1 --2- 172.21.15.106:0/470751429 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa164065150 0x7fa164067600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa18815b540 tx=0x7fa170009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.316+0000 7fa17ea00640 1 -- 172.21.15.106:0/470751429 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa1780703e0 con 0x7fa1880b1440 2024-08-17T02:28:01.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.490+0000 7fa18d800640 1 -- 172.21.15.106:0/470751429 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1880b0cd0 con 0x7fa1880b1440 2024-08-17T02:28:01.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.491+0000 7fa17ea00640 1 -- 172.21.15.106:0/470751429 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fa178073a00 con 0x7fa1880b1440 2024-08-17T02:28:01.491 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:01.491 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:27:52.284039+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:48.547438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:49.671073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:01.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.493+0000 7fa18d800640 1 -- 172.21.15.106:0/470751429 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa164065150 msgr2=0x7fa164067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.493+0000 7fa18d800640 1 --2- 172.21.15.106:0/470751429 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa164065150 0x7fa164067600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa18815b540 tx=0x7fa170009040 comp rx=0 tx=0).stop 2024-08-17T02:28:01.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.493+0000 7fa18d800640 1 -- 172.21.15.106:0/470751429 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1880b1440 msgr2=0x7fa188156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.493+0000 7fa18d800640 1 --2- 172.21.15.106:0/470751429 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1880b1440 0x7fa188156170 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa1780097d0 tx=0x7fa178032000 comp rx=0 tx=0).stop 2024-08-17T02:28:01.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.493+0000 7fa18d800640 1 -- 172.21.15.106:0/470751429 shutdown_connections 2024-08-17T02:28:01.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.493+0000 7fa18d800640 1 --2- 172.21.15.106:0/470751429 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa188140580 0x7fa18815dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.493+0000 7fa18d800640 1 --2- 172.21.15.106:0/470751429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa1881401b0 0x7fa18815d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.493+0000 7fa18d800640 1 --2- 172.21.15.106:0/470751429 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa164065150 0x7fa164067600 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.493+0000 7fa18d800640 1 --2- 172.21.15.106:0/470751429 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1880b1440 0x7fa188156170 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.493+0000 7fa18d800640 1 -- 172.21.15.106:0/470751429 >> 172.21.15.106:0/470751429 conn(0x7fa1880cb9b0 msgr2=0x7fa1880af780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:01.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.493+0000 7fa18d800640 1 -- 172.21.15.106:0/470751429 shutdown_connections 2024-08-17T02:28:01.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.493+0000 7fa18d800640 1 -- 172.21.15.106:0/470751429 wait complete. 2024-08-17T02:28:01.508 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:37.928826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:48.547438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:49.671073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:28:01.509 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:28:01.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.658+0000 7fd74d600640 1 Processor -- start 2024-08-17T02:28:01.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.658+0000 7fd74d600640 1 -- start start 2024-08-17T02:28:01.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.659+0000 7fd74d600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd7480b5840 0x7fd7480b3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.659+0000 7fd74d600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7480b40d0 0x7fd7480cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.659+0000 7fd74d600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7480b2700 con 0x7fd7480b2db0 2024-08-17T02:28:01.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.659+0000 7fd74d600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7480b5cb0 con 0x7fd7480b5840 2024-08-17T02:28:01.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.659+0000 7fd74d600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7480b1940 con 0x7fd7480b40d0 2024-08-17T02:28:01.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.660+0000 7fd747400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7480b40d0 0x7fd7480cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.660+0000 7fd747400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7480b40d0 0x7fd7480cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:38930/0 (socket says 172.21.15.106:38930) 2024-08-17T02:28:01.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.660+0000 7fd747400640 1 -- 172.21.15.106:0/1692300522 learned_addr learned my addr 172.21.15.106:0/1692300522 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:01.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.660+0000 7fd746a00640 1 --1- 172.21.15.106:0/1692300522 >> v1:172.21.15.171:6789/0 conn(0x7fd7480b2db0 0x7fd7480cef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:47662/0 (socket says 172.21.15.106:47662) 2024-08-17T02:28:01.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.660+0000 7fd746000640 1 --2- 172.21.15.106:0/1692300522 >> v2:172.21.15.171:3300/0 conn(0x7fd7480b5840 0x7fd7480b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.660+0000 7fd747400640 1 -- 172.21.15.106:0/1692300522 >> v2:172.21.15.171:3300/0 conn(0x7fd7480b5840 msgr2=0x7fd7480b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:01.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.660+0000 7fd747400640 1 --2- 172.21.15.106:0/1692300522 >> v2:172.21.15.171:3300/0 conn(0x7fd7480b5840 0x7fd7480b3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.660+0000 7fd745600640 1 -- 172.21.15.106:0/1692300522 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 785453274 0 0) 0x7fd7480b2700 con 0x7fd7480b2db0 2024-08-17T02:28:01.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.660+0000 7fd747400640 1 -- 172.21.15.106:0/1692300522 >> v1:172.21.15.171:6789/0 conn(0x7fd7480b2db0 legacy=0x7fd7480cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.660+0000 7fd747400640 1 -- 172.21.15.106:0/1692300522 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7480b1c20 con 0x7fd7480b40d0 2024-08-17T02:28:01.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.661+0000 7fd747400640 1 --2- 172.21.15.106:0/1692300522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7480b40d0 0x7fd7480cf640 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd740009f20 tx=0x7fd740009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98848de86af166b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.662+0000 7fd745600640 1 -- 172.21.15.106:0/1692300522 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd740031400 con 0x7fd7480b40d0 2024-08-17T02:28:01.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.662+0000 7fd745600640 1 -- 172.21.15.106:0/1692300522 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74002d050 con 0x7fd7480b40d0 2024-08-17T02:28:01.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.662+0000 7fd745600640 1 -- 172.21.15.106:0/1692300522 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd740031790 con 0x7fd7480b40d0 2024-08-17T02:28:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.662+0000 7fd74d600640 1 -- 172.21.15.106:0/1692300522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7480b40d0 msgr2=0x7fd7480cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.662+0000 7fd74d600640 1 --2- 172.21.15.106:0/1692300522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7480b40d0 0x7fd7480cf640 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd740009f20 tx=0x7fd740009840 comp rx=0 tx=0).stop 2024-08-17T02:28:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.662+0000 7fd74d600640 1 -- 172.21.15.106:0/1692300522 shutdown_connections 2024-08-17T02:28:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.662+0000 7fd74d600640 1 --2- 172.21.15.106:0/1692300522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7480b40d0 0x7fd7480cf640 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.662+0000 7fd74d600640 1 --2- 172.21.15.106:0/1692300522 >> v2:172.21.15.171:3300/0 conn(0x7fd7480b5840 0x7fd7480b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.662+0000 7fd74d600640 1 -- 172.21.15.106:0/1692300522 >> 172.21.15.106:0/1692300522 conn(0x7fd7480cfdc0 msgr2=0x7fd7480d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.662+0000 7fd74d600640 1 -- 172.21.15.106:0/1692300522 shutdown_connections 2024-08-17T02:28:01.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.662+0000 7fd74d600640 1 -- 172.21.15.106:0/1692300522 wait complete. 2024-08-17T02:28:01.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.664+0000 7fd74d600640 1 Processor -- start 2024-08-17T02:28:01.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.664+0000 7fd74d600640 1 -- start start 2024-08-17T02:28:01.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.665+0000 7fd74d600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7480b2db0 0x7fd748099a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.665+0000 7fd74d600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7480b40d0 0x7fd748169510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.665+0000 7fd74d600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7480b5840 0x7fd74815e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.665+0000 7fd74d600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74809a9f0 con 0x7fd7480b40d0 2024-08-17T02:28:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.665+0000 7fd74d600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd748169a50 con 0x7fd7480b5840 2024-08-17T02:28:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.665+0000 7fd74d600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd74809a150 con 0x7fd7480b2db0 2024-08-17T02:28:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.665+0000 7fd746000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7480b40d0 0x7fd748169510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.665+0000 7fd746000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7480b40d0 0x7fd748169510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53494/0 (socket says 172.21.15.106:53494) 2024-08-17T02:28:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.665+0000 7fd746000640 1 -- 172.21.15.106:0/1332684760 learned_addr learned my addr 172.21.15.106:0/1332684760 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.665+0000 7fd746a00640 1 --2- 172.21.15.106:0/1332684760 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7480b2db0 0x7fd748099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.665+0000 7fd747400640 1 --2- 172.21.15.106:0/1332684760 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7480b5840 0x7fd74815e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.665+0000 7fd746000640 1 -- 172.21.15.106:0/1332684760 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7480b2db0 msgr2=0x7fd748099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.665+0000 7fd746000640 1 --2- 172.21.15.106:0/1332684760 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7480b2db0 0x7fd748099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.665+0000 7fd746000640 1 -- 172.21.15.106:0/1332684760 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7480b5840 msgr2=0x7fd74815e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.665+0000 7fd746000640 1 --2- 172.21.15.106:0/1332684760 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7480b5840 0x7fd74815e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.665+0000 7fd746000640 1 -- 172.21.15.106:0/1332684760 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd740009ae0 con 0x7fd7480b40d0 2024-08-17T02:28:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.666+0000 7fd746000640 1 --2- 172.21.15.106:0/1332684760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7480b40d0 0x7fd748169510 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd73400e900 tx=0x7fd7340090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.666+0000 7fd73e000640 1 -- 172.21.15.106:0/1332684760 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7340094a0 con 0x7fd7480b40d0 2024-08-17T02:28:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.666+0000 7fd73e000640 1 -- 172.21.15.106:0/1332684760 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73400c940 con 0x7fd7480b40d0 2024-08-17T02:28:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.666+0000 7fd74d600640 1 -- 172.21.15.106:0/1332684760 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd74809a430 con 0x7fd7480b40d0 2024-08-17T02:28:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.666+0000 7fd73e000640 1 -- 172.21.15.106:0/1332684760 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73400cd00 con 0x7fd7480b40d0 2024-08-17T02:28:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.666+0000 7fd74d600640 1 -- 172.21.15.106:0/1332684760 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd748169d70 con 0x7fd7480b40d0 2024-08-17T02:28:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.667+0000 7fd74d600640 1 -- 172.21.15.106:0/1332684760 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd748064db0 con 0x7fd7480b40d0 2024-08-17T02:28:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.668+0000 7fd73e000640 1 -- 172.21.15.106:0/1332684760 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd734013680 con 0x7fd7480b40d0 2024-08-17T02:28:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.670+0000 7fd73e000640 1 --2- 172.21.15.106:0/1332684760 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd728065150 0x7fd728067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.670+0000 7fd73e000640 1 -- 172.21.15.106:0/1332684760 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd734082520 con 0x7fd7480b40d0 2024-08-17T02:28:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.670+0000 7fd746a00640 1 --2- 172.21.15.106:0/1332684760 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd728065150 0x7fd728067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.670+0000 7fd746a00640 1 --2- 172.21.15.106:0/1332684760 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd728065150 0x7fd728067600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd74815fd30 tx=0x7fd738007cc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.674+0000 7fd73e000640 1 -- 172.21.15.106:0/1332684760 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd734050670 con 0x7fd7480b40d0 2024-08-17T02:28:01.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.845+0000 7fd74d600640 1 -- 172.21.15.106:0/1332684760 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd7480af4d0 con 0x7fd7480b40d0 2024-08-17T02:28:01.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.845+0000 7fd73e000640 1 -- 172.21.15.106:0/1332684760 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd734053c90 con 0x7fd7480b40d0 2024-08-17T02:28:01.846 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-08-17T02:28:01.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.847+0000 7fd74d600640 1 -- 172.21.15.106:0/1332684760 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd728065150 msgr2=0x7fd728067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.847+0000 7fd74d600640 1 --2- 172.21.15.106:0/1332684760 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd728065150 0x7fd728067600 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd74815fd30 tx=0x7fd738007cc0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.847+0000 7fd74d600640 1 -- 172.21.15.106:0/1332684760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7480b40d0 msgr2=0x7fd748169510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.847+0000 7fd74d600640 1 --2- 172.21.15.106:0/1332684760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7480b40d0 0x7fd748169510 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd73400e900 tx=0x7fd7340090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.848+0000 7fd74d600640 1 -- 172.21.15.106:0/1332684760 shutdown_connections 2024-08-17T02:28:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.848+0000 7fd74d600640 1 --2- 172.21.15.106:0/1332684760 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd7480b5840 0x7fd74815e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.848+0000 7fd74d600640 1 --2- 172.21.15.106:0/1332684760 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd728065150 0x7fd728067600 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.848+0000 7fd74d600640 1 --2- 172.21.15.106:0/1332684760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7480b40d0 0x7fd748169510 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.848+0000 7fd74d600640 1 --2- 172.21.15.106:0/1332684760 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd7480b2db0 0x7fd748099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.848+0000 7fd74d600640 1 -- 172.21.15.106:0/1332684760 >> 172.21.15.106:0/1332684760 conn(0x7fd7480cfdc0 msgr2=0x7fd7480af780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.848+0000 7fd74d600640 1 -- 172.21.15.106:0/1332684760 shutdown_connections 2024-08-17T02:28:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:01.848+0000 7fd74d600640 1 -- 172.21.15.106:0/1332684760 wait complete. 2024-08-17T02:28:01.863 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:28:02.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.013+0000 7f0a2a200640 1 Processor -- start 2024-08-17T02:28:02.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.013+0000 7f0a2a200640 1 -- start start 2024-08-17T02:28:02.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.014+0000 7f0a2a200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a2415c1f0 0x7f0a24096a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.014+0000 7f0a2a200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0a2415c5c0 0x7f0a24096fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.014+0000 7f0a2a200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a240ad290 con 0x7f0a240ab5a0 2024-08-17T02:28:02.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.014+0000 7f0a2a200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a240ac130 con 0x7f0a2415c5c0 2024-08-17T02:28:02.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.014+0000 7f0a2a200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a240b0e20 con 0x7f0a2415c1f0 2024-08-17T02:28:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.015+0000 7f0a23400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a2415c1f0 0x7f0a24096a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.015+0000 7f0a1be00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0a2415c5c0 0x7f0a24096fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.015+0000 7f0a23400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a2415c1f0 0x7f0a24096a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:38944/0 (socket says 172.21.15.106:38944) 2024-08-17T02:28:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.015+0000 7f0a23400640 1 -- 172.21.15.106:0/183988659 learned_addr learned my addr 172.21.15.106:0/183988659 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.015+0000 7f0a23e00640 1 --1- 172.21.15.106:0/183988659 >> v1:172.21.15.171:6789/0 conn(0x7f0a240ab5a0 0x7f0a240aba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:47674/0 (socket says 172.21.15.106:47674) 2024-08-17T02:28:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.015+0000 7f0a23400640 1 -- 172.21.15.106:0/183988659 >> v2:172.21.15.171:3300/0 conn(0x7f0a2415c5c0 msgr2=0x7f0a24096fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.015+0000 7f0a23400640 1 --2- 172.21.15.106:0/183988659 >> v2:172.21.15.171:3300/0 conn(0x7f0a2415c5c0 0x7f0a24096fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.015+0000 7f0a23400640 1 -- 172.21.15.106:0/183988659 >> v1:172.21.15.171:6789/0 conn(0x7f0a240ab5a0 legacy=0x7f0a240aba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.015+0000 7f0a23400640 1 -- 172.21.15.106:0/183988659 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a240ac370 con 0x7f0a2415c1f0 2024-08-17T02:28:02.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.016+0000 7f0a23400640 1 --2- 172.21.15.106:0/183988659 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a2415c1f0 0x7f0a24096a70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0a14009910 tx=0x7f0a140091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a454bea2de0ef839 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.017+0000 7f0a22a00640 1 -- 172.21.15.106:0/183988659 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1402ae40 con 0x7f0a2415c1f0 2024-08-17T02:28:02.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.017+0000 7f0a22a00640 1 -- 172.21.15.106:0/183988659 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a14032440 con 0x7f0a2415c1f0 2024-08-17T02:28:02.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.017+0000 7f0a22a00640 1 -- 172.21.15.106:0/183988659 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a14032820 con 0x7f0a2415c1f0 2024-08-17T02:28:02.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.017+0000 7f0a2a200640 1 -- 172.21.15.106:0/183988659 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a2415c1f0 msgr2=0x7f0a24096a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.017+0000 7f0a2a200640 1 --2- 172.21.15.106:0/183988659 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a2415c1f0 0x7f0a24096a70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0a14009910 tx=0x7f0a140091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.017+0000 7f0a2a200640 1 -- 172.21.15.106:0/183988659 shutdown_connections 2024-08-17T02:28:02.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.017+0000 7f0a2a200640 1 --2- 172.21.15.106:0/183988659 >> v2:172.21.15.171:3300/0 conn(0x7f0a2415c5c0 0x7f0a24096fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.017+0000 7f0a2a200640 1 --2- 172.21.15.106:0/183988659 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a2415c1f0 0x7f0a24096a70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.017+0000 7f0a2a200640 1 -- 172.21.15.106:0/183988659 >> 172.21.15.106:0/183988659 conn(0x7f0a240b2fd0 msgr2=0x7f0a240b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:02.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.017+0000 7f0a2a200640 1 -- 172.21.15.106:0/183988659 shutdown_connections 2024-08-17T02:28:02.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.017+0000 7f0a2a200640 1 -- 172.21.15.106:0/183988659 wait complete. 2024-08-17T02:28:02.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.019+0000 7f0a2a200640 1 Processor -- start 2024-08-17T02:28:02.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.019+0000 7f0a2a200640 1 -- start start 2024-08-17T02:28:02.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.020+0000 7f0a2a200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a240ab5a0 0x7f0a240afb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.020+0000 7f0a2a200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a2415c1f0 0x7f0a240c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.020+0000 7f0a2a200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a2415c5c0 0x7f0a240c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.020+0000 7f0a2a200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a240ae770 con 0x7f0a2415c1f0 2024-08-17T02:28:02.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.020+0000 7f0a2a200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2414cec0 con 0x7f0a2415c5c0 2024-08-17T02:28:02.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.020+0000 7f0a2a200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a240ad6d0 con 0x7f0a240ab5a0 2024-08-17T02:28:02.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.020+0000 7f0a1be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a2415c1f0 0x7f0a240c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.020+0000 7f0a1be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a2415c1f0 0x7f0a240c73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53510/0 (socket says 172.21.15.106:53510) 2024-08-17T02:28:02.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.020+0000 7f0a1be00640 1 -- 172.21.15.106:0/972201191 learned_addr learned my addr 172.21.15.106:0/972201191 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:02.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.020+0000 7f0a23400640 1 --2- 172.21.15.106:0/972201191 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a240ab5a0 0x7f0a240afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.020+0000 7f0a23e00640 1 --2- 172.21.15.106:0/972201191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a2415c5c0 0x7f0a240c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.020+0000 7f0a1be00640 1 -- 172.21.15.106:0/972201191 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a240ab5a0 msgr2=0x7f0a240afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.020+0000 7f0a1be00640 1 --2- 172.21.15.106:0/972201191 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a240ab5a0 0x7f0a240afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.020+0000 7f0a1be00640 1 -- 172.21.15.106:0/972201191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a2415c5c0 msgr2=0x7f0a240c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.020+0000 7f0a1be00640 1 --2- 172.21.15.106:0/972201191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a2415c5c0 0x7f0a240c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.020+0000 7f0a1be00640 1 -- 172.21.15.106:0/972201191 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a14009450 con 0x7f0a2415c1f0 2024-08-17T02:28:02.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.021+0000 7f0a1be00640 1 --2- 172.21.15.106:0/972201191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a2415c1f0 0x7f0a240c73c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c00e900 tx=0x7f0a0c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.021+0000 7f0a1aa00640 1 -- 172.21.15.106:0/972201191 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c00c8e0 con 0x7f0a2415c1f0 2024-08-17T02:28:02.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.021+0000 7f0a1aa00640 1 -- 172.21.15.106:0/972201191 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0c00ca40 con 0x7f0a2415c1f0 2024-08-17T02:28:02.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.021+0000 7f0a1aa00640 1 -- 172.21.15.106:0/972201191 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c00cde0 con 0x7f0a2415c1f0 2024-08-17T02:28:02.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.021+0000 7f0a2a200640 1 -- 172.21.15.106:0/972201191 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a240ad9b0 con 0x7f0a2415c1f0 2024-08-17T02:28:02.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.021+0000 7f0a2a200640 1 -- 172.21.15.106:0/972201191 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a240ae250 con 0x7f0a2415c1f0 2024-08-17T02:28:02.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.022+0000 7f0a2a200640 1 -- 172.21.15.106:0/972201191 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a24071050 con 0x7f0a2415c1f0 2024-08-17T02:28:02.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.023+0000 7f0a1aa00640 1 -- 172.21.15.106:0/972201191 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0a0c013680 con 0x7f0a2415c1f0 2024-08-17T02:28:02.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.024+0000 7f0a1aa00640 1 --2- 172.21.15.106:0/972201191 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0a00065150 0x7f0a00067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.024+0000 7f0a1aa00640 1 -- 172.21.15.106:0/972201191 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0a0c0826a0 con 0x7f0a2415c1f0 2024-08-17T02:28:02.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.024+0000 7f0a23400640 1 --2- 172.21.15.106:0/972201191 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0a00065150 0x7f0a00067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.024+0000 7f0a23400640 1 --2- 172.21.15.106:0/972201191 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0a00065150 0x7f0a00067600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0a14034000 tx=0x7f0a14032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.027+0000 7f0a1aa00640 1 -- 172.21.15.106:0/972201191 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0a0c050780 con 0x7f0a2415c1f0 2024-08-17T02:28:02.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.199+0000 7f0a2a200640 1 -- 172.21.15.106:0/972201191 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a240adba0 con 0x7f0a2415c1f0 2024-08-17T02:28:02.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.199+0000 7f0a1aa00640 1 -- 172.21.15.106:0/972201191 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0a0c053da0 con 0x7f0a2415c1f0 2024-08-17T02:28:02.200 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-08-17T02:28:02.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.201+0000 7f0a2a200640 1 -- 172.21.15.106:0/972201191 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0a00065150 msgr2=0x7f0a00067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.201+0000 7f0a2a200640 1 --2- 172.21.15.106:0/972201191 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0a00065150 0x7f0a00067600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0a14034000 tx=0x7f0a14032000 comp rx=0 tx=0).stop 2024-08-17T02:28:02.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.201+0000 7f0a2a200640 1 -- 172.21.15.106:0/972201191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a2415c1f0 msgr2=0x7f0a240c73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.201+0000 7f0a2a200640 1 --2- 172.21.15.106:0/972201191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a2415c1f0 0x7f0a240c73c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c00e900 tx=0x7f0a0c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.201+0000 7f0a2a200640 1 -- 172.21.15.106:0/972201191 shutdown_connections 2024-08-17T02:28:02.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.201+0000 7f0a2a200640 1 --2- 172.21.15.106:0/972201191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a2415c5c0 0x7f0a240c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.201+0000 7f0a2a200640 1 --2- 172.21.15.106:0/972201191 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0a00065150 0x7f0a00067600 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.201+0000 7f0a2a200640 1 --2- 172.21.15.106:0/972201191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a2415c1f0 0x7f0a240c73c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.201+0000 7f0a2a200640 1 --2- 172.21.15.106:0/972201191 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a240ab5a0 0x7f0a240afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.201+0000 7f0a2a200640 1 -- 172.21.15.106:0/972201191 >> 172.21.15.106:0/972201191 conn(0x7f0a240b2fd0 msgr2=0x7f0a2415a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:02.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.201+0000 7f0a2a200640 1 -- 172.21.15.106:0/972201191 shutdown_connections 2024-08-17T02:28:02.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.201+0000 7f0a2a200640 1 -- 172.21.15.106:0/972201191 wait complete. 2024-08-17T02:28:02.217 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:28:02.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.367+0000 7f48df200640 1 Processor -- start 2024-08-17T02:28:02.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.368+0000 7f48df200640 1 -- start start 2024-08-17T02:28:02.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.369+0000 7f48df200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48e00ae540 0x7f48e00ae910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.369+0000 7f48df200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f48e00af0f0 0x7f48e0067d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.369+0000 7f48df200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e00ab790 con 0x7f48e00af520 2024-08-17T02:28:02.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.369+0000 7f48df200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e00aee50 con 0x7f48e00af0f0 2024-08-17T02:28:02.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.369+0000 7f48df200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e00aab80 con 0x7f48e00ae540 2024-08-17T02:28:02.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.369+0000 7f48d5400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f48e00af0f0 0x7f48e0067d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.369+0000 7f48d5400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f48e00af0f0 0x7f48e0067d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53522/0 (socket says 172.21.15.106:53522) 2024-08-17T02:28:02.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.369+0000 7f48d5400640 1 -- 172.21.15.106:0/1091282116 learned_addr learned my addr 172.21.15.106:0/1091282116 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:02.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.369+0000 7f48dde00640 1 --2- 172.21.15.106:0/1091282116 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48e00ae540 0x7f48e00ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.369+0000 7f48d5400640 1 -- 172.21.15.106:0/1091282116 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48e00ae540 msgr2=0x7f48e00ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:02.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.369+0000 7f48d5400640 1 --2- 172.21.15.106:0/1091282116 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48e00ae540 0x7f48e00ae910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.369+0000 7f48d5400640 1 -- 172.21.15.106:0/1091282116 >> v1:172.21.15.171:6789/0 conn(0x7f48e00af520 legacy=0x7f48e0068270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.369+0000 7f48d5400640 1 -- 172.21.15.106:0/1091282116 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e00aae60 con 0x7f48e00af0f0 2024-08-17T02:28:02.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.369+0000 7f48dde00640 1 --2- 172.21.15.106:0/1091282116 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48e00ae540 0x7f48e00ae910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:02.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.370+0000 7f48d5400640 1 --2- 172.21.15.106:0/1091282116 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48e00af0f0 0x7f48e0067d30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009910 tx=0x7f48c80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99340915e9b34b0d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.371+0000 7f48dd400640 1 -- 172.21.15.106:0/1091282116 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c802ae40 con 0x7f48e00af0f0 2024-08-17T02:28:02.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.371+0000 7f48dd400640 1 -- 172.21.15.106:0/1091282116 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c8032440 con 0x7f48e00af0f0 2024-08-17T02:28:02.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.371+0000 7f48dd400640 1 -- 172.21.15.106:0/1091282116 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c8032820 con 0x7f48e00af0f0 2024-08-17T02:28:02.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.371+0000 7f48df200640 1 -- 172.21.15.106:0/1091282116 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48e00af0f0 msgr2=0x7f48e0067d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.371+0000 7f48df200640 1 --2- 172.21.15.106:0/1091282116 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48e00af0f0 0x7f48e0067d30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009910 tx=0x7f48c80091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.371+0000 7f48df200640 1 -- 172.21.15.106:0/1091282116 shutdown_connections 2024-08-17T02:28:02.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.371+0000 7f48df200640 1 --2- 172.21.15.106:0/1091282116 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48e00af0f0 0x7f48e0067d30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.371+0000 7f48df200640 1 --2- 172.21.15.106:0/1091282116 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48e00ae540 0x7f48e00ae910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.371+0000 7f48df200640 1 -- 172.21.15.106:0/1091282116 >> 172.21.15.106:0/1091282116 conn(0x7f48e0096a70 msgr2=0x7f48e0096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:02.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.371+0000 7f48df200640 1 -- 172.21.15.106:0/1091282116 shutdown_connections 2024-08-17T02:28:02.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.371+0000 7f48df200640 1 -- 172.21.15.106:0/1091282116 wait complete. 2024-08-17T02:28:02.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.373+0000 7f48df200640 1 Processor -- start 2024-08-17T02:28:02.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.373+0000 7f48df200640 1 -- start start 2024-08-17T02:28:02.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.373+0000 7f48df200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48e00ae540 0x7f48e00c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.373+0000 7f48df200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48e00af0f0 0x7f48e00cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.374+0000 7f48df200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48e00af520 0x7f48e00cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.374+0000 7f48df200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e00c86d0 con 0x7f48e00af0f0 2024-08-17T02:28:02.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.374+0000 7f48df200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e016a750 con 0x7f48e00ae540 2024-08-17T02:28:02.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.374+0000 7f48df200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e00ca210 con 0x7f48e00af520 2024-08-17T02:28:02.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.374+0000 7f48d5400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48e00af0f0 0x7f48e00cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.374+0000 7f48d5400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48e00af0f0 0x7f48e00cafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53534/0 (socket says 172.21.15.106:53534) 2024-08-17T02:28:02.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.374+0000 7f48d5400640 1 -- 172.21.15.106:0/761598604 learned_addr learned my addr 172.21.15.106:0/761598604 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:02.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.374+0000 7f48dde00640 1 --2- 172.21.15.106:0/761598604 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48e00ae540 0x7f48e00c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.374+0000 7f48de800640 1 --2- 172.21.15.106:0/761598604 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48e00af520 0x7f48e00cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.374+0000 7f48d5400640 1 -- 172.21.15.106:0/761598604 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48e00af520 msgr2=0x7f48e00cbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.374+0000 7f48d5400640 1 --2- 172.21.15.106:0/761598604 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48e00af520 0x7f48e00cbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.374+0000 7f48d5400640 1 -- 172.21.15.106:0/761598604 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48e00ae540 msgr2=0x7f48e00c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.374+0000 7f48d5400640 1 --2- 172.21.15.106:0/761598604 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48e00ae540 0x7f48e00c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.374+0000 7f48d5400640 1 -- 172.21.15.106:0/761598604 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c8009450 con 0x7f48e00af0f0 2024-08-17T02:28:02.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.374+0000 7f48de800640 1 --2- 172.21.15.106:0/761598604 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48e00af520 0x7f48e00cbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:02.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.374+0000 7f48d5400640 1 --2- 172.21.15.106:0/761598604 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48e00af0f0 0x7f48e00cafd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f48c8035040 tx=0x7f48c8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.375+0000 7f48d6000640 1 -- 172.21.15.106:0/761598604 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c8031a60 con 0x7f48e00af0f0 2024-08-17T02:28:02.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.375+0000 7f48d6000640 1 -- 172.21.15.106:0/761598604 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c8031be0 con 0x7f48e00af0f0 2024-08-17T02:28:02.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.375+0000 7f48df200640 1 -- 172.21.15.106:0/761598604 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e00ca4f0 con 0x7f48e00af0f0 2024-08-17T02:28:02.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.375+0000 7f48d6000640 1 -- 172.21.15.106:0/761598604 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c803e450 con 0x7f48e00af0f0 2024-08-17T02:28:02.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.375+0000 7f48df200640 1 -- 172.21.15.106:0/761598604 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e00caab0 con 0x7f48e00af0f0 2024-08-17T02:28:02.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.376+0000 7f48df200640 1 -- 172.21.15.106:0/761598604 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e00ce330 con 0x7f48e00af0f0 2024-08-17T02:28:02.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.376+0000 7f48d6000640 1 -- 172.21.15.106:0/761598604 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f48c803e880 con 0x7f48e00af0f0 2024-08-17T02:28:02.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.377+0000 7f48d6000640 1 --2- 172.21.15.106:0/761598604 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f48bc065150 0x7f48bc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.377+0000 7f48d6000640 1 -- 172.21.15.106:0/761598604 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f48c802ae40 con 0x7f48e00af0f0 2024-08-17T02:28:02.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.377+0000 7f48dde00640 1 --2- 172.21.15.106:0/761598604 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f48bc065150 0x7f48bc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.378+0000 7f48dde00640 1 --2- 172.21.15.106:0/761598604 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f48bc065150 0x7f48bc067600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f48e006b5f0 tx=0x7f48d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.381+0000 7f48d6000640 1 -- 172.21.15.106:0/761598604 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f48e00ce330 con 0x7f48e00af0f0 2024-08-17T02:28:02.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.550+0000 7f48df200640 1 -- 172.21.15.106:0/761598604 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f48e00ce330 con 0x7f48e00af0f0 2024-08-17T02:28:02.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.550+0000 7f48d6000640 1 -- 172.21.15.106:0/761598604 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f48e00ce330 con 0x7f48e00af0f0 2024-08-17T02:28:02.551 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-08-17T02:28:02.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.552+0000 7f48df200640 1 -- 172.21.15.106:0/761598604 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f48bc065150 msgr2=0x7f48bc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.552+0000 7f48df200640 1 --2- 172.21.15.106:0/761598604 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f48bc065150 0x7f48bc067600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f48e006b5f0 tx=0x7f48d0008040 comp rx=0 tx=0).stop 2024-08-17T02:28:02.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.553+0000 7f48df200640 1 -- 172.21.15.106:0/761598604 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48e00af0f0 msgr2=0x7f48e00cafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.553+0000 7f48df200640 1 --2- 172.21.15.106:0/761598604 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48e00af0f0 0x7f48e00cafd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f48c8035040 tx=0x7f48c8032000 comp rx=0 tx=0).stop 2024-08-17T02:28:02.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.553+0000 7f48df200640 1 -- 172.21.15.106:0/761598604 shutdown_connections 2024-08-17T02:28:02.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.553+0000 7f48df200640 1 --2- 172.21.15.106:0/761598604 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48e00af520 0x7f48e00cbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.553+0000 7f48df200640 1 --2- 172.21.15.106:0/761598604 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f48bc065150 0x7f48bc067600 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.553+0000 7f48df200640 1 --2- 172.21.15.106:0/761598604 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f48e00af0f0 0x7f48e00cafd0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.553+0000 7f48df200640 1 --2- 172.21.15.106:0/761598604 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f48e00ae540 0x7f48e00c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.553+0000 7f48df200640 1 -- 172.21.15.106:0/761598604 >> 172.21.15.106:0/761598604 conn(0x7f48e0096a70 msgr2=0x7f48e00b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:02.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.553+0000 7f48df200640 1 -- 172.21.15.106:0/761598604 shutdown_connections 2024-08-17T02:28:02.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.553+0000 7f48df200640 1 -- 172.21.15.106:0/761598604 wait complete. 2024-08-17T02:28:02.568 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:02.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.714+0000 7f0d4b400640 1 Processor -- start 2024-08-17T02:28:02.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.714+0000 7f0d4b400640 1 -- start start 2024-08-17T02:28:02.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.715+0000 7f0d4b400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0d44155180 0x7f0d440aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.716+0000 7f0d4b400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d44155550 0x7f0d440ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.716+0000 7f0d4b400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d440afc10 con 0x7f0d440acba0 2024-08-17T02:28:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.716+0000 7f0d4b400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d440ae5b0 con 0x7f0d44155180 2024-08-17T02:28:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.716+0000 7f0d4b400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d440af000 con 0x7f0d44155550 2024-08-17T02:28:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.716+0000 7f0d48a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0d44155180 0x7f0d440aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.716+0000 7f0d49400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f0d440acba0 0x7f0d440ad000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:46294/0 (socket says 172.21.15.106:46294) 2024-08-17T02:28:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.716+0000 7f0d49400640 1 -- 172.21.15.106:0/3439193013 learned_addr learned my addr 172.21.15.106:0/3439193013 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.716+0000 7f0d3be00640 1 --2- 172.21.15.106:0/3439193013 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d44155550 0x7f0d440ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.716+0000 7f0d48a00640 1 -- 172.21.15.106:0/3439193013 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d44155550 msgr2=0x7f0d440ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.716+0000 7f0d48a00640 1 --2- 172.21.15.106:0/3439193013 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d44155550 0x7f0d440ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.716+0000 7f0d48a00640 1 -- 172.21.15.106:0/3439193013 >> v1:172.21.15.106:6789/0 conn(0x7f0d440acba0 legacy=0x7f0d440ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.716+0000 7f0d48a00640 1 -- 172.21.15.106:0/3439193013 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d440af2e0 con 0x7f0d44155180 2024-08-17T02:28:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.716+0000 7f0d43e00640 1 -- 172.21.15.106:0/3439193013 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3870884430 0 0) 0x7f0d440afc10 con 0x7f0d440acba0 2024-08-17T02:28:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.717+0000 7f0d48a00640 1 --2- 172.21.15.106:0/3439193013 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d44155180 0x7f0d440aea20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0d34009850 tx=0x7f0d340090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1a25c254e54881 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.717+0000 7f0d43e00640 1 -- 172.21.15.106:0/3439193013 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3402ad80 con 0x7f0d44155180 2024-08-17T02:28:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.718+0000 7f0d43e00640 1 -- 172.21.15.106:0/3439193013 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d34032440 con 0x7f0d44155180 2024-08-17T02:28:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.718+0000 7f0d43e00640 1 -- 172.21.15.106:0/3439193013 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d340327e0 con 0x7f0d44155180 2024-08-17T02:28:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.718+0000 7f0d4b400640 1 -- 172.21.15.106:0/3439193013 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d44155180 msgr2=0x7f0d440aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.718+0000 7f0d4b400640 1 --2- 172.21.15.106:0/3439193013 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d44155180 0x7f0d440aea20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0d34009850 tx=0x7f0d340090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.718+0000 7f0d4b400640 1 -- 172.21.15.106:0/3439193013 shutdown_connections 2024-08-17T02:28:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.718+0000 7f0d4b400640 1 --2- 172.21.15.106:0/3439193013 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d44155550 0x7f0d440ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.718+0000 7f0d4b400640 1 --2- 172.21.15.106:0/3439193013 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d44155180 0x7f0d440aea20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.718+0000 7f0d4b400640 1 -- 172.21.15.106:0/3439193013 >> 172.21.15.106:0/3439193013 conn(0x7f0d440cb9b0 msgr2=0x7f0d440cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:02.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.718+0000 7f0d4b400640 1 -- 172.21.15.106:0/3439193013 shutdown_connections 2024-08-17T02:28:02.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.718+0000 7f0d4b400640 1 -- 172.21.15.106:0/3439193013 wait complete. 2024-08-17T02:28:02.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.720+0000 7f0d4b400640 1 Processor -- start 2024-08-17T02:28:02.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.720+0000 7f0d4b400640 1 -- start start 2024-08-17T02:28:02.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.721+0000 7f0d4b400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d440acba0 0x7f0d440abd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.721+0000 7f0d4b400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d44155180 0x7f0d44168ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.721+0000 7f0d4b400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d44155550 0x7f0d44168ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.721+0000 7f0d4b400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d440aa7c0 con 0x7f0d44155180 2024-08-17T02:28:02.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.721+0000 7f0d4b400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d440aa9d0 con 0x7f0d44155550 2024-08-17T02:28:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.721+0000 7f0d4b400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d440aacb0 con 0x7f0d440acba0 2024-08-17T02:28:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.721+0000 7f0d3be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d44155180 0x7f0d44168ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.721+0000 7f0d3be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d44155180 0x7f0d44168ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53562/0 (socket says 172.21.15.106:53562) 2024-08-17T02:28:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.721+0000 7f0d3be00640 1 -- 172.21.15.106:0/1361353292 learned_addr learned my addr 172.21.15.106:0/1361353292 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.721+0000 7f0d48a00640 1 --2- 172.21.15.106:0/1361353292 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d440acba0 0x7f0d440abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.721+0000 7f0d49400640 1 --2- 172.21.15.106:0/1361353292 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d44155550 0x7f0d44168ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.721+0000 7f0d3be00640 1 -- 172.21.15.106:0/1361353292 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d440acba0 msgr2=0x7f0d440abd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.721+0000 7f0d3be00640 1 --2- 172.21.15.106:0/1361353292 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d440acba0 0x7f0d440abd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.721+0000 7f0d3be00640 1 -- 172.21.15.106:0/1361353292 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d44155550 msgr2=0x7f0d44168ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.721+0000 7f0d3be00640 1 --2- 172.21.15.106:0/1361353292 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d44155550 0x7f0d44168ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.721+0000 7f0d3be00640 1 -- 172.21.15.106:0/1361353292 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d34009390 con 0x7f0d44155180 2024-08-17T02:28:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.721+0000 7f0d49400640 1 --2- 172.21.15.106:0/1361353292 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d44155550 0x7f0d44168ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:02.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.721+0000 7f0d3be00640 1 --2- 172.21.15.106:0/1361353292 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d44155180 0x7f0d44168ab0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00e900 tx=0x7f0d2c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.722+0000 7f0d40c00640 1 -- 172.21.15.106:0/1361353292 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c00c8e0 con 0x7f0d44155180 2024-08-17T02:28:02.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.722+0000 7f0d40c00640 1 -- 172.21.15.106:0/1361353292 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2c00ca40 con 0x7f0d44155180 2024-08-17T02:28:02.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.722+0000 7f0d40c00640 1 -- 172.21.15.106:0/1361353292 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c00cde0 con 0x7f0d44155180 2024-08-17T02:28:02.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.722+0000 7f0d4b400640 1 -- 172.21.15.106:0/1361353292 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d440aaf90 con 0x7f0d44155180 2024-08-17T02:28:02.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.722+0000 7f0d4b400640 1 -- 172.21.15.106:0/1361353292 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d440ac2d0 con 0x7f0d44155180 2024-08-17T02:28:02.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.723+0000 7f0d4b400640 1 -- 172.21.15.106:0/1361353292 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d4406c7a0 con 0x7f0d44155180 2024-08-17T02:28:02.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.723+0000 7f0d40c00640 1 -- 172.21.15.106:0/1361353292 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0d2c013680 con 0x7f0d44155180 2024-08-17T02:28:02.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.724+0000 7f0d40c00640 1 --2- 172.21.15.106:0/1361353292 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0d20065150 0x7f0d20067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:02.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.724+0000 7f0d40c00640 1 -- 172.21.15.106:0/1361353292 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0d2c0826a0 con 0x7f0d44155180 2024-08-17T02:28:02.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.724+0000 7f0d48a00640 1 --2- 172.21.15.106:0/1361353292 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0d20065150 0x7f0d20067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:02.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.725+0000 7f0d48a00640 1 --2- 172.21.15.106:0/1361353292 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0d20065150 0x7f0d20067600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0d34034000 tx=0x7f0d34032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:02.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.728+0000 7f0d40c00640 1 -- 172.21.15.106:0/1361353292 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0d4406c7a0 con 0x7f0d44155180 2024-08-17T02:28:02.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.942+0000 7f0d4b400640 1 -- 172.21.15.106:0/1361353292 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d4406c7a0 con 0x7f0d44155180 2024-08-17T02:28:02.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.942+0000 7f0d40c00640 1 -- 172.21.15.106:0/1361353292 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f0d4406c7a0 con 0x7f0d44155180 2024-08-17T02:28:02.943 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:02.943 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1696744783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1696744783},{"type":"v1","addr":"172.21.15.106:6837","nonce":1696744783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/966571689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":966571689},{"type":"v1","addr":"172.21.15.171:6833","nonce":966571689}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/3205379168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3205379168},{"type":"v1","addr":"172.21.15.106:6836","nonce":3205379168}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:50.683483+0000","modified":"2024-08-17T02:27:54.296580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6835/3901195482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3901195482},{"type":"v1","addr":"172.21.15.171:6835","nonce":3901195482}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:28:02.943 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 8 2024-08-17T02:28:02.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.944+0000 7f0d4b400640 1 -- 172.21.15.106:0/1361353292 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0d20065150 msgr2=0x7f0d20067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.944+0000 7f0d4b400640 1 --2- 172.21.15.106:0/1361353292 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0d20065150 0x7f0d20067600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0d34034000 tx=0x7f0d34032000 comp rx=0 tx=0).stop 2024-08-17T02:28:02.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.944+0000 7f0d4b400640 1 -- 172.21.15.106:0/1361353292 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d44155180 msgr2=0x7f0d44168ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:02.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.944+0000 7f0d4b400640 1 --2- 172.21.15.106:0/1361353292 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d44155180 0x7f0d44168ab0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00e900 tx=0x7f0d2c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.945+0000 7f0d4b400640 1 -- 172.21.15.106:0/1361353292 shutdown_connections 2024-08-17T02:28:02.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.945+0000 7f0d4b400640 1 --2- 172.21.15.106:0/1361353292 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d44155550 0x7f0d44168ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.945+0000 7f0d4b400640 1 --2- 172.21.15.106:0/1361353292 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0d20065150 0x7f0d20067600 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.945+0000 7f0d4b400640 1 --2- 172.21.15.106:0/1361353292 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d44155180 0x7f0d44168ab0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.945+0000 7f0d4b400640 1 --2- 172.21.15.106:0/1361353292 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d440acba0 0x7f0d440abd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:02.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.945+0000 7f0d4b400640 1 -- 172.21.15.106:0/1361353292 >> 172.21.15.106:0/1361353292 conn(0x7f0d440cb9b0 msgr2=0x7f0d44152010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:02.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.945+0000 7f0d4b400640 1 -- 172.21.15.106:0/1361353292 shutdown_connections 2024-08-17T02:28:02.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:02.945+0000 7f0d4b400640 1 -- 172.21.15.106:0/1361353292 wait complete. 2024-08-17T02:28:02.960 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:03.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.106+0000 7fb297200640 1 Processor -- start 2024-08-17T02:28:03.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.106+0000 7fb297200640 1 -- start start 2024-08-17T02:28:03.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.107+0000 7fb297200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb298158d40 0x7fb29806ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.107+0000 7fb297200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb2980aa290 0x7fb2980b0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.107+0000 7fb297200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2980af590 con 0x7fb298158970 2024-08-17T02:28:03.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.107+0000 7fb297200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2980aed30 con 0x7fb298158d40 2024-08-17T02:28:03.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.107+0000 7fb297200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2980b0130 con 0x7fb2980aa290 2024-08-17T02:28:03.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.107+0000 7fb28d400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb298158d40 0x7fb29806ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.107+0000 7fb28d400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb298158d40 0x7fb29806ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53576/0 (socket says 172.21.15.106:53576) 2024-08-17T02:28:03.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.107+0000 7fb28d400640 1 -- 172.21.15.106:0/3484032769 learned_addr learned my addr 172.21.15.106:0/3484032769 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:03.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.107+0000 7fb296800640 1 --2- 172.21.15.106:0/3484032769 >> v2:172.21.15.171:3300/0 conn(0x7fb2980aa290 0x7fb2980b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.108+0000 7fb28d400640 1 -- 172.21.15.106:0/3484032769 >> v2:172.21.15.171:3300/0 conn(0x7fb2980aa290 msgr2=0x7fb2980b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:03.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.108+0000 7fb28d400640 1 --2- 172.21.15.106:0/3484032769 >> v2:172.21.15.171:3300/0 conn(0x7fb2980aa290 0x7fb2980b0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.108+0000 7fb28d400640 1 -- 172.21.15.106:0/3484032769 >> v1:172.21.15.171:6789/0 conn(0x7fb298158970 legacy=0x7fb2980afa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:03.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.108+0000 7fb28d400640 1 -- 172.21.15.106:0/3484032769 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2980aa9f0 con 0x7fb298158d40 2024-08-17T02:28:03.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.108+0000 7fb28d400640 1 --2- 172.21.15.106:0/3484032769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb298158d40 0x7fb29806ab70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb29815c6f0 tx=0x7fb2800091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3321581cdb0b55 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.109+0000 7fb295400640 1 -- 172.21.15.106:0/3484032769 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28002add0 con 0x7fb298158d40 2024-08-17T02:28:03.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.109+0000 7fb295400640 1 -- 172.21.15.106:0/3484032769 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb280032440 con 0x7fb298158d40 2024-08-17T02:28:03.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.109+0000 7fb295400640 1 -- 172.21.15.106:0/3484032769 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb280032820 con 0x7fb298158d40 2024-08-17T02:28:03.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.109+0000 7fb297200640 1 -- 172.21.15.106:0/3484032769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb298158d40 msgr2=0x7fb29806ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.109+0000 7fb297200640 1 --2- 172.21.15.106:0/3484032769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb298158d40 0x7fb29806ab70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb29815c6f0 tx=0x7fb2800091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.109+0000 7fb297200640 1 -- 172.21.15.106:0/3484032769 shutdown_connections 2024-08-17T02:28:03.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.109+0000 7fb297200640 1 --2- 172.21.15.106:0/3484032769 >> v2:172.21.15.171:3300/0 conn(0x7fb2980aa290 0x7fb2980b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.109+0000 7fb297200640 1 --2- 172.21.15.106:0/3484032769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb298158d40 0x7fb29806ab70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.109+0000 7fb297200640 1 -- 172.21.15.106:0/3484032769 >> 172.21.15.106:0/3484032769 conn(0x7fb298067750 msgr2=0x7fb298068c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:03.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.109+0000 7fb297200640 1 -- 172.21.15.106:0/3484032769 shutdown_connections 2024-08-17T02:28:03.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.109+0000 7fb297200640 1 -- 172.21.15.106:0/3484032769 wait complete. 2024-08-17T02:28:03.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.111+0000 7fb297200640 1 Processor -- start 2024-08-17T02:28:03.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.111+0000 7fb297200640 1 -- start start 2024-08-17T02:28:03.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.112+0000 7fb297200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2980aa290 0x7fb298168d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.112+0000 7fb297200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb298158970 0x7fb298149520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.112+0000 7fb297200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb298158d40 0x7fb2980c2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.112+0000 7fb297200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2980c0cb0 con 0x7fb298158970 2024-08-17T02:28:03.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.112+0000 7fb297200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2980c1550 con 0x7fb298158d40 2024-08-17T02:28:03.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.112+0000 7fb297200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb29815b240 con 0x7fb2980aa290 2024-08-17T02:28:03.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.112+0000 7fb28d400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb298158970 0x7fb298149520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.112+0000 7fb28d400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb298158970 0x7fb298149520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53584/0 (socket says 172.21.15.106:53584) 2024-08-17T02:28:03.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.112+0000 7fb28d400640 1 -- 172.21.15.106:0/3487983620 learned_addr learned my addr 172.21.15.106:0/3487983620 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:03.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.112+0000 7fb296800640 1 --2- 172.21.15.106:0/3487983620 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb298158d40 0x7fb2980c2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.112+0000 7fb295e00640 1 --2- 172.21.15.106:0/3487983620 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2980aa290 0x7fb298168d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.112+0000 7fb28d400640 1 -- 172.21.15.106:0/3487983620 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2980aa290 msgr2=0x7fb298168d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.112+0000 7fb28d400640 1 --2- 172.21.15.106:0/3487983620 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2980aa290 0x7fb298168d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.112+0000 7fb28d400640 1 -- 172.21.15.106:0/3487983620 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb298158d40 msgr2=0x7fb2980c2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.112+0000 7fb28d400640 1 --2- 172.21.15.106:0/3487983620 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb298158d40 0x7fb2980c2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.112+0000 7fb28d400640 1 -- 172.21.15.106:0/3487983620 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb280009450 con 0x7fb298158970 2024-08-17T02:28:03.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.112+0000 7fb295e00640 1 --2- 172.21.15.106:0/3487983620 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2980aa290 0x7fb298168d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:03.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.113+0000 7fb28d400640 1 --2- 172.21.15.106:0/3487983620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb298158970 0x7fb298149520 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb280009210 tx=0x7fb280032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.113+0000 7fb28e000640 1 -- 172.21.15.106:0/3487983620 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb280000c90 con 0x7fb298158970 2024-08-17T02:28:03.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.113+0000 7fb28e000640 1 -- 172.21.15.106:0/3487983620 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb280031de0 con 0x7fb298158970 2024-08-17T02:28:03.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.113+0000 7fb297200640 1 -- 172.21.15.106:0/3487983620 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2980c3ad0 con 0x7fb298158970 2024-08-17T02:28:03.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.113+0000 7fb28e000640 1 -- 172.21.15.106:0/3487983620 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28003d670 con 0x7fb298158970 2024-08-17T02:28:03.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.113+0000 7fb297200640 1 -- 172.21.15.106:0/3487983620 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2980c11e0 con 0x7fb298158970 2024-08-17T02:28:03.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.114+0000 7fb297200640 1 -- 172.21.15.106:0/3487983620 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2980c16c0 con 0x7fb298158970 2024-08-17T02:28:03.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.115+0000 7fb28e000640 1 -- 172.21.15.106:0/3487983620 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb280039040 con 0x7fb298158970 2024-08-17T02:28:03.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.115+0000 7fb28e000640 1 --2- 172.21.15.106:0/3487983620 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb274065150 0x7fb274067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.116+0000 7fb28e000640 1 -- 172.21.15.106:0/3487983620 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb2800a2680 con 0x7fb298158970 2024-08-17T02:28:03.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.116+0000 7fb295e00640 1 --2- 172.21.15.106:0/3487983620 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb274065150 0x7fb274067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.116+0000 7fb295e00640 1 --2- 172.21.15.106:0/3487983620 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb274065150 0x7fb274067600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb288002860 tx=0x7fb288009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.119+0000 7fb28e000640 1 -- 172.21.15.106:0/3487983620 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb280070750 con 0x7fb298158970 2024-08-17T02:28:03.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.293+0000 7fb297200640 1 -- 172.21.15.106:0/3487983620 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb298071050 con 0x7fb298158970 2024-08-17T02:28:03.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.294+0000 7fb28e000640 1 -- 172.21.15.106:0/3487983620 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fb280073d70 con 0x7fb298158970 2024-08-17T02:28:03.294 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:03.294 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:27:52.284039+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:48.547438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:49.671073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:03.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.296+0000 7fb297200640 1 -- 172.21.15.106:0/3487983620 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb274065150 msgr2=0x7fb274067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.296+0000 7fb297200640 1 --2- 172.21.15.106:0/3487983620 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb274065150 0x7fb274067600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb288002860 tx=0x7fb288009040 comp rx=0 tx=0).stop 2024-08-17T02:28:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.296+0000 7fb297200640 1 -- 172.21.15.106:0/3487983620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb298158970 msgr2=0x7fb298149520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.296+0000 7fb297200640 1 --2- 172.21.15.106:0/3487983620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb298158970 0x7fb298149520 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb280009210 tx=0x7fb280032000 comp rx=0 tx=0).stop 2024-08-17T02:28:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.296+0000 7fb297200640 1 -- 172.21.15.106:0/3487983620 shutdown_connections 2024-08-17T02:28:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.296+0000 7fb297200640 1 --2- 172.21.15.106:0/3487983620 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb298158d40 0x7fb2980c2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.296+0000 7fb297200640 1 --2- 172.21.15.106:0/3487983620 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb274065150 0x7fb274067600 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.296+0000 7fb297200640 1 --2- 172.21.15.106:0/3487983620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb298158970 0x7fb298149520 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.296+0000 7fb297200640 1 --2- 172.21.15.106:0/3487983620 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb2980aa290 0x7fb298168d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.296+0000 7fb297200640 1 -- 172.21.15.106:0/3487983620 >> 172.21.15.106:0/3487983620 conn(0x7fb298067750 msgr2=0x7fb2980ae280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.296+0000 7fb297200640 1 -- 172.21.15.106:0/3487983620 shutdown_connections 2024-08-17T02:28:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.296+0000 7fb297200640 1 -- 172.21.15.106:0/3487983620 wait complete. 2024-08-17T02:28:03.311 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:37.928826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:48.547438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:49.671073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:28:03.312 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:28:03.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.461+0000 7f6a7b400640 1 Processor -- start 2024-08-17T02:28:03.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.461+0000 7f6a7b400640 1 -- start start 2024-08-17T02:28:03.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.462+0000 7f6a7b400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6a740b0a80 0x7f6a740b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.462+0000 7f6a7b400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6a740adec0 0x7f6a7415a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.462+0000 7f6a7b400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a74157070 con 0x7f6a74157e10 2024-08-17T02:28:03.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.462+0000 7f6a7b400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a740b1390 con 0x7f6a740adec0 2024-08-17T02:28:03.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.462+0000 7f6a7b400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a7415b410 con 0x7f6a740b0a80 2024-08-17T02:28:03.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.463+0000 7f6a79400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6a740adec0 0x7f6a7415a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.463+0000 7f6a79400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6a740adec0 0x7f6a7415a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53596/0 (socket says 172.21.15.106:53596) 2024-08-17T02:28:03.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.463+0000 7f6a79400640 1 -- 172.21.15.106:0/1247048880 learned_addr learned my addr 172.21.15.106:0/1247048880 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:03.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.463+0000 7f6a78a00640 1 --2- 172.21.15.106:0/1247048880 >> v2:172.21.15.171:3300/0 conn(0x7f6a740b0a80 0x7f6a740b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.463+0000 7f6a79400640 1 -- 172.21.15.106:0/1247048880 >> v2:172.21.15.171:3300/0 conn(0x7f6a740b0a80 msgr2=0x7f6a740b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:03.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.463+0000 7f6a79400640 1 --2- 172.21.15.106:0/1247048880 >> v2:172.21.15.171:3300/0 conn(0x7f6a740b0a80 0x7f6a740b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.463+0000 7f6a79400640 1 -- 172.21.15.106:0/1247048880 >> v1:172.21.15.171:6789/0 conn(0x7f6a74157e10 legacy=0x7f6a740ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:03.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.463+0000 7f6a79400640 1 -- 172.21.15.106:0/1247048880 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a74157330 con 0x7f6a740adec0 2024-08-17T02:28:03.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.464+0000 7f6a79400640 1 --2- 172.21.15.106:0/1247048880 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a740adec0 0x7f6a7415a6e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6a74068410 tx=0x7f6a6c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=950d8ec405fbf517 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.464+0000 7f6a73e00640 1 -- 172.21.15.106:0/1247048880 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c031400 con 0x7f6a740adec0 2024-08-17T02:28:03.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.464+0000 7f6a73e00640 1 -- 172.21.15.106:0/1247048880 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6c02d050 con 0x7f6a740adec0 2024-08-17T02:28:03.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.464+0000 7f6a73e00640 1 -- 172.21.15.106:0/1247048880 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c0317d0 con 0x7f6a740adec0 2024-08-17T02:28:03.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.465+0000 7f6a7b400640 1 -- 172.21.15.106:0/1247048880 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a740adec0 msgr2=0x7f6a7415a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.465+0000 7f6a7b400640 1 --2- 172.21.15.106:0/1247048880 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a740adec0 0x7f6a7415a6e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6a74068410 tx=0x7f6a6c009840 comp rx=0 tx=0).stop 2024-08-17T02:28:03.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.465+0000 7f6a7b400640 1 -- 172.21.15.106:0/1247048880 shutdown_connections 2024-08-17T02:28:03.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.465+0000 7f6a7b400640 1 --2- 172.21.15.106:0/1247048880 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a740adec0 0x7f6a7415a6e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.465+0000 7f6a7b400640 1 --2- 172.21.15.106:0/1247048880 >> v2:172.21.15.171:3300/0 conn(0x7f6a740b0a80 0x7f6a740b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.465+0000 7f6a7b400640 1 -- 172.21.15.106:0/1247048880 >> 172.21.15.106:0/1247048880 conn(0x7f6a74067750 msgr2=0x7f6a740cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:03.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.465+0000 7f6a7b400640 1 -- 172.21.15.106:0/1247048880 shutdown_connections 2024-08-17T02:28:03.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.465+0000 7f6a7b400640 1 -- 172.21.15.106:0/1247048880 wait complete. 2024-08-17T02:28:03.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.466+0000 7f6a7b400640 1 Processor -- start 2024-08-17T02:28:03.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.466+0000 7f6a7b400640 1 -- start start 2024-08-17T02:28:03.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.467+0000 7f6a7b400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a740adec0 0x7f6a7414ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.467+0000 7f6a7b400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a740b0a80 0x7f6a7414faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.467+0000 7f6a7b400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a74157e10 0x7f6a7414b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.467+0000 7f6a7b400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a741690d0 con 0x7f6a74157e10 2024-08-17T02:28:03.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.467+0000 7f6a7b400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7414b320 con 0x7f6a740adec0 2024-08-17T02:28:03.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.467+0000 7f6a7b400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a74150390 con 0x7f6a740b0a80 2024-08-17T02:28:03.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.467+0000 7f6a79400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a74157e10 0x7f6a7414b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.468+0000 7f6a79400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a74157e10 0x7f6a7414b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53604/0 (socket says 172.21.15.106:53604) 2024-08-17T02:28:03.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.468+0000 7f6a79400640 1 -- 172.21.15.106:0/2023973586 learned_addr learned my addr 172.21.15.106:0/2023973586 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:03.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.468+0000 7f6a78a00640 1 --2- 172.21.15.106:0/2023973586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a740adec0 0x7f6a7414ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.468+0000 7f6a6be00640 1 --2- 172.21.15.106:0/2023973586 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a740b0a80 0x7f6a7414faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.468+0000 7f6a79400640 1 -- 172.21.15.106:0/2023973586 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a740b0a80 msgr2=0x7f6a7414faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.468+0000 7f6a79400640 1 --2- 172.21.15.106:0/2023973586 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a740b0a80 0x7f6a7414faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.468+0000 7f6a79400640 1 -- 172.21.15.106:0/2023973586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a740adec0 msgr2=0x7f6a7414ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.468+0000 7f6a79400640 1 --2- 172.21.15.106:0/2023973586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a740adec0 0x7f6a7414ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.468+0000 7f6a79400640 1 -- 172.21.15.106:0/2023973586 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6c009ae0 con 0x7f6a74157e10 2024-08-17T02:28:03.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.468+0000 7f6a79400640 1 --2- 172.21.15.106:0/2023973586 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a74157e10 0x7f6a7414b9f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c02ac90 tx=0x7f6a6c036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.468+0000 7f6a70c00640 1 -- 172.21.15.106:0/2023973586 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c008e50 con 0x7f6a74157e10 2024-08-17T02:28:03.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.469+0000 7f6a70c00640 1 -- 172.21.15.106:0/2023973586 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6c03b410 con 0x7f6a74157e10 2024-08-17T02:28:03.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.469+0000 7f6a70c00640 1 -- 172.21.15.106:0/2023973586 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c03b7d0 con 0x7f6a74157e10 2024-08-17T02:28:03.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.469+0000 7f6a7b400640 1 -- 172.21.15.106:0/2023973586 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a74150670 con 0x7f6a74157e10 2024-08-17T02:28:03.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.469+0000 7f6a7b400640 1 -- 172.21.15.106:0/2023973586 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a74150c30 con 0x7f6a74157e10 2024-08-17T02:28:03.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.470+0000 7f6a7b400640 1 -- 172.21.15.106:0/2023973586 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a74168e70 con 0x7f6a74157e10 2024-08-17T02:28:03.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.470+0000 7f6a70c00640 1 -- 172.21.15.106:0/2023973586 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6a6c038050 con 0x7f6a74157e10 2024-08-17T02:28:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.472+0000 7f6a70c00640 1 --2- 172.21.15.106:0/2023973586 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6a50065150 0x7f6a50067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.472+0000 7f6a70c00640 1 -- 172.21.15.106:0/2023973586 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6a6c0a31d0 con 0x7f6a74157e10 2024-08-17T02:28:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.472+0000 7f6a78a00640 1 --2- 172.21.15.106:0/2023973586 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6a50065150 0x7f6a50067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.472+0000 7f6a78a00640 1 --2- 172.21.15.106:0/2023973586 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6a50065150 0x7f6a50067600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6a64007b80 tx=0x7f6a64008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.476+0000 7f6a70c00640 1 -- 172.21.15.106:0/2023973586 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6a6c0712a0 con 0x7f6a74157e10 2024-08-17T02:28:03.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.646+0000 7f6a7b400640 1 -- 172.21.15.106:0/2023973586 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a74064db0 con 0x7f6a74157e10 2024-08-17T02:28:03.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.646+0000 7f6a70c00640 1 -- 172.21.15.106:0/2023973586 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a6c0748c0 con 0x7f6a74157e10 2024-08-17T02:28:03.647 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-08-17T02:28:03.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.648+0000 7f6a7b400640 1 -- 172.21.15.106:0/2023973586 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6a50065150 msgr2=0x7f6a50067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.648+0000 7f6a7b400640 1 --2- 172.21.15.106:0/2023973586 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6a50065150 0x7f6a50067600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6a64007b80 tx=0x7f6a64008040 comp rx=0 tx=0).stop 2024-08-17T02:28:03.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.648+0000 7f6a7b400640 1 -- 172.21.15.106:0/2023973586 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a74157e10 msgr2=0x7f6a7414b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.648+0000 7f6a7b400640 1 --2- 172.21.15.106:0/2023973586 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a74157e10 0x7f6a7414b9f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c02ac90 tx=0x7f6a6c036000 comp rx=0 tx=0).stop 2024-08-17T02:28:03.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.648+0000 7f6a7b400640 1 -- 172.21.15.106:0/2023973586 shutdown_connections 2024-08-17T02:28:03.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.648+0000 7f6a7b400640 1 --2- 172.21.15.106:0/2023973586 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6a50065150 0x7f6a50067600 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.648+0000 7f6a7b400640 1 --2- 172.21.15.106:0/2023973586 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a74157e10 0x7f6a7414b9f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.648+0000 7f6a7b400640 1 --2- 172.21.15.106:0/2023973586 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a740b0a80 0x7f6a7414faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.648+0000 7f6a7b400640 1 --2- 172.21.15.106:0/2023973586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a740adec0 0x7f6a7414ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.648+0000 7f6a7b400640 1 -- 172.21.15.106:0/2023973586 >> 172.21.15.106:0/2023973586 conn(0x7f6a74067750 msgr2=0x7f6a740ad5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:03.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.649+0000 7f6a7b400640 1 -- 172.21.15.106:0/2023973586 shutdown_connections 2024-08-17T02:28:03.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.649+0000 7f6a7b400640 1 -- 172.21.15.106:0/2023973586 wait complete. 2024-08-17T02:28:03.664 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:28:03.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.813+0000 7f35a5000640 1 Processor -- start 2024-08-17T02:28:03.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.813+0000 7f35a5000640 1 -- start start 2024-08-17T02:28:03.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.814+0000 7f35a5000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35a0156c50 0x7f35a00c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.814+0000 7f35a5000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a00ab130 con 0x7f35a00c8bd0 2024-08-17T02:28:03.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.814+0000 7f35a5000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a00ae5a0 con 0x7f35a00adcf0 2024-08-17T02:28:03.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.814+0000 7f35a5000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a00ae2c0 con 0x7f35a0156c50 2024-08-17T02:28:03.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.814+0000 7f359e800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f35a00c8bd0 0x7f35a00aeb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:46306/0 (socket says 172.21.15.106:46306) 2024-08-17T02:28:03.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.814+0000 7f359e800640 1 -- 172.21.15.106:0/2217313832 learned_addr learned my addr 172.21.15.106:0/2217313832 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:03.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.815+0000 7f359de00640 1 --2- 172.21.15.106:0/2217313832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35a0156c50 0x7f35a00c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.815+0000 7f359d400640 1 -- 172.21.15.106:0/2217313832 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217044970 0 0) 0x7f35a00ab130 con 0x7f35a00c8bd0 2024-08-17T02:28:03.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.815+0000 7f359d400640 1 -- 172.21.15.106:0/2217313832 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35840034e0 con 0x7f35a00c8bd0 2024-08-17T02:28:03.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.815+0000 7f359d400640 1 -- 172.21.15.106:0/2217313832 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1068449151 0 0) 0x7f35a00ae5a0 con 0x7f35a00adcf0 2024-08-17T02:28:03.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.815+0000 7f359d400640 1 -- 172.21.15.106:0/2217313832 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35a00ab130 con 0x7f35a00adcf0 2024-08-17T02:28:03.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.815+0000 7f359de00640 1 -- 172.21.15.106:0/2217313832 >> v1:172.21.15.171:6789/0 conn(0x7f35a00adcf0 legacy=0x7f35a00ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.815+0000 7f359de00640 1 -- 172.21.15.106:0/2217313832 >> v1:172.21.15.106:6789/0 conn(0x7f35a00c8bd0 legacy=0x7f35a00aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.815+0000 7f359d400640 1 -- 172.21.15.106:0/2217313832 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1223257228 0 0) 0x7f35840034e0 con 0x7f35a00c8bd0 2024-08-17T02:28:03.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.815+0000 7f359de00640 1 -- 172.21.15.106:0/2217313832 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a00aaae0 con 0x7f35a0156c50 2024-08-17T02:28:03.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.816+0000 7f359de00640 1 --2- 172.21.15.106:0/2217313832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35a0156c50 0x7f35a00c7cf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3590009880 tx=0x7f35900090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae2d83d1a39f0ee9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.817+0000 7f359d400640 1 -- 172.21.15.106:0/2217313832 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35980017f0 con 0x7f35a0156c50 2024-08-17T02:28:03.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.817+0000 7f359d400640 1 -- 172.21.15.106:0/2217313832 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359002aa30 con 0x7f35a0156c50 2024-08-17T02:28:03.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.817+0000 7f359d400640 1 -- 172.21.15.106:0/2217313832 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359002adb0 con 0x7f35a0156c50 2024-08-17T02:28:03.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.817+0000 7f35a5000640 1 -- 172.21.15.106:0/2217313832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35a0156c50 msgr2=0x7f35a00c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.817+0000 7f35a5000640 1 --2- 172.21.15.106:0/2217313832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35a0156c50 0x7f35a00c7cf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3590009880 tx=0x7f35900090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.817+0000 7f35a5000640 1 -- 172.21.15.106:0/2217313832 shutdown_connections 2024-08-17T02:28:03.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.817+0000 7f35a5000640 1 --2- 172.21.15.106:0/2217313832 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35a0156c50 0x7f35a00c7cf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.817+0000 7f35a5000640 1 -- 172.21.15.106:0/2217313832 >> 172.21.15.106:0/2217313832 conn(0x7f35a0067750 msgr2=0x7f35a00c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:03.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.817+0000 7f35a5000640 1 -- 172.21.15.106:0/2217313832 shutdown_connections 2024-08-17T02:28:03.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.817+0000 7f35a5000640 1 -- 172.21.15.106:0/2217313832 wait complete. 2024-08-17T02:28:03.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.819+0000 7f35a5000640 1 Processor -- start 2024-08-17T02:28:03.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.819+0000 7f35a5000640 1 -- start start 2024-08-17T02:28:03.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.820+0000 7f35a5000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35a00adcf0 0x7f35a0149ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.820+0000 7f35a5000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35a00c8bd0 0x7f35a014b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.820+0000 7f35a5000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35a0156c50 0x7f35a014bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.820+0000 7f35a5000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a0166e70 con 0x7f35a00adcf0 2024-08-17T02:28:03.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.820+0000 7f35a5000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a0155790 con 0x7f35a00c8bd0 2024-08-17T02:28:03.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.820+0000 7f35a5000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a0154b80 con 0x7f35a0156c50 2024-08-17T02:28:03.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.820+0000 7f359de00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35a00adcf0 0x7f35a0149ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.820+0000 7f359de00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35a00adcf0 0x7f35a0149ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53608/0 (socket says 172.21.15.106:53608) 2024-08-17T02:28:03.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.820+0000 7f359de00640 1 -- 172.21.15.106:0/2414212356 learned_addr learned my addr 172.21.15.106:0/2414212356 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:03.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.820+0000 7f359e800640 1 --2- 172.21.15.106:0/2414212356 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35a0156c50 0x7f35a014bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.820+0000 7f3597e00640 1 --2- 172.21.15.106:0/2414212356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35a00c8bd0 0x7f35a014b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.820+0000 7f359de00640 1 -- 172.21.15.106:0/2414212356 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35a0156c50 msgr2=0x7f35a014bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.820+0000 7f359de00640 1 --2- 172.21.15.106:0/2414212356 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35a0156c50 0x7f35a014bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.820+0000 7f359de00640 1 -- 172.21.15.106:0/2414212356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35a00c8bd0 msgr2=0x7f35a014b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:03.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.820+0000 7f359de00640 1 --2- 172.21.15.106:0/2414212356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35a00c8bd0 0x7f35a014b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:03.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.820+0000 7f359de00640 1 -- 172.21.15.106:0/2414212356 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3590009390 con 0x7f35a00adcf0 2024-08-17T02:28:03.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.820+0000 7f3597e00640 1 --2- 172.21.15.106:0/2414212356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35a00c8bd0 0x7f35a014b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:03.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.821+0000 7f359de00640 1 --2- 172.21.15.106:0/2414212356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35a00adcf0 0x7f35a0149ce0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f35900097d0 tx=0x7f3590032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.821+0000 7f3595600640 1 -- 172.21.15.106:0/2414212356 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3590033e70 con 0x7f35a00adcf0 2024-08-17T02:28:03.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.821+0000 7f3595600640 1 -- 172.21.15.106:0/2414212356 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359003c410 con 0x7f35a00adcf0 2024-08-17T02:28:03.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.821+0000 7f35a5000640 1 -- 172.21.15.106:0/2414212356 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a0154e60 con 0x7f35a00adcf0 2024-08-17T02:28:03.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.821+0000 7f3595600640 1 -- 172.21.15.106:0/2414212356 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359003c7f0 con 0x7f35a00adcf0 2024-08-17T02:28:03.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.821+0000 7f35a5000640 1 -- 172.21.15.106:0/2414212356 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a0155420 con 0x7f35a00adcf0 2024-08-17T02:28:03.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.822+0000 7f35a5000640 1 -- 172.21.15.106:0/2414212356 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a0071050 con 0x7f35a00adcf0 2024-08-17T02:28:03.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.823+0000 7f3595600640 1 -- 172.21.15.106:0/2414212356 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3590039050 con 0x7f35a00adcf0 2024-08-17T02:28:03.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.824+0000 7f3595600640 1 --2- 172.21.15.106:0/2414212356 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f357c065150 0x7f357c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:03.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.824+0000 7f3595600640 1 -- 172.21.15.106:0/2414212356 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f35900a2b30 con 0x7f35a00adcf0 2024-08-17T02:28:03.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.824+0000 7f3597e00640 1 --2- 172.21.15.106:0/2414212356 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f357c065150 0x7f357c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:03.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.825+0000 7f3597e00640 1 --2- 172.21.15.106:0/2414212356 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f357c065150 0x7f357c067600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f35a01539b0 tx=0x7f3588009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:03.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:03.828+0000 7f3595600640 1 -- 172.21.15.106:0/2414212356 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3590070b50 con 0x7f35a00adcf0 2024-08-17T02:28:04.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.003+0000 7f35a5000640 1 -- 172.21.15.106:0/2414212356 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f35a0153420 con 0x7f35a00adcf0 2024-08-17T02:28:04.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.003+0000 7f3595600640 1 -- 172.21.15.106:0/2414212356 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3590074170 con 0x7f35a00adcf0 2024-08-17T02:28:04.004 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-08-17T02:28:04.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.005+0000 7f35a5000640 1 -- 172.21.15.106:0/2414212356 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f357c065150 msgr2=0x7f357c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.005+0000 7f35a5000640 1 --2- 172.21.15.106:0/2414212356 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f357c065150 0x7f357c067600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f35a01539b0 tx=0x7f3588009040 comp rx=0 tx=0).stop 2024-08-17T02:28:04.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.005+0000 7f35a5000640 1 -- 172.21.15.106:0/2414212356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35a00adcf0 msgr2=0x7f35a0149ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.005+0000 7f35a5000640 1 --2- 172.21.15.106:0/2414212356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35a00adcf0 0x7f35a0149ce0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f35900097d0 tx=0x7f3590032000 comp rx=0 tx=0).stop 2024-08-17T02:28:04.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.005+0000 7f35a5000640 1 -- 172.21.15.106:0/2414212356 shutdown_connections 2024-08-17T02:28:04.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.005+0000 7f35a5000640 1 --2- 172.21.15.106:0/2414212356 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35a0156c50 0x7f35a014bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.005+0000 7f35a5000640 1 --2- 172.21.15.106:0/2414212356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35a00c8bd0 0x7f35a014b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.005+0000 7f35a5000640 1 --2- 172.21.15.106:0/2414212356 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f357c065150 0x7f357c067600 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.005+0000 7f35a5000640 1 --2- 172.21.15.106:0/2414212356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35a00adcf0 0x7f35a0149ce0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.005+0000 7f35a5000640 1 -- 172.21.15.106:0/2414212356 >> 172.21.15.106:0/2414212356 conn(0x7f35a0067750 msgr2=0x7f35a00ad2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:04.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.005+0000 7f35a5000640 1 -- 172.21.15.106:0/2414212356 shutdown_connections 2024-08-17T02:28:04.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.005+0000 7f35a5000640 1 -- 172.21.15.106:0/2414212356 wait complete. 2024-08-17T02:28:04.021 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:28:04.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.170+0000 7fc745600640 1 Processor -- start 2024-08-17T02:28:04.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.170+0000 7fc745600640 1 -- start start 2024-08-17T02:28:04.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.171+0000 7fc745600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc740097180 0x7fc7400ab5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.171+0000 7fc745600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc74015c5c0 0x7fc7400abae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.171+0000 7fc745600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7400ad290 con 0x7fc74015c1f0 2024-08-17T02:28:04.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.171+0000 7fc745600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7400b0e20 con 0x7fc740097180 2024-08-17T02:28:04.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.171+0000 7fc745600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7400ac370 con 0x7fc74015c5c0 2024-08-17T02:28:04.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.171+0000 7fc73ea00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc74015c1f0 0x7fc740096a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:46308/0 (socket says 172.21.15.106:46308) 2024-08-17T02:28:04.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.172+0000 7fc73ea00640 1 -- 172.21.15.106:0/728840508 learned_addr learned my addr 172.21.15.106:0/728840508 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:04.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.172+0000 7fc73e000640 1 --2- 172.21.15.106:0/728840508 >> v2:172.21.15.106:3300/0 conn(0x7fc740097180 0x7fc7400ab5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.172+0000 7fc73f400640 1 --2- 172.21.15.106:0/728840508 >> v2:172.21.15.171:3300/0 conn(0x7fc74015c5c0 0x7fc7400abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.172+0000 7fc73e000640 1 -- 172.21.15.106:0/728840508 >> v2:172.21.15.171:3300/0 conn(0x7fc74015c5c0 msgr2=0x7fc7400abae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:04.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.172+0000 7fc73e000640 1 --2- 172.21.15.106:0/728840508 >> v2:172.21.15.171:3300/0 conn(0x7fc74015c5c0 0x7fc7400abae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.172+0000 7fc73e000640 1 -- 172.21.15.106:0/728840508 >> v1:172.21.15.106:6789/0 conn(0x7fc74015c1f0 legacy=0x7fc740096a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.172+0000 7fc73e000640 1 -- 172.21.15.106:0/728840508 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7400ac650 con 0x7fc740097180 2024-08-17T02:28:04.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.173+0000 7fc73e000640 1 --2- 172.21.15.106:0/728840508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc740097180 0x7fc7400ab5a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc740064680 tx=0x7fc72c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5322708ea7c5f30 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.173+0000 7fc73d600640 1 -- 172.21.15.106:0/728840508 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c02adb0 con 0x7fc740097180 2024-08-17T02:28:04.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.173+0000 7fc73d600640 1 -- 172.21.15.106:0/728840508 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72c032440 con 0x7fc740097180 2024-08-17T02:28:04.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.173+0000 7fc73d600640 1 -- 172.21.15.106:0/728840508 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c032820 con 0x7fc740097180 2024-08-17T02:28:04.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.174+0000 7fc745600640 1 -- 172.21.15.106:0/728840508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc740097180 msgr2=0x7fc7400ab5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.174+0000 7fc745600640 1 --2- 172.21.15.106:0/728840508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc740097180 0x7fc7400ab5a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc740064680 tx=0x7fc72c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.174+0000 7fc745600640 1 -- 172.21.15.106:0/728840508 shutdown_connections 2024-08-17T02:28:04.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.174+0000 7fc745600640 1 --2- 172.21.15.106:0/728840508 >> v2:172.21.15.171:3300/0 conn(0x7fc74015c5c0 0x7fc7400abae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.174+0000 7fc745600640 1 --2- 172.21.15.106:0/728840508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc740097180 0x7fc7400ab5a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.174+0000 7fc745600640 1 -- 172.21.15.106:0/728840508 >> 172.21.15.106:0/728840508 conn(0x7fc7400b2fd0 msgr2=0x7fc7400b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:04.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.174+0000 7fc745600640 1 -- 172.21.15.106:0/728840508 shutdown_connections 2024-08-17T02:28:04.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.174+0000 7fc745600640 1 -- 172.21.15.106:0/728840508 wait complete. 2024-08-17T02:28:04.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.175+0000 7fc745600640 1 Processor -- start 2024-08-17T02:28:04.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.175+0000 7fc745600640 1 -- start start 2024-08-17T02:28:04.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.176+0000 7fc745600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc740097180 0x7fc7401528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.176+0000 7fc745600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc74015c1f0 0x7fc7401444e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.176+0000 7fc745600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc74015c5c0 0x7fc740154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.176+0000 7fc745600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc740152e10 con 0x7fc74015c1f0 2024-08-17T02:28:04.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.176+0000 7fc745600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7400af6e0 con 0x7fc740097180 2024-08-17T02:28:04.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.176+0000 7fc745600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7400af9c0 con 0x7fc74015c5c0 2024-08-17T02:28:04.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.176+0000 7fc73e000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc74015c1f0 0x7fc7401444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.177+0000 7fc73e000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc74015c1f0 0x7fc7401444e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53632/0 (socket says 172.21.15.106:53632) 2024-08-17T02:28:04.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.177+0000 7fc73e000640 1 -- 172.21.15.106:0/210679060 learned_addr learned my addr 172.21.15.106:0/210679060 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:04.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.177+0000 7fc73f400640 1 --2- 172.21.15.106:0/210679060 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc74015c5c0 0x7fc740154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.177+0000 7fc73ea00640 1 --2- 172.21.15.106:0/210679060 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc740097180 0x7fc7401528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.177+0000 7fc73e000640 1 -- 172.21.15.106:0/210679060 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc74015c5c0 msgr2=0x7fc740154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.177+0000 7fc73e000640 1 --2- 172.21.15.106:0/210679060 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc74015c5c0 0x7fc740154430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.177+0000 7fc73e000640 1 -- 172.21.15.106:0/210679060 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc740097180 msgr2=0x7fc7401528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.177+0000 7fc73e000640 1 --2- 172.21.15.106:0/210679060 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc740097180 0x7fc7401528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.177+0000 7fc73e000640 1 -- 172.21.15.106:0/210679060 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72c009390 con 0x7fc74015c1f0 2024-08-17T02:28:04.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.177+0000 7fc73e000640 1 --2- 172.21.15.106:0/210679060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc74015c1f0 0x7fc7401444e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc72c009360 tx=0x7fc72c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.177+0000 7fc736000640 1 -- 172.21.15.106:0/210679060 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c000d10 con 0x7fc74015c1f0 2024-08-17T02:28:04.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.177+0000 7fc736000640 1 -- 172.21.15.106:0/210679060 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72c031de0 con 0x7fc74015c1f0 2024-08-17T02:28:04.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.177+0000 7fc745600640 1 -- 172.21.15.106:0/210679060 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7400afca0 con 0x7fc74015c1f0 2024-08-17T02:28:04.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.177+0000 7fc736000640 1 -- 172.21.15.106:0/210679060 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c03d670 con 0x7fc74015c1f0 2024-08-17T02:28:04.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.178+0000 7fc745600640 1 -- 172.21.15.106:0/210679060 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc740144a20 con 0x7fc74015c1f0 2024-08-17T02:28:04.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.179+0000 7fc745600640 1 -- 172.21.15.106:0/210679060 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc740071050 con 0x7fc74015c1f0 2024-08-17T02:28:04.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.179+0000 7fc736000640 1 -- 172.21.15.106:0/210679060 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc72c039040 con 0x7fc74015c1f0 2024-08-17T02:28:04.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.180+0000 7fc736000640 1 --2- 172.21.15.106:0/210679060 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc720065150 0x7fc720067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.181+0000 7fc736000640 1 -- 172.21.15.106:0/210679060 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc72c0a2720 con 0x7fc74015c1f0 2024-08-17T02:28:04.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.181+0000 7fc73ea00640 1 --2- 172.21.15.106:0/210679060 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc720065150 0x7fc720067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.181+0000 7fc73ea00640 1 --2- 172.21.15.106:0/210679060 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc720065150 0x7fc720067600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc730007fd0 tx=0x7fc730009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.185+0000 7fc736000640 1 -- 172.21.15.106:0/210679060 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc72c070740 con 0x7fc74015c1f0 2024-08-17T02:28:04.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.356+0000 7fc745600640 1 -- 172.21.15.106:0/210679060 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc74014f9a0 con 0x7fc74015c1f0 2024-08-17T02:28:04.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.358+0000 7fc736000640 1 -- 172.21.15.106:0/210679060 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc72c073d60 con 0x7fc74015c1f0 2024-08-17T02:28:04.358 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-08-17T02:28:04.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.360+0000 7fc745600640 1 -- 172.21.15.106:0/210679060 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc720065150 msgr2=0x7fc720067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.360+0000 7fc745600640 1 --2- 172.21.15.106:0/210679060 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc720065150 0x7fc720067600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc730007fd0 tx=0x7fc730009040 comp rx=0 tx=0).stop 2024-08-17T02:28:04.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.360+0000 7fc745600640 1 -- 172.21.15.106:0/210679060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc74015c1f0 msgr2=0x7fc7401444e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.360+0000 7fc745600640 1 --2- 172.21.15.106:0/210679060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc74015c1f0 0x7fc7401444e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc72c009360 tx=0x7fc72c032000 comp rx=0 tx=0).stop 2024-08-17T02:28:04.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.360+0000 7fc745600640 1 -- 172.21.15.106:0/210679060 shutdown_connections 2024-08-17T02:28:04.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.360+0000 7fc745600640 1 --2- 172.21.15.106:0/210679060 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc74015c5c0 0x7fc740154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.360+0000 7fc745600640 1 --2- 172.21.15.106:0/210679060 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc720065150 0x7fc720067600 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.360+0000 7fc745600640 1 --2- 172.21.15.106:0/210679060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc74015c1f0 0x7fc7401444e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.360+0000 7fc745600640 1 --2- 172.21.15.106:0/210679060 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc740097180 0x7fc7401528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.360+0000 7fc745600640 1 -- 172.21.15.106:0/210679060 >> 172.21.15.106:0/210679060 conn(0x7fc7400b2fd0 msgr2=0x7fc7400acb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:04.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.360+0000 7fc745600640 1 -- 172.21.15.106:0/210679060 shutdown_connections 2024-08-17T02:28:04.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.360+0000 7fc745600640 1 -- 172.21.15.106:0/210679060 wait complete. 2024-08-17T02:28:04.375 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:04.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.522+0000 7f5c98a00640 1 Processor -- start 2024-08-17T02:28:04.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.522+0000 7f5c98a00640 1 -- start start 2024-08-17T02:28:04.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.523+0000 7f5c98a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c940ccca0 0x7f5c94163870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.523+0000 7f5c98a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c940cadc0 con 0x7f5c94159ca0 2024-08-17T02:28:04.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.523+0000 7f5c98a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c940cb060 con 0x7f5c940ceb40 2024-08-17T02:28:04.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.523+0000 7f5c98a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c940cd6e0 con 0x7f5c940ccca0 2024-08-17T02:28:04.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.523+0000 7f5c93400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5c94159ca0 0x7f5c940ca360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:46316/0 (socket says 172.21.15.106:46316) 2024-08-17T02:28:04.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.523+0000 7f5c93400640 1 -- 172.21.15.106:0/3978274068 learned_addr learned my addr 172.21.15.106:0/3978274068 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:04.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.524+0000 7f5c93e00640 1 --2- 172.21.15.106:0/3978274068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c940ccca0 0x7f5c94163870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.524+0000 7f5c92000640 1 -- 172.21.15.106:0/3978274068 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 739773442 0 0) 0x7f5c940cadc0 con 0x7f5c94159ca0 2024-08-17T02:28:04.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.524+0000 7f5c92000640 1 -- 172.21.15.106:0/3978274068 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c780034e0 con 0x7f5c94159ca0 2024-08-17T02:28:04.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.524+0000 7f5c92000640 1 -- 172.21.15.106:0/3978274068 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1933007559 0 0) 0x7f5c780034e0 con 0x7f5c94159ca0 2024-08-17T02:28:04.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.524+0000 7f5c92000640 1 -- 172.21.15.106:0/3978274068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c940ccca0 msgr2=0x7f5c94163870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:04.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.524+0000 7f5c92000640 1 --2- 172.21.15.106:0/3978274068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c940ccca0 0x7f5c94163870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.524+0000 7f5c92000640 1 -- 172.21.15.106:0/3978274068 >> v1:172.21.15.171:6789/0 conn(0x7f5c940ceb40 legacy=0x7f5c940cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.524+0000 7f5c92000640 1 -- 172.21.15.106:0/3978274068 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c940cb300 con 0x7f5c94159ca0 2024-08-17T02:28:04.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.524+0000 7f5c92000640 1 -- 172.21.15.106:0/3978274068 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7f5c84001470 con 0x7f5c94159ca0 2024-08-17T02:28:04.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.524+0000 7f5c92000640 1 -- 172.21.15.106:0/3978274068 >> v1:172.21.15.106:6789/0 conn(0x7f5c94159ca0 legacy=0x7f5c940ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.524+0000 7f5c92000640 1 --2- 172.21.15.106:0/3978274068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c78003a00 0x7f5c78003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.524+0000 7f5c92000640 1 --2- 172.21.15.106:0/3978274068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c940ccca0 0x7f5c78004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.524+0000 7f5c92000640 1 --2- 172.21.15.106:0/3978274068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c78004cc0 0x7f5c78005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.524+0000 7f5c92000640 1 -- 172.21.15.106:0/3978274068 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c940cd6e0 con 0x7f5c78004cc0 2024-08-17T02:28:04.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.524+0000 7f5c92000640 1 -- 172.21.15.106:0/3978274068 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7800bab0 con 0x7f5c78003a00 2024-08-17T02:28:04.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.524+0000 7f5c92000640 1 -- 172.21.15.106:0/3978274068 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7800bc70 con 0x7f5c940ccca0 2024-08-17T02:28:04.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.524+0000 7f5c93400640 1 --2- 172.21.15.106:0/3978274068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c78003a00 0x7f5c78003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.524+0000 7f5c93e00640 1 --2- 172.21.15.106:0/3978274068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c78004cc0 0x7f5c78005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.524+0000 7f5c92a00640 1 --2- 172.21.15.106:0/3978274068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c940ccca0 0x7f5c78004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.525+0000 7f5c93400640 1 -- 172.21.15.106:0/3978274068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c940ccca0 msgr2=0x7f5c78004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:04.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.525+0000 7f5c93400640 1 --2- 172.21.15.106:0/3978274068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c940ccca0 0x7f5c78004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.525+0000 7f5c93400640 1 -- 172.21.15.106:0/3978274068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c78004cc0 msgr2=0x7f5c78005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:04.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.525+0000 7f5c93400640 1 --2- 172.21.15.106:0/3978274068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c78004cc0 0x7f5c78005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.525+0000 7f5c93400640 1 -- 172.21.15.106:0/3978274068 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c780034e0 con 0x7f5c78003a00 2024-08-17T02:28:04.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.526+0000 7f5c93400640 1 --2- 172.21.15.106:0/3978274068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c78003a00 0x7f5c78003dd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5c8400c210 tx=0x7f5c940cb860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=635a00ee467fbcf3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.526+0000 7f5c92000640 1 -- 172.21.15.106:0/3978274068 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c84005960 con 0x7f5c78003a00 2024-08-17T02:28:04.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.526+0000 7f5c92000640 1 -- 172.21.15.106:0/3978274068 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c84005ae0 con 0x7f5c78003a00 2024-08-17T02:28:04.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.526+0000 7f5c92000640 1 -- 172.21.15.106:0/3978274068 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c84005ea0 con 0x7f5c78003a00 2024-08-17T02:28:04.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.527+0000 7f5c98a00640 1 -- 172.21.15.106:0/3978274068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c78003a00 msgr2=0x7f5c78003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.527+0000 7f5c98a00640 1 --2- 172.21.15.106:0/3978274068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c78003a00 0x7f5c78003dd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5c8400c210 tx=0x7f5c940cb860 comp rx=0 tx=0).stop 2024-08-17T02:28:04.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.527+0000 7f5c93e00640 1 -- 172.21.15.106:0/3978274068 reap_dead start 2024-08-17T02:28:04.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.527+0000 7f5c98a00640 1 -- 172.21.15.106:0/3978274068 shutdown_connections 2024-08-17T02:28:04.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.527+0000 7f5c98a00640 1 -- 172.21.15.106:0/3978274068 >> 172.21.15.106:0/3978274068 conn(0x7f5c94098e00 msgr2=0x7f5c9406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:04.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.527+0000 7f5c98a00640 1 -- 172.21.15.106:0/3978274068 shutdown_connections 2024-08-17T02:28:04.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.527+0000 7f5c98a00640 1 -- 172.21.15.106:0/3978274068 wait complete. 2024-08-17T02:28:04.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.528+0000 7f5c98a00640 1 Processor -- start 2024-08-17T02:28:04.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.528+0000 7f5c98a00640 1 -- start start 2024-08-17T02:28:04.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.529+0000 7f5c98a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c78003a00 0x7f5c941688c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.529+0000 7f5c98a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c940c3fd0 0x7f5c940c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.529+0000 7f5c98a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c94153170 0x7f5c940ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.529+0000 7f5c98a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c940c7b10 con 0x7f5c94153170 2024-08-17T02:28:04.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.529+0000 7f5c98a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c940c4420 con 0x7f5c78003a00 2024-08-17T02:28:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.529+0000 7f5c98a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c940c46e0 con 0x7f5c940c3fd0 2024-08-17T02:28:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.529+0000 7f5c93e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c94153170 0x7f5c940ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.529+0000 7f5c93e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c94153170 0x7f5c940ca130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53654/0 (socket says 172.21.15.106:53654) 2024-08-17T02:28:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.529+0000 7f5c93e00640 1 -- 172.21.15.106:0/1282489475 learned_addr learned my addr 172.21.15.106:0/1282489475 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.530+0000 7f5c93400640 1 --2- 172.21.15.106:0/1282489475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c78003a00 0x7f5c941688c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.530+0000 7f5c92a00640 1 --2- 172.21.15.106:0/1282489475 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c940c3fd0 0x7f5c940c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.530+0000 7f5c93e00640 1 -- 172.21.15.106:0/1282489475 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c940c3fd0 msgr2=0x7f5c940c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.530+0000 7f5c93e00640 1 --2- 172.21.15.106:0/1282489475 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c940c3fd0 0x7f5c940c75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.530+0000 7f5c93e00640 1 -- 172.21.15.106:0/1282489475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c78003a00 msgr2=0x7f5c941688c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.530+0000 7f5c93e00640 1 --2- 172.21.15.106:0/1282489475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c78003a00 0x7f5c941688c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.530+0000 7f5c93e00640 1 -- 172.21.15.106:0/1282489475 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c940c49c0 con 0x7f5c94153170 2024-08-17T02:28:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.530+0000 7f5c92a00640 1 --2- 172.21.15.106:0/1282489475 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c940c3fd0 0x7f5c940c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.530+0000 7f5c93e00640 1 --2- 172.21.15.106:0/1282489475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c94153170 0x7f5c940ca130 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5c940cd0c0 tx=0x7f5c8c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.530+0000 7f5c8aa00640 1 -- 172.21.15.106:0/1282489475 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c00e040 con 0x7f5c94153170 2024-08-17T02:28:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.530+0000 7f5c8aa00640 1 -- 172.21.15.106:0/1282489475 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8c00f040 con 0x7f5c94153170 2024-08-17T02:28:04.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.530+0000 7f5c98a00640 1 -- 172.21.15.106:0/1282489475 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c940c4ca0 con 0x7f5c94153170 2024-08-17T02:28:04.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.530+0000 7f5c8aa00640 1 -- 172.21.15.106:0/1282489475 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8c015940 con 0x7f5c94153170 2024-08-17T02:28:04.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.531+0000 7f5c98a00640 1 -- 172.21.15.106:0/1282489475 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c940c5260 con 0x7f5c94153170 2024-08-17T02:28:04.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.532+0000 7f5c98a00640 1 -- 172.21.15.106:0/1282489475 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c940c5480 con 0x7f5c94153170 2024-08-17T02:28:04.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.532+0000 7f5c8aa00640 1 -- 172.21.15.106:0/1282489475 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5c8c015d30 con 0x7f5c94153170 2024-08-17T02:28:04.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.533+0000 7f5c8aa00640 1 --2- 172.21.15.106:0/1282489475 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5c74065180 0x7f5c74067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.533+0000 7f5c8aa00640 1 -- 172.21.15.106:0/1282489475 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5c8c082560 con 0x7f5c94153170 2024-08-17T02:28:04.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.533+0000 7f5c93400640 1 --2- 172.21.15.106:0/1282489475 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5c74065180 0x7f5c74067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.534+0000 7f5c93400640 1 --2- 172.21.15.106:0/1282489475 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5c74065180 0x7f5c74067630 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5c84033000 tx=0x7f5c84031000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.538+0000 7f5c8aa00640 1 -- 172.21.15.106:0/1282489475 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5c8c0506d0 con 0x7f5c94153170 2024-08-17T02:28:04.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.746+0000 7f5c98a00640 1 -- 172.21.15.106:0/1282489475 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c94071050 con 0x7f5c94153170 2024-08-17T02:28:04.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.747+0000 7f5c8aa00640 1 -- 172.21.15.106:0/1282489475 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f5c8c053cf0 con 0x7f5c94153170 2024-08-17T02:28:04.747 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:04.748 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1696744783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1696744783},{"type":"v1","addr":"172.21.15.106:6837","nonce":1696744783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/966571689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":966571689},{"type":"v1","addr":"172.21.15.171:6833","nonce":966571689}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/3205379168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3205379168},{"type":"v1","addr":"172.21.15.106:6836","nonce":3205379168}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:50.683483+0000","modified":"2024-08-17T02:27:54.296580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6835/3901195482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3901195482},{"type":"v1","addr":"172.21.15.171:6835","nonce":3901195482}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:28:04.748 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 8 2024-08-17T02:28:04.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.749+0000 7f5c98a00640 1 -- 172.21.15.106:0/1282489475 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5c74065180 msgr2=0x7f5c74067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.749+0000 7f5c98a00640 1 --2- 172.21.15.106:0/1282489475 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5c74065180 0x7f5c74067630 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5c84033000 tx=0x7f5c84031000 comp rx=0 tx=0).stop 2024-08-17T02:28:04.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.749+0000 7f5c98a00640 1 -- 172.21.15.106:0/1282489475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c94153170 msgr2=0x7f5c940ca130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.749+0000 7f5c98a00640 1 --2- 172.21.15.106:0/1282489475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c94153170 0x7f5c940ca130 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5c940cd0c0 tx=0x7f5c8c00b040 comp rx=0 tx=0).stop 2024-08-17T02:28:04.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.749+0000 7f5c98a00640 1 -- 172.21.15.106:0/1282489475 shutdown_connections 2024-08-17T02:28:04.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.749+0000 7f5c98a00640 1 --2- 172.21.15.106:0/1282489475 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5c74065180 0x7f5c74067630 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.749+0000 7f5c98a00640 1 --2- 172.21.15.106:0/1282489475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c94153170 0x7f5c940ca130 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.749+0000 7f5c98a00640 1 --2- 172.21.15.106:0/1282489475 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c940c3fd0 0x7f5c940c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.749+0000 7f5c98a00640 1 --2- 172.21.15.106:0/1282489475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c78003a00 0x7f5c941688c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.749+0000 7f5c98a00640 1 -- 172.21.15.106:0/1282489475 >> 172.21.15.106:0/1282489475 conn(0x7f5c94098e00 msgr2=0x7f5c94156d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:04.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.749+0000 7f5c98a00640 1 -- 172.21.15.106:0/1282489475 shutdown_connections 2024-08-17T02:28:04.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.749+0000 7f5c98a00640 1 -- 172.21.15.106:0/1282489475 wait complete. 2024-08-17T02:28:04.764 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:04.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.912+0000 7f29dde00640 1 Processor -- start 2024-08-17T02:28:04.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.912+0000 7f29dde00640 1 -- start start 2024-08-17T02:28:04.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.913+0000 7f29dde00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f29d8158c30 0x7f29d8159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.913+0000 7f29dde00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d80cea50 con 0x7f29d80ccc60 2024-08-17T02:28:04.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.913+0000 7f29dde00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d80cab60 con 0x7f29d80cdd90 2024-08-17T02:28:04.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.913+0000 7f29dde00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d8159000 con 0x7f29d8158c30 2024-08-17T02:28:04.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.913+0000 7f29dd400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f29d80ccc60 0x7f29d81627a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:46320/0 (socket says 172.21.15.106:46320) 2024-08-17T02:28:04.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.913+0000 7f29dd400640 1 -- 172.21.15.106:0/3132483719 learned_addr learned my addr 172.21.15.106:0/3132483719 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:04.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.914+0000 7f29dca00640 1 --2- 172.21.15.106:0/3132483719 >> v2:172.21.15.171:3300/0 conn(0x7f29d8158c30 0x7f29d8159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.914+0000 7f29d7400640 1 -- 172.21.15.106:0/3132483719 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3150892418 0 0) 0x7f29d80cea50 con 0x7f29d80ccc60 2024-08-17T02:28:04.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.914+0000 7f29d7400640 1 -- 172.21.15.106:0/3132483719 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29c00034e0 con 0x7f29d80ccc60 2024-08-17T02:28:04.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.914+0000 7f29d7400640 1 -- 172.21.15.106:0/3132483719 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2291286044 0 0) 0x7f29d80cab60 con 0x7f29d80cdd90 2024-08-17T02:28:04.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.914+0000 7f29d7400640 1 -- 172.21.15.106:0/3132483719 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29d80cea50 con 0x7f29d80cdd90 2024-08-17T02:28:04.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.914+0000 7f29d7400640 1 -- 172.21.15.106:0/3132483719 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1698084567 0 0) 0x7f29c00034e0 con 0x7f29d80ccc60 2024-08-17T02:28:04.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.914+0000 7f29d7400640 1 -- 172.21.15.106:0/3132483719 >> v2:172.21.15.171:3300/0 conn(0x7f29d8158c30 msgr2=0x7f29d8159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:04.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.914+0000 7f29d7400640 1 --2- 172.21.15.106:0/3132483719 >> v2:172.21.15.171:3300/0 conn(0x7f29d8158c30 0x7f29d8159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.914+0000 7f29d7400640 1 -- 172.21.15.106:0/3132483719 >> v1:172.21.15.171:6789/0 conn(0x7f29d80cdd90 legacy=0x7f29d80cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.914+0000 7f29d7400640 1 -- 172.21.15.106:0/3132483719 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d80ce1e0 con 0x7f29d80ccc60 2024-08-17T02:28:04.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.914+0000 7f29d7400640 1 -- 172.21.15.106:0/3132483719 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7f29d00017f0 con 0x7f29d80ccc60 2024-08-17T02:28:04.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.914+0000 7f29d7400640 1 -- 172.21.15.106:0/3132483719 >> v1:172.21.15.106:6789/0 conn(0x7f29d80ccc60 legacy=0x7f29d81627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.914+0000 7f29d7400640 1 --2- 172.21.15.106:0/3132483719 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29c0003b60 0x7f29c0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.914+0000 7f29d7400640 1 --2- 172.21.15.106:0/3132483719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29c0004780 0x7f29c0004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.914+0000 7f29d7400640 1 --2- 172.21.15.106:0/3132483719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29c0005130 0x7f29c000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.914+0000 7f29d7400640 1 -- 172.21.15.106:0/3132483719 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d8159000 con 0x7f29c0003b60 2024-08-17T02:28:04.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.914+0000 7f29d7400640 1 -- 172.21.15.106:0/3132483719 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c000c020 con 0x7f29c0004780 2024-08-17T02:28:04.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.914+0000 7f29d7400640 1 -- 172.21.15.106:0/3132483719 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c000c1e0 con 0x7f29c0005130 2024-08-17T02:28:04.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.914+0000 7f29dca00640 1 --2- 172.21.15.106:0/3132483719 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29c0003b60 0x7f29c0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.915+0000 7f29dd400640 1 --2- 172.21.15.106:0/3132483719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29c0005130 0x7f29c000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.915+0000 7f29d7e00640 1 --2- 172.21.15.106:0/3132483719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29c0004780 0x7f29c0004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.915+0000 7f29dca00640 1 -- 172.21.15.106:0/3132483719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29c0005130 msgr2=0x7f29c000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:04.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.915+0000 7f29dca00640 1 --2- 172.21.15.106:0/3132483719 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29c0005130 0x7f29c000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.915+0000 7f29dca00640 1 -- 172.21.15.106:0/3132483719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29c0004780 msgr2=0x7f29c0004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:04.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.915+0000 7f29dca00640 1 --2- 172.21.15.106:0/3132483719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29c0004780 0x7f29c0004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.915+0000 7f29dca00640 1 -- 172.21.15.106:0/3132483719 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c00034e0 con 0x7f29c0003b60 2024-08-17T02:28:04.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.915+0000 7f29d7e00640 1 --2- 172.21.15.106:0/3132483719 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29c0004780 0x7f29c0004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:04.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.915+0000 7f29dd400640 1 -- 172.21.15.106:0/3132483719 reap_dead start 2024-08-17T02:28:04.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.916+0000 7f29dca00640 1 --2- 172.21.15.106:0/3132483719 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29c0003b60 0x7f29c0003f50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f29cc009b70 tx=0x7f29cc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa7d7d497f6bf91 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.916+0000 7f29d7400640 1 -- 172.21.15.106:0/3132483719 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc031400 con 0x7f29c0003b60 2024-08-17T02:28:04.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.916+0000 7f29d7400640 1 -- 172.21.15.106:0/3132483719 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc02d050 con 0x7f29c0003b60 2024-08-17T02:28:04.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.916+0000 7f29d7400640 1 -- 172.21.15.106:0/3132483719 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc031790 con 0x7f29c0003b60 2024-08-17T02:28:04.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.916+0000 7f29dde00640 1 -- 172.21.15.106:0/3132483719 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29c0003b60 msgr2=0x7f29c0003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.916+0000 7f29dde00640 1 --2- 172.21.15.106:0/3132483719 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29c0003b60 0x7f29c0003f50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f29cc009b70 tx=0x7f29cc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.917+0000 7f29dde00640 1 -- 172.21.15.106:0/3132483719 shutdown_connections 2024-08-17T02:28:04.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.917+0000 7f29dde00640 1 --2- 172.21.15.106:0/3132483719 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29c0003b60 0x7f29c0003f50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.917+0000 7f29dde00640 1 -- 172.21.15.106:0/3132483719 >> 172.21.15.106:0/3132483719 conn(0x7f29d8098e20 msgr2=0x7f29d806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:04.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.917+0000 7f29dde00640 1 -- 172.21.15.106:0/3132483719 shutdown_connections 2024-08-17T02:28:04.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.917+0000 7f29dde00640 1 -- 172.21.15.106:0/3132483719 wait complete. 2024-08-17T02:28:04.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.918+0000 7f29dde00640 1 Processor -- start 2024-08-17T02:28:04.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.918+0000 7f29dde00640 1 -- start start 2024-08-17T02:28:04.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.919+0000 7f29dde00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29c0003b60 0x7f29d8143f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.919+0000 7f29dde00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29d81455c0 0x7f29d8145a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.919+0000 7f29dde00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29d8147a80 0x7f29d8147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.919+0000 7f29dde00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d8146f20 con 0x7f29d8147a80 2024-08-17T02:28:04.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.919+0000 7f29dde00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d8146310 con 0x7f29c0003b60 2024-08-17T02:28:04.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.919+0000 7f29dde00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d81465f0 con 0x7f29d81455c0 2024-08-17T02:28:04.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.919+0000 7f29dd400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29d8147a80 0x7f29d8147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.919+0000 7f29dd400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29d8147a80 0x7f29d8147ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53672/0 (socket says 172.21.15.106:53672) 2024-08-17T02:28:04.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.919+0000 7f29dd400640 1 -- 172.21.15.106:0/3170660119 learned_addr learned my addr 172.21.15.106:0/3170660119 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:04.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.919+0000 7f29dca00640 1 --2- 172.21.15.106:0/3170660119 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29c0003b60 0x7f29d8143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.919+0000 7f29d7e00640 1 --2- 172.21.15.106:0/3170660119 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29d81455c0 0x7f29d8145a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.920+0000 7f29dd400640 1 -- 172.21.15.106:0/3170660119 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29d81455c0 msgr2=0x7f29d8145a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.920+0000 7f29dd400640 1 --2- 172.21.15.106:0/3170660119 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29d81455c0 0x7f29d8145a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.920+0000 7f29dd400640 1 -- 172.21.15.106:0/3170660119 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29c0003b60 msgr2=0x7f29d8143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:04.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.920+0000 7f29dd400640 1 --2- 172.21.15.106:0/3170660119 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29c0003b60 0x7f29d8143f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:04.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.920+0000 7f29dd400640 1 -- 172.21.15.106:0/3170660119 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d81468d0 con 0x7f29d8147a80 2024-08-17T02:28:04.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.920+0000 7f29d7e00640 1 --2- 172.21.15.106:0/3170660119 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29d81455c0 0x7f29d8145a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:04.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.920+0000 7f29dd400640 1 --2- 172.21.15.106:0/3170660119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29d8147a80 0x7f29d8147ef0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f29d0000f80 tx=0x7f29d80caad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.920+0000 7f29cbe00640 1 -- 172.21.15.106:0/3170660119 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d0012590 con 0x7f29d8147a80 2024-08-17T02:28:04.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.920+0000 7f29cbe00640 1 -- 172.21.15.106:0/3170660119 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d0012710 con 0x7f29d8147a80 2024-08-17T02:28:04.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.920+0000 7f29dde00640 1 -- 172.21.15.106:0/3170660119 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d8146bb0 con 0x7f29d8147a80 2024-08-17T02:28:04.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.920+0000 7f29cbe00640 1 -- 172.21.15.106:0/3170660119 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d0012ad0 con 0x7f29d8147a80 2024-08-17T02:28:04.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.920+0000 7f29dde00640 1 -- 172.21.15.106:0/3170660119 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d8145f70 con 0x7f29d8147a80 2024-08-17T02:28:04.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.922+0000 7f29dde00640 1 -- 172.21.15.106:0/3170660119 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d8147090 con 0x7f29d8147a80 2024-08-17T02:28:04.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.922+0000 7f29cbe00640 1 -- 172.21.15.106:0/3170660119 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f29d001d460 con 0x7f29d8147a80 2024-08-17T02:28:04.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.923+0000 7f29cbe00640 1 --2- 172.21.15.106:0/3170660119 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f29b8065150 0x7f29b8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:04.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.923+0000 7f29cbe00640 1 -- 172.21.15.106:0/3170660119 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f29d00821b0 con 0x7f29d8147a80 2024-08-17T02:28:04.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.923+0000 7f29dca00640 1 --2- 172.21.15.106:0/3170660119 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f29b8065150 0x7f29b8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:04.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.924+0000 7f29dca00640 1 --2- 172.21.15.106:0/3170660119 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f29b8065150 0x7f29b8067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f29cc034000 tx=0x7f29cc035000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:04.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:04.927+0000 7f29cbe00640 1 -- 172.21.15.106:0/3170660119 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f29d0050270 con 0x7f29d8147a80 2024-08-17T02:28:05.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.098+0000 7f29dde00640 1 -- 172.21.15.106:0/3170660119 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29d8146730 con 0x7f29d8147a80 2024-08-17T02:28:05.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.099+0000 7f29cbe00640 1 -- 172.21.15.106:0/3170660119 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f29d8146730 con 0x7f29d8147a80 2024-08-17T02:28:05.100 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:05.100 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:27:52.284039+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:48.547438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:49.671073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:05.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.101+0000 7f29dde00640 1 -- 172.21.15.106:0/3170660119 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f29b8065150 msgr2=0x7f29b8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.101+0000 7f29dde00640 1 --2- 172.21.15.106:0/3170660119 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f29b8065150 0x7f29b8067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f29cc034000 tx=0x7f29cc035000 comp rx=0 tx=0).stop 2024-08-17T02:28:05.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.101+0000 7f29dde00640 1 -- 172.21.15.106:0/3170660119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29d8147a80 msgr2=0x7f29d8147ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.101+0000 7f29dde00640 1 --2- 172.21.15.106:0/3170660119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29d8147a80 0x7f29d8147ef0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f29d0000f80 tx=0x7f29d80caad0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.101+0000 7f29dde00640 1 -- 172.21.15.106:0/3170660119 shutdown_connections 2024-08-17T02:28:05.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.101+0000 7f29dde00640 1 --2- 172.21.15.106:0/3170660119 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f29b8065150 0x7f29b8067600 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.101+0000 7f29dde00640 1 --2- 172.21.15.106:0/3170660119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29d8147a80 0x7f29d8147ef0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.101+0000 7f29dde00640 1 --2- 172.21.15.106:0/3170660119 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29d81455c0 0x7f29d8145a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.101+0000 7f29dde00640 1 --2- 172.21.15.106:0/3170660119 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29c0003b60 0x7f29d8143f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.101+0000 7f29dde00640 1 -- 172.21.15.106:0/3170660119 >> 172.21.15.106:0/3170660119 conn(0x7f29d8098e20 msgr2=0x7f29d80cbb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:05.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.102+0000 7f29dde00640 1 -- 172.21.15.106:0/3170660119 shutdown_connections 2024-08-17T02:28:05.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.102+0000 7f29dde00640 1 -- 172.21.15.106:0/3170660119 wait complete. 2024-08-17T02:28:05.117 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:05.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.264+0000 7fe7aee00640 1 Processor -- start 2024-08-17T02:28:05.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.264+0000 7fe7aee00640 1 -- start start 2024-08-17T02:28:05.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.265+0000 7fe7aee00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe7a80caa40 0x7fe7a80ace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.265+0000 7fe7aee00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a80cb560 con 0x7fe7a8159350 2024-08-17T02:28:05.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.265+0000 7fe7aee00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a80cf7e0 con 0x7fe7a8158f80 2024-08-17T02:28:05.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.265+0000 7fe7aee00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a80cfac0 con 0x7fe7a80caa40 2024-08-17T02:28:05.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.265+0000 7fe7ace00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe7a8159350 0x7fe7a80ad380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:46330/0 (socket says 172.21.15.106:46330) 2024-08-17T02:28:05.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.265+0000 7fe7ace00640 1 -- 172.21.15.106:0/3052408645 learned_addr learned my addr 172.21.15.106:0/3052408645 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:05.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.266+0000 7fe7a7400640 1 --2- 172.21.15.106:0/3052408645 >> v2:172.21.15.171:3300/0 conn(0x7fe7a80caa40 0x7fe7a80ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.266+0000 7fe7a6a00640 1 -- 172.21.15.106:0/3052408645 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3732674394 0 0) 0x7fe7a80cb560 con 0x7fe7a8159350 2024-08-17T02:28:05.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.266+0000 7fe7a6a00640 1 -- 172.21.15.106:0/3052408645 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe78c0034e0 con 0x7fe7a8159350 2024-08-17T02:28:05.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.266+0000 7fe7a6a00640 1 -- 172.21.15.106:0/3052408645 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2122623676 0 0) 0x7fe7a80cf7e0 con 0x7fe7a8158f80 2024-08-17T02:28:05.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.266+0000 7fe7a6a00640 1 -- 172.21.15.106:0/3052408645 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7a80cb560 con 0x7fe7a8158f80 2024-08-17T02:28:05.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.266+0000 7fe7a7400640 1 -- 172.21.15.106:0/3052408645 >> v1:172.21.15.171:6789/0 conn(0x7fe7a8158f80 legacy=0x7fe7a80ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.266+0000 7fe7a7400640 1 -- 172.21.15.106:0/3052408645 >> v1:172.21.15.106:6789/0 conn(0x7fe7a8159350 legacy=0x7fe7a80ad380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.266+0000 7fe7a7400640 1 -- 172.21.15.106:0/3052408645 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a80caf10 con 0x7fe7a80caa40 2024-08-17T02:28:05.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.267+0000 7fe7a7400640 1 --2- 172.21.15.106:0/3052408645 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7a80caa40 0x7fe7a80ace40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe794009850 tx=0x7fe7940090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6132c9ed162b8db server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.267+0000 7fe7a6a00640 1 -- 172.21.15.106:0/3052408645 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79402ae20 con 0x7fe7a80caa40 2024-08-17T02:28:05.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.267+0000 7fe7a6a00640 1 -- 172.21.15.106:0/3052408645 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe794032440 con 0x7fe7a80caa40 2024-08-17T02:28:05.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.267+0000 7fe7a6a00640 1 -- 172.21.15.106:0/3052408645 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7940327e0 con 0x7fe7a80caa40 2024-08-17T02:28:05.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.268+0000 7fe7aee00640 1 -- 172.21.15.106:0/3052408645 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7a80caa40 msgr2=0x7fe7a80ace40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.268+0000 7fe7aee00640 1 --2- 172.21.15.106:0/3052408645 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7a80caa40 0x7fe7a80ace40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe794009850 tx=0x7fe7940090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.268+0000 7fe7aee00640 1 -- 172.21.15.106:0/3052408645 shutdown_connections 2024-08-17T02:28:05.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.268+0000 7fe7aee00640 1 --2- 172.21.15.106:0/3052408645 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7a80caa40 0x7fe7a80ace40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.268+0000 7fe7aee00640 1 -- 172.21.15.106:0/3052408645 >> 172.21.15.106:0/3052408645 conn(0x7fe7a80cfd90 msgr2=0x7fe7a80d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:05.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.268+0000 7fe7aee00640 1 -- 172.21.15.106:0/3052408645 shutdown_connections 2024-08-17T02:28:05.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.268+0000 7fe7aee00640 1 -- 172.21.15.106:0/3052408645 wait complete. 2024-08-17T02:28:05.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.269+0000 7fe7aee00640 1 Processor -- start 2024-08-17T02:28:05.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.270+0000 7fe7aee00640 1 -- start start 2024-08-17T02:28:05.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.270+0000 7fe7aee00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7a80caa40 0x7fe7a81551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.270+0000 7fe7aee00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7a8158f80 0x7fe7a80b4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.270+0000 7fe7aee00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7a8159350 0x7fe7a80c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.270+0000 7fe7aee00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a80ca120 con 0x7fe7a80caa40 2024-08-17T02:28:05.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.270+0000 7fe7aee00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a80b3030 con 0x7fe7a8158f80 2024-08-17T02:28:05.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.270+0000 7fe7aee00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a80b2d00 con 0x7fe7a8159350 2024-08-17T02:28:05.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.271+0000 7fe7a7e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7a80caa40 0x7fe7a81551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.271+0000 7fe7a7e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7a80caa40 0x7fe7a81551f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53680/0 (socket says 172.21.15.106:53680) 2024-08-17T02:28:05.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.271+0000 7fe7a7e00640 1 -- 172.21.15.106:0/782696068 learned_addr learned my addr 172.21.15.106:0/782696068 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.271+0000 7fe7ace00640 1 --2- 172.21.15.106:0/782696068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7a8159350 0x7fe7a80c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.271+0000 7fe7a7400640 1 --2- 172.21.15.106:0/782696068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7a8158f80 0x7fe7a80b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.271+0000 7fe7a7e00640 1 -- 172.21.15.106:0/782696068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7a8159350 msgr2=0x7fe7a80c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.271+0000 7fe7a7e00640 1 --2- 172.21.15.106:0/782696068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7a8159350 0x7fe7a80c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.271+0000 7fe7a7e00640 1 -- 172.21.15.106:0/782696068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7a8158f80 msgr2=0x7fe7a80b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.271+0000 7fe7a7e00640 1 --2- 172.21.15.106:0/782696068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7a8158f80 0x7fe7a80b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.271+0000 7fe7a7e00640 1 -- 172.21.15.106:0/782696068 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe794009390 con 0x7fe7a80caa40 2024-08-17T02:28:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.271+0000 7fe7ace00640 1 --2- 172.21.15.106:0/782696068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7a8159350 0x7fe7a80c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.271+0000 7fe7a7e00640 1 --2- 172.21.15.106:0/782696068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7a80caa40 0x7fe7a81551f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe79800c590 tx=0x7fe798007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.271+0000 7fe79f400640 1 -- 172.21.15.106:0/782696068 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe798012630 con 0x7fe7a80caa40 2024-08-17T02:28:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.272+0000 7fe79f400640 1 -- 172.21.15.106:0/782696068 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7980127b0 con 0x7fe7a80caa40 2024-08-17T02:28:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.272+0000 7fe7aee00640 1 -- 172.21.15.106:0/782696068 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a80c9b60 con 0x7fe7a80caa40 2024-08-17T02:28:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.272+0000 7fe79f400640 1 -- 172.21.15.106:0/782696068 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe798012b70 con 0x7fe7a80caa40 2024-08-17T02:28:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.272+0000 7fe7aee00640 1 -- 172.21.15.106:0/782696068 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a815c5f0 con 0x7fe7a80caa40 2024-08-17T02:28:05.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.273+0000 7fe7aee00640 1 -- 172.21.15.106:0/782696068 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a80b2b60 con 0x7fe7a80caa40 2024-08-17T02:28:05.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.273+0000 7fe79f400640 1 -- 172.21.15.106:0/782696068 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe79801a3b0 con 0x7fe7a80caa40 2024-08-17T02:28:05.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.275+0000 7fe79f400640 1 --2- 172.21.15.106:0/782696068 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe788065150 0x7fe788067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:05.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.275+0000 7fe79f400640 1 -- 172.21.15.106:0/782696068 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe798082410 con 0x7fe7a80caa40 2024-08-17T02:28:05.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.275+0000 7fe7a7400640 1 --2- 172.21.15.106:0/782696068 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe788065150 0x7fe788067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:05.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.275+0000 7fe7a7400640 1 --2- 172.21.15.106:0/782696068 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe788065150 0x7fe788067600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe794034000 tx=0x7fe794032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:05.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.279+0000 7fe79f400640 1 -- 172.21.15.106:0/782696068 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe7a80b2b60 con 0x7fe7a80caa40 2024-08-17T02:28:05.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.487+0000 7fe7aee00640 1 -- 172.21.15.106:0/782696068 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7a80b2b60 con 0x7fe7a80caa40 2024-08-17T02:28:05.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.487+0000 7fe79f400640 1 -- 172.21.15.106:0/782696068 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7fe7a80b2b60 con 0x7fe7a80caa40 2024-08-17T02:28:05.488 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:05.488 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1696744783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1696744783},{"type":"v1","addr":"172.21.15.106:6837","nonce":1696744783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/966571689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":966571689},{"type":"v1","addr":"172.21.15.171:6833","nonce":966571689}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/3205379168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3205379168},{"type":"v1","addr":"172.21.15.106:6836","nonce":3205379168}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:50.683483+0000","modified":"2024-08-17T02:27:54.296580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6835/3901195482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3901195482},{"type":"v1","addr":"172.21.15.171:6835","nonce":3901195482}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:28:05.488 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 8 2024-08-17T02:28:05.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.489+0000 7fe7aee00640 1 -- 172.21.15.106:0/782696068 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe788065150 msgr2=0x7fe788067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.489+0000 7fe7aee00640 1 --2- 172.21.15.106:0/782696068 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe788065150 0x7fe788067600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe794034000 tx=0x7fe794032000 comp rx=0 tx=0).stop 2024-08-17T02:28:05.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.489+0000 7fe7aee00640 1 -- 172.21.15.106:0/782696068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7a80caa40 msgr2=0x7fe7a81551f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:05.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.489+0000 7fe7aee00640 1 --2- 172.21.15.106:0/782696068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7a80caa40 0x7fe7a81551f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe79800c590 tx=0x7fe798007d80 comp rx=0 tx=0).stop 2024-08-17T02:28:05.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.489+0000 7fe7aee00640 1 -- 172.21.15.106:0/782696068 shutdown_connections 2024-08-17T02:28:05.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.489+0000 7fe7aee00640 1 --2- 172.21.15.106:0/782696068 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe7a8159350 0x7fe7a80c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.489+0000 7fe7aee00640 1 --2- 172.21.15.106:0/782696068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe7a8158f80 0x7fe7a80b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.489+0000 7fe7aee00640 1 --2- 172.21.15.106:0/782696068 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe788065150 0x7fe788067600 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.489+0000 7fe7aee00640 1 --2- 172.21.15.106:0/782696068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7a80caa40 0x7fe7a81551f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:05.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.489+0000 7fe7aee00640 1 -- 172.21.15.106:0/782696068 >> 172.21.15.106:0/782696068 conn(0x7fe7a80cfd90 msgr2=0x7fe7a8067540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:05.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.489+0000 7fe7aee00640 1 -- 172.21.15.106:0/782696068 shutdown_connections 2024-08-17T02:28:05.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:05.489+0000 7fe7aee00640 1 -- 172.21.15.106:0/782696068 wait complete. 2024-08-17T02:28:05.907 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:27:50.683483+0000', 'modified': '2024-08-17T02:27:54.296580+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4300}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4300': {'gid': 4300, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.171:6835/3901195482', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6834', 'nonce': 3901195482}, {'type': 'v1', 'addr': '172.21.15.171:6835', 'nonce': 3901195482}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:28:05.908 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:28:05.908 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-08-17T02:28:06.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.056+0000 7fe572600640 1 Processor -- start 2024-08-17T02:28:06.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.056+0000 7fe572600640 1 -- start start 2024-08-17T02:28:06.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.057+0000 7fe572600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe56c0af6d0 0x7fe56c0aa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.057+0000 7fe572600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe56c0abc80 con 0x7fe56c158cb0 2024-08-17T02:28:06.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.057+0000 7fe572600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe56c0afb20 con 0x7fe56c0ac820 2024-08-17T02:28:06.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.057+0000 7fe572600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c0aae50 con 0x7fe56c0af6d0 2024-08-17T02:28:06.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.057+0000 7fe56b400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe56c158cb0 0x7fe56c0ac110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:46334/0 (socket says 172.21.15.106:46334) 2024-08-17T02:28:06.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.057+0000 7fe56b400640 1 -- 172.21.15.106:0/3237600394 learned_addr learned my addr 172.21.15.106:0/3237600394 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:06.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.058+0000 7fe562a00640 1 --2- 172.21.15.106:0/3237600394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe56c0af6d0 0x7fe56c0aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.058+0000 7fe56aa00640 1 -- 172.21.15.106:0/3237600394 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 356385255 0 0) 0x7fe56c0abc80 con 0x7fe56c158cb0 2024-08-17T02:28:06.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.058+0000 7fe56aa00640 1 -- 172.21.15.106:0/3237600394 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5500034e0 con 0x7fe56c158cb0 2024-08-17T02:28:06.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.058+0000 7fe56aa00640 1 -- 172.21.15.106:0/3237600394 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780030348 0 0) 0x7fe56c0afb20 con 0x7fe56c0ac820 2024-08-17T02:28:06.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.058+0000 7fe56aa00640 1 -- 172.21.15.106:0/3237600394 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe56c0abc80 con 0x7fe56c0ac820 2024-08-17T02:28:06.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.058+0000 7fe56aa00640 1 -- 172.21.15.106:0/3237600394 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 852762326 0 0) 0x7fe5500034e0 con 0x7fe56c158cb0 2024-08-17T02:28:06.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.058+0000 7fe56aa00640 1 -- 172.21.15.106:0/3237600394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe56c0af6d0 msgr2=0x7fe56c0aa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.058+0000 7fe56aa00640 1 --2- 172.21.15.106:0/3237600394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe56c0af6d0 0x7fe56c0aa910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.058+0000 7fe56aa00640 1 -- 172.21.15.106:0/3237600394 >> v1:172.21.15.171:6789/0 conn(0x7fe56c0ac820 legacy=0x7fe56c159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.058+0000 7fe56aa00640 1 -- 172.21.15.106:0/3237600394 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56c0ab070 con 0x7fe56c158cb0 2024-08-17T02:28:06.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.058+0000 7fe56aa00640 1 -- 172.21.15.106:0/3237600394 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7fe55c0017f0 con 0x7fe56c158cb0 2024-08-17T02:28:06.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.058+0000 7fe56aa00640 1 -- 172.21.15.106:0/3237600394 >> v1:172.21.15.106:6789/0 conn(0x7fe56c158cb0 legacy=0x7fe56c0ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.058+0000 7fe56aa00640 1 --2- 172.21.15.106:0/3237600394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe550003b90 0x7fe550003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.058+0000 7fe56aa00640 1 --2- 172.21.15.106:0/3237600394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe56c0af6d0 0x7fe550004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.058+0000 7fe56aa00640 1 --2- 172.21.15.106:0/3237600394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe550004cc0 0x7fe550005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.058+0000 7fe56aa00640 1 -- 172.21.15.106:0/3237600394 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c0aae50 con 0x7fe550004cc0 2024-08-17T02:28:06.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.058+0000 7fe56aa00640 1 -- 172.21.15.106:0/3237600394 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55000bb60 con 0x7fe550003b90 2024-08-17T02:28:06.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.058+0000 7fe56aa00640 1 -- 172.21.15.106:0/3237600394 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55000bcd0 con 0x7fe56c0af6d0 2024-08-17T02:28:06.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.058+0000 7fe56b400640 1 --2- 172.21.15.106:0/3237600394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe550003b90 0x7fe550003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.058+0000 7fe56be00640 1 --2- 172.21.15.106:0/3237600394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe550004cc0 0x7fe550005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.059+0000 7fe562a00640 1 --2- 172.21.15.106:0/3237600394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe56c0af6d0 0x7fe550004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.059+0000 7fe56b400640 1 -- 172.21.15.106:0/3237600394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe56c0af6d0 msgr2=0x7fe550004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.059+0000 7fe56b400640 1 --2- 172.21.15.106:0/3237600394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe56c0af6d0 0x7fe550004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.059+0000 7fe56b400640 1 -- 172.21.15.106:0/3237600394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe550004cc0 msgr2=0x7fe550005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.059+0000 7fe56b400640 1 --2- 172.21.15.106:0/3237600394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe550004cc0 0x7fe550005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.059+0000 7fe56b400640 1 -- 172.21.15.106:0/3237600394 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5500034e0 con 0x7fe550003b90 2024-08-17T02:28:06.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.060+0000 7fe56b400640 1 --2- 172.21.15.106:0/3237600394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe550003b90 0x7fe550003f80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00a7d0 tx=0x7fe55c0020c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb5324ac31d0b34c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.060+0000 7fe56aa00640 1 -- 172.21.15.106:0/3237600394 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c0071c0 con 0x7fe550003b90 2024-08-17T02:28:06.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.060+0000 7fe56aa00640 1 -- 172.21.15.106:0/3237600394 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55c007340 con 0x7fe550003b90 2024-08-17T02:28:06.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.060+0000 7fe56aa00640 1 -- 172.21.15.106:0/3237600394 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c007700 con 0x7fe550003b90 2024-08-17T02:28:06.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.061+0000 7fe572600640 1 -- 172.21.15.106:0/3237600394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe550003b90 msgr2=0x7fe550003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.061+0000 7fe572600640 1 --2- 172.21.15.106:0/3237600394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe550003b90 0x7fe550003f80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00a7d0 tx=0x7fe55c0020c0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.061+0000 7fe56be00640 1 -- 172.21.15.106:0/3237600394 reap_dead start 2024-08-17T02:28:06.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.061+0000 7fe572600640 1 -- 172.21.15.106:0/3237600394 shutdown_connections 2024-08-17T02:28:06.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.061+0000 7fe572600640 1 -- 172.21.15.106:0/3237600394 >> 172.21.15.106:0/3237600394 conn(0x7fe56c096a70 msgr2=0x7fe56c096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:06.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.061+0000 7fe572600640 1 -- 172.21.15.106:0/3237600394 shutdown_connections 2024-08-17T02:28:06.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.061+0000 7fe572600640 1 -- 172.21.15.106:0/3237600394 wait complete. 2024-08-17T02:28:06.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.062+0000 7fe572600640 1 Processor -- start 2024-08-17T02:28:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.062+0000 7fe572600640 1 -- start start 2024-08-17T02:28:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.063+0000 7fe572600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe550003b90 0x7fe56c169d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.063+0000 7fe572600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe56c0c6d10 0x7fe56c09a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.063+0000 7fe572600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe56c09ad00 0x7fe56c09b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.063+0000 7fe572600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c09b6e0 con 0x7fe56c09ad00 2024-08-17T02:28:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.063+0000 7fe572600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c0c8d00 con 0x7fe56c0c6d10 2024-08-17T02:28:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.063+0000 7fe572600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c0c7db0 con 0x7fe550003b90 2024-08-17T02:28:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.063+0000 7fe56be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe56c09ad00 0x7fe56c09b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.063+0000 7fe56be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe56c09ad00 0x7fe56c09b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53696/0 (socket says 172.21.15.106:53696) 2024-08-17T02:28:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.063+0000 7fe56be00640 1 -- 172.21.15.106:0/3822247423 learned_addr learned my addr 172.21.15.106:0/3822247423 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.064+0000 7fe56b400640 1 --2- 172.21.15.106:0/3822247423 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe550003b90 0x7fe56c169d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.064+0000 7fe562a00640 1 --2- 172.21.15.106:0/3822247423 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe56c0c6d10 0x7fe56c09a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.064+0000 7fe56be00640 1 -- 172.21.15.106:0/3822247423 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe550003b90 msgr2=0x7fe56c169d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.064+0000 7fe56be00640 1 --2- 172.21.15.106:0/3822247423 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe550003b90 0x7fe56c169d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.064+0000 7fe56be00640 1 -- 172.21.15.106:0/3822247423 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe56c0c6d10 msgr2=0x7fe56c09a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.064+0000 7fe56be00640 1 --2- 172.21.15.106:0/3822247423 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe56c0c6d10 0x7fe56c09a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.064+0000 7fe56be00640 1 -- 172.21.15.106:0/3822247423 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56c16a2c0 con 0x7fe56c09ad00 2024-08-17T02:28:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.064+0000 7fe562a00640 1 --2- 172.21.15.106:0/3822247423 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe56c0c6d10 0x7fe56c09a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.064+0000 7fe56b400640 1 --2- 172.21.15.106:0/3822247423 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe550003b90 0x7fe56c169d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.064+0000 7fe56be00640 1 --2- 172.21.15.106:0/3822247423 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe56c09ad00 0x7fe56c09b1a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe56c0ad480 tx=0x7fe564007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.064+0000 7fe563400640 1 -- 172.21.15.106:0/3822247423 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe564007030 con 0x7fe56c09ad00 2024-08-17T02:28:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.064+0000 7fe563400640 1 -- 172.21.15.106:0/3822247423 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe564007190 con 0x7fe56c09ad00 2024-08-17T02:28:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.064+0000 7fe572600640 1 -- 172.21.15.106:0/3822247423 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe56c09a940 con 0x7fe56c09ad00 2024-08-17T02:28:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.064+0000 7fe563400640 1 -- 172.21.15.106:0/3822247423 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe564007550 con 0x7fe56c09ad00 2024-08-17T02:28:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.064+0000 7fe572600640 1 -- 172.21.15.106:0/3822247423 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe56c0c7480 con 0x7fe56c09ad00 2024-08-17T02:28:06.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.066+0000 7fe563400640 1 -- 172.21.15.106:0/3822247423 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe5640069a0 con 0x7fe56c09ad00 2024-08-17T02:28:06.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.067+0000 7fe563400640 1 --2- 172.21.15.106:0/3822247423 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe548065180 0x7fe548067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.068+0000 7fe563400640 1 -- 172.21.15.106:0/3822247423 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe564081780 con 0x7fe56c09ad00 2024-08-17T02:28:06.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.068+0000 7fe56b400640 1 --2- 172.21.15.106:0/3822247423 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe548065180 0x7fe548067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.068+0000 7fe56b400640 1 --2- 172.21.15.106:0/3822247423 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe548065180 0x7fe548067630 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe55c033000 tx=0x7fe55c034000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.068+0000 7fe574b91740 1 Processor -- start 2024-08-17T02:28:06.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.068+0000 7fe574b91740 1 -- start start 2024-08-17T02:28:06.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.069+0000 7fe574b91740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5631cf8eea30 0x5631cf8eee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.069+0000 7fe574b91740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf8ca0a0 0x5631cf90c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.069+0000 7fe574b91740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5631cf90cb10 0x5631cf8c3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.069+0000 7fe574b91740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631cf884380 con 0x5631cf8ca0a0 2024-08-17T02:28:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.069+0000 7fe574b91740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631cf82d9e0 con 0x5631cf8eea30 2024-08-17T02:28:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.069+0000 7fe574b91740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x5631cf82b170 con 0x5631cf90cb10 2024-08-17T02:28:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.069+0000 7fe562a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf8ca0a0 0x5631cf90c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.070+0000 7fe562a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf8ca0a0 0x5631cf90c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53698/0 (socket says 172.21.15.106:53698) 2024-08-17T02:28:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.070+0000 7fe562a00640 1 -- 172.21.15.106:0/466610033 learned_addr learned my addr 172.21.15.106:0/466610033 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.070+0000 7fe56be00640 1 --2- 172.21.15.106:0/466610033 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5631cf90cb10 0x5631cf8c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.070+0000 7fe56b400640 1 --2- 172.21.15.106:0/466610033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5631cf8eea30 0x5631cf8eee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.070+0000 7fe562a00640 1 -- 172.21.15.106:0/466610033 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5631cf90cb10 msgr2=0x5631cf8c3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.070+0000 7fe562a00640 1 --2- 172.21.15.106:0/466610033 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5631cf90cb10 0x5631cf8c3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.070+0000 7fe562a00640 1 -- 172.21.15.106:0/466610033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5631cf8eea30 msgr2=0x5631cf8eee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.070+0000 7fe562a00640 1 --2- 172.21.15.106:0/466610033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5631cf8eea30 0x5631cf8eee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.070+0000 7fe562a00640 1 -- 172.21.15.106:0/466610033 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5631cf7da820 con 0x5631cf8ca0a0 2024-08-17T02:28:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.070+0000 7fe562a00640 1 --2- 172.21.15.106:0/466610033 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf8ca0a0 0x5631cf90c5d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe554009be0 tx=0x7fe554008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d5ec0c47a1ffc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.070+0000 7fe55b400640 1 -- 172.21.15.106:0/466610033 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe554013cc0 con 0x5631cf8ca0a0 2024-08-17T02:28:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.070+0000 7fe55b400640 1 -- 172.21.15.106:0/466610033 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe554013e20 con 0x5631cf8ca0a0 2024-08-17T02:28:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.070+0000 7fe55b400640 1 -- 172.21.15.106:0/466610033 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe554016670 con 0x5631cf8ca0a0 2024-08-17T02:28:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.071+0000 7fe574b91740 1 -- 172.21.15.106:0/466610033 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf8ca0a0 msgr2=0x5631cf90c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.071+0000 7fe574b91740 1 --2- 172.21.15.106:0/466610033 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf8ca0a0 0x5631cf90c5d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe554009be0 tx=0x7fe554008040 comp rx=0 tx=0).stop 2024-08-17T02:28:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.071+0000 7fe574b91740 1 -- 172.21.15.106:0/466610033 shutdown_connections 2024-08-17T02:28:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.071+0000 7fe574b91740 1 --2- 172.21.15.106:0/466610033 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5631cf90cb10 0x5631cf8c3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.071+0000 7fe574b91740 1 --2- 172.21.15.106:0/466610033 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf8ca0a0 0x5631cf90c5d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.071+0000 7fe574b91740 1 --2- 172.21.15.106:0/466610033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5631cf8eea30 0x5631cf8eee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.071+0000 7fe574b91740 1 -- 172.21.15.106:0/466610033 >> 172.21.15.106:0/466610033 conn(0x5631cf862030 msgr2=0x5631cf910c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.071+0000 7fe574b91740 1 -- 172.21.15.106:0/466610033 shutdown_connections 2024-08-17T02:28:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.071+0000 7fe574b91740 1 -- 172.21.15.106:0/466610033 wait complete. 2024-08-17T02:28:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.072+0000 7fe574b91740 1 -- start start 2024-08-17T02:28:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.072+0000 7fe574b91740 1 Processor -- start 2024-08-17T02:28:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.073+0000 7fe574b91740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5631cf8ca0a0 0x5631cf8f5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.073+0000 7fe574b91740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf8eea30 0x5631cf91d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.073+0000 7fe574b91740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5631cf90cb10 0x5631cf8f3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.073+0000 7fe574b91740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631cf826f60 con 0x5631cf8eea30 2024-08-17T02:28:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.073+0000 7fe574b91740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631cf7cf690 con 0x5631cf8ca0a0 2024-08-17T02:28:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.073+0000 7fe574b91740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x5631cf7cf330 con 0x5631cf90cb10 2024-08-17T02:28:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.073+0000 7fe574b91740 10 client.0 _ll_register_callbacks cb 0x5631cf7c92b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:28:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.073+0000 7fe562a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf8eea30 0x5631cf91d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.073+0000 7fe562a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf8eea30 0x5631cf91d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53706/0 (socket says 172.21.15.106:53706) 2024-08-17T02:28:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.073+0000 7fe562a00640 1 -- 172.21.15.106:0/1173328105 learned_addr learned my addr 172.21.15.106:0/1173328105 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.073+0000 7fe56be00640 1 --2- 172.21.15.106:0/1173328105 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5631cf90cb10 0x5631cf8f3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.073+0000 7fe56b400640 1 --2- 172.21.15.106:0/1173328105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5631cf8ca0a0 0x5631cf8f5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.074+0000 7fe562a00640 1 -- 172.21.15.106:0/1173328105 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5631cf90cb10 msgr2=0x5631cf8f3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.074+0000 7fe562a00640 1 --2- 172.21.15.106:0/1173328105 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5631cf90cb10 0x5631cf8f3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.074+0000 7fe562a00640 1 -- 172.21.15.106:0/1173328105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5631cf8ca0a0 msgr2=0x5631cf8f5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.074+0000 7fe562a00640 1 --2- 172.21.15.106:0/1173328105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5631cf8ca0a0 0x5631cf8f5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.074+0000 7fe562a00640 1 -- 172.21.15.106:0/1173328105 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5540098e0 con 0x5631cf8eea30 2024-08-17T02:28:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.074+0000 7fe562a00640 1 --2- 172.21.15.106:0/1173328105 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf8eea30 0x5631cf91d730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe554019000 tx=0x7fe55401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ca8ae789a153ca server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.074+0000 7fe54fe00640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-08-17T02:28:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.074+0000 7fe54fe00640 1 -- 172.21.15.106:0/1173328105 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe554024070 con 0x5631cf8eea30 2024-08-17T02:28:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.074+0000 7fe54fe00640 1 -- 172.21.15.106:0/1173328105 <== mon.0 v2:172.21.15.106:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe554016c70 con 0x5631cf8eea30 2024-08-17T02:28:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.074+0000 7fe574b91740 1 -- 172.21.15.106:0/1173328105 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5631cf85ad20 con 0x5631cf8eea30 2024-08-17T02:28:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.074+0000 7fe54fe00640 1 -- 172.21.15.106:0/1173328105 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5540166b0 con 0x5631cf8eea30 2024-08-17T02:28:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.074+0000 7fe574b91740 10 client.4653 fetch_fsmap learned FSMap version 8 2024-08-17T02:28:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.074+0000 7fe574b91740 1 -- 172.21.15.106:0/1173328105 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5631cf7f0ab0 con 0x5631cf8eea30 2024-08-17T02:28:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.075+0000 7fe54fe00640 1 -- 172.21.15.106:0/1173328105 <== mon.0 v2:172.21.15.106:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5631cf85ad20 con 0x5631cf8eea30 2024-08-17T02:28:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.075+0000 7fe54fe00640 1 -- 172.21.15.106:0/1173328105 <== mon.0 v2:172.21.15.106:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe55401f640 con 0x5631cf8eea30 2024-08-17T02:28:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.075+0000 7fe574b91740 10 client.4653 fetch_fsmap finished waiting for FSMap version 8 2024-08-17T02:28:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.075+0000 7fe574b91740 10 client.4653 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-17T02:28:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.075+0000 7fe574b91740 20 client.4653 populate_metadata read hostname 'smithi106' 2024-08-17T02:28:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.075+0000 7fe574b91740 1 --2- 172.21.15.106:0/1173328105 >> [v2:172.21.15.171:6834/3901195482,v1:172.21.15.171:6835/3901195482] conn(0x5631cf90ee70 0x5631cf90dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.075+0000 7fe574b91740 4 client.4653 mds_command: new command op to 4300 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:28:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.075+0000 7fe574b91740 1 -- 172.21.15.106:0/1173328105 --> [v2:172.21.15.171:6834/3901195482,v1:172.21.15.171:6835/3901195482] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5631cf52e3c0 con 0x5631cf90ee70 2024-08-17T02:28:06.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.075+0000 7fe56b400640 1 --2- 172.21.15.106:0/1173328105 >> [v2:172.21.15.171:6834/3901195482,v1:172.21.15.171:6835/3901195482] conn(0x5631cf90ee70 0x5631cf90dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.076+0000 7fe56b400640 1 --2- 172.21.15.106:0/1173328105 >> [v2:172.21.15.171:6834/3901195482,v1:172.21.15.171:6835/3901195482] conn(0x5631cf90ee70 0x5631cf90dfe0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=562ea1dfc651c9c0 server_cookie=ff28e034ac8fc630 in_seq=0 out_seq=0 2024-08-17T02:28:06.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.076+0000 7fe54fe00640 10 client.4653 ms_handle_connect on v2:172.21.15.171:6834/3901195482 2024-08-17T02:28:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.077+0000 7fe54fe00640 1 -- 172.21.15.106:0/1173328105 <== mds.0 v2:172.21.15.171:6834/3901195482 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x5631cf52e3c0 con 0x5631cf90ee70 2024-08-17T02:28:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.077+0000 7fe54fe00640 10 client.4653 handle_command_reply: tid=0 2024-08-17T02:28:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.077+0000 7fe574b91740 1 client.4653 shutdown 2024-08-17T02:28:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.077+0000 7fe574b91740 1 -- 172.21.15.106:0/1173328105 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf8eea30 msgr2=0x5631cf91d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.077+0000 7fe574b91740 1 --2- 172.21.15.106:0/1173328105 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf8eea30 0x5631cf91d730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe554019000 tx=0x7fe55401d000 comp rx=0 tx=0).stop 2024-08-17T02:28:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.077+0000 7fe574b91740 1 -- 172.21.15.106:0/1173328105 shutdown_connections 2024-08-17T02:28:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.077+0000 7fe574b91740 1 --2- 172.21.15.106:0/1173328105 >> [v2:172.21.15.171:6834/3901195482,v1:172.21.15.171:6835/3901195482] conn(0x5631cf90ee70 0x5631cf90dfe0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.077+0000 7fe574b91740 1 --2- 172.21.15.106:0/1173328105 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5631cf90cb10 0x5631cf8f3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.077+0000 7fe574b91740 1 --2- 172.21.15.106:0/1173328105 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf8eea30 0x5631cf91d730 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.077+0000 7fe54fe00640 0 client.4653 ms_handle_reset on v2:172.21.15.171:6834/3901195482 2024-08-17T02:28:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.077+0000 7fe574b91740 1 --2- 172.21.15.106:0/1173328105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5631cf8ca0a0 0x5631cf8f5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.077+0000 7fe574b91740 1 -- 172.21.15.106:0/1173328105 >> 172.21.15.106:0/1173328105 conn(0x5631cf862030 msgr2=0x5631cf910c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.077+0000 7fe574b91740 1 -- 172.21.15.106:0/1173328105 shutdown_connections 2024-08-17T02:28:06.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.077+0000 7fe574b91740 1 -- 172.21.15.106:0/1173328105 wait complete. 2024-08-17T02:28:06.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.077+0000 7fe574b91740 20 client.4653 trim_cache size 0 max 16384 2024-08-17T02:28:06.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.093+0000 7fe574b91740 1 Processor -- start 2024-08-17T02:28:06.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.093+0000 7fe574b91740 1 -- start start 2024-08-17T02:28:06.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.093+0000 7fe574b91740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5631cf8ca0a0 0x5631cf8f3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.093+0000 7fe574b91740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf8eea30 0x5631cf90fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.093+0000 7fe574b91740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5631cf90cb10 0x5631cf8f3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.094+0000 7fe574b91740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631cf5a1f20 con 0x5631cf8eea30 2024-08-17T02:28:06.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.094+0000 7fe574b91740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631cf8be580 con 0x5631cf8ca0a0 2024-08-17T02:28:06.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.094+0000 7fe574b91740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x5631cf7ea740 con 0x5631cf90cb10 2024-08-17T02:28:06.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.094+0000 7fe562a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf8eea30 0x5631cf90fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.094+0000 7fe562a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf8eea30 0x5631cf90fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53716/0 (socket says 172.21.15.106:53716) 2024-08-17T02:28:06.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.094+0000 7fe562a00640 1 -- 172.21.15.106:0/136166482 learned_addr learned my addr 172.21.15.106:0/136166482 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:06.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.094+0000 7fe56b400640 1 --2- 172.21.15.106:0/136166482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5631cf8ca0a0 0x5631cf8f3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.094+0000 7fe56be00640 1 --2- 172.21.15.106:0/136166482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5631cf90cb10 0x5631cf8f3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.094+0000 7fe562a00640 1 -- 172.21.15.106:0/136166482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5631cf90cb10 msgr2=0x5631cf8f3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.094+0000 7fe562a00640 1 --2- 172.21.15.106:0/136166482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5631cf90cb10 0x5631cf8f3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.094+0000 7fe562a00640 1 -- 172.21.15.106:0/136166482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5631cf8ca0a0 msgr2=0x5631cf8f3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.094+0000 7fe562a00640 1 --2- 172.21.15.106:0/136166482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5631cf8ca0a0 0x5631cf8f3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.094+0000 7fe562a00640 1 -- 172.21.15.106:0/136166482 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5631cf7f4490 con 0x5631cf8eea30 2024-08-17T02:28:06.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.094+0000 7fe56be00640 1 --2- 172.21.15.106:0/136166482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5631cf90cb10 0x5631cf8f3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:06.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.094+0000 7fe562a00640 1 --2- 172.21.15.106:0/136166482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf8eea30 0x5631cf90fba0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe554028920 tx=0x7fe554021050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae07b9f2426b7d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.095+0000 7fe55be00640 1 -- 172.21.15.106:0/136166482 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe554024030 con 0x5631cf8eea30 2024-08-17T02:28:06.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.095+0000 7fe55be00640 1 -- 172.21.15.106:0/136166482 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55401fb00 con 0x5631cf8eea30 2024-08-17T02:28:06.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.095+0000 7fe55be00640 1 -- 172.21.15.106:0/136166482 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55401f640 con 0x5631cf8eea30 2024-08-17T02:28:06.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.095+0000 7fe574b91740 1 -- 172.21.15.106:0/136166482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf8eea30 msgr2=0x5631cf90fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.095+0000 7fe574b91740 1 --2- 172.21.15.106:0/136166482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf8eea30 0x5631cf90fba0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe554028920 tx=0x7fe554021050 comp rx=0 tx=0).stop 2024-08-17T02:28:06.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.095+0000 7fe574b91740 1 -- 172.21.15.106:0/136166482 shutdown_connections 2024-08-17T02:28:06.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.095+0000 7fe574b91740 1 --2- 172.21.15.106:0/136166482 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5631cf90cb10 0x5631cf8f3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.095+0000 7fe574b91740 1 --2- 172.21.15.106:0/136166482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf8eea30 0x5631cf90fba0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.095+0000 7fe574b91740 1 --2- 172.21.15.106:0/136166482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5631cf8ca0a0 0x5631cf8f3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.095+0000 7fe574b91740 1 -- 172.21.15.106:0/136166482 >> 172.21.15.106:0/136166482 conn(0x5631cf862030 msgr2=0x5631cf8f5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:06.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.095+0000 7fe574b91740 1 -- 172.21.15.106:0/136166482 shutdown_connections 2024-08-17T02:28:06.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.095+0000 7fe574b91740 1 -- 172.21.15.106:0/136166482 wait complete. 2024-08-17T02:28:06.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.096+0000 7fe574b91740 1 -- start start 2024-08-17T02:28:06.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.096+0000 7fe574b91740 1 Processor -- start 2024-08-17T02:28:06.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.097+0000 7fe574b91740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5631cf8ca0a0 0x5631cf8ed4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.097+0000 7fe574b91740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5631cf8eea30 0x5631cf8eda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.097+0000 7fe574b91740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf90cb10 0x5631cf973da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.097+0000 7fe574b91740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631cf90e470 con 0x5631cf90cb10 2024-08-17T02:28:06.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.097+0000 7fe574b91740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631cf90e100 con 0x5631cf8ca0a0 2024-08-17T02:28:06.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.097+0000 7fe574b91740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x5631cf91d910 con 0x5631cf8eea30 2024-08-17T02:28:06.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.097+0000 7fe574b91740 10 client.0 _ll_register_callbacks cb 0x7fe550003670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:28:06.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.097+0000 7fe56be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf90cb10 0x5631cf973da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.097+0000 7fe56be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf90cb10 0x5631cf973da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53722/0 (socket says 172.21.15.106:53722) 2024-08-17T02:28:06.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.097+0000 7fe56be00640 1 -- 172.21.15.106:0/4182698940 learned_addr learned my addr 172.21.15.106:0/4182698940 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:06.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.097+0000 7fe56b400640 1 --2- 172.21.15.106:0/4182698940 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5631cf8ca0a0 0x5631cf8ed4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.097+0000 7fe562a00640 1 --2- 172.21.15.106:0/4182698940 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5631cf8eea30 0x5631cf8eda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.097+0000 7fe56be00640 1 -- 172.21.15.106:0/4182698940 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5631cf8eea30 msgr2=0x5631cf8eda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.097+0000 7fe56be00640 1 --2- 172.21.15.106:0/4182698940 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5631cf8eea30 0x5631cf8eda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.097+0000 7fe56be00640 1 -- 172.21.15.106:0/4182698940 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5631cf8ca0a0 msgr2=0x5631cf8ed4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.097+0000 7fe56be00640 1 --2- 172.21.15.106:0/4182698940 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5631cf8ca0a0 0x5631cf8ed4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.097+0000 7fe56be00640 1 -- 172.21.15.106:0/4182698940 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5631cf7f0ab0 con 0x5631cf90cb10 2024-08-17T02:28:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.097+0000 7fe562a00640 1 --2- 172.21.15.106:0/4182698940 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5631cf8eea30 0x5631cf8eda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.098+0000 7fe56be00640 1 --2- 172.21.15.106:0/4182698940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf90cb10 0x5631cf973da0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe564053160 tx=0x7fe564066040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef3941737345ae3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.098+0000 7fe54fe00640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-08-17T02:28:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.098+0000 7fe54fe00640 1 -- 172.21.15.106:0/4182698940 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56406e240 con 0x5631cf90cb10 2024-08-17T02:28:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.098+0000 7fe54fe00640 1 -- 172.21.15.106:0/4182698940 <== mon.0 v2:172.21.15.106:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe56406d020 con 0x5631cf90cb10 2024-08-17T02:28:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.098+0000 7fe574b91740 1 -- 172.21.15.106:0/4182698940 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe554013e20 con 0x5631cf90cb10 2024-08-17T02:28:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.098+0000 7fe54fe00640 1 -- 172.21.15.106:0/4182698940 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe56405a400 con 0x5631cf90cb10 2024-08-17T02:28:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.098+0000 7fe574b91740 10 client.4659 fetch_fsmap learned FSMap version 8 2024-08-17T02:28:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.098+0000 7fe574b91740 1 -- 172.21.15.106:0/4182698940 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5631cf7f41e0 con 0x5631cf90cb10 2024-08-17T02:28:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.098+0000 7fe54fe00640 1 -- 172.21.15.106:0/4182698940 <== mon.0 v2:172.21.15.106:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe554013e20 con 0x5631cf90cb10 2024-08-17T02:28:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.098+0000 7fe54fe00640 1 -- 172.21.15.106:0/4182698940 <== mon.0 v2:172.21.15.106:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe564012070 con 0x5631cf90cb10 2024-08-17T02:28:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.098+0000 7fe574b91740 10 client.4659 fetch_fsmap finished waiting for FSMap version 8 2024-08-17T02:28:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.098+0000 7fe574b91740 10 client.4659 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-17T02:28:06.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.098+0000 7fe574b91740 20 client.4659 populate_metadata read hostname 'smithi106' 2024-08-17T02:28:06.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.098+0000 7fe574b91740 1 --2- 172.21.15.106:0/4182698940 >> [v2:172.21.15.171:6834/3901195482,v1:172.21.15.171:6835/3901195482] conn(0x5631cf8c7df0 0x5631cf8c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.098+0000 7fe574b91740 4 client.4659 mds_command: new command op to 4300 tid=0[{"prefix": "status"}] 2024-08-17T02:28:06.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.098+0000 7fe574b91740 1 -- 172.21.15.106:0/4182698940 --> [v2:172.21.15.171:6834/3901195482,v1:172.21.15.171:6835/3901195482] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5631cf53f6c0 con 0x5631cf8c7df0 2024-08-17T02:28:06.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.099+0000 7fe56b400640 1 --2- 172.21.15.106:0/4182698940 >> [v2:172.21.15.171:6834/3901195482,v1:172.21.15.171:6835/3901195482] conn(0x5631cf8c7df0 0x5631cf8c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.099+0000 7fe54fe00640 10 client.4659 ms_handle_connect on v2:172.21.15.171:6834/3901195482 2024-08-17T02:28:06.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.099+0000 7fe56b400640 1 --2- 172.21.15.106:0/4182698940 >> [v2:172.21.15.171:6834/3901195482,v1:172.21.15.171:6835/3901195482] conn(0x5631cf8c7df0 0x5631cf8c81c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adfded3ebbd04f3a server_cookie=faebacbc21883782 in_seq=0 out_seq=0 2024-08-17T02:28:06.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.099+0000 7fe54fe00640 1 -- 172.21.15.106:0/4182698940 <== mds.0 v2:172.21.15.171:6834/3901195482 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5631cf53f6c0 con 0x5631cf8c7df0 2024-08-17T02:28:06.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.099+0000 7fe54fe00640 10 client.4659 handle_command_reply: tid=0 2024-08-17T02:28:06.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.099+0000 7fe574b91740 1 client.4659 shutdown 2024-08-17T02:28:06.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.100+0000 7fe574b91740 1 -- 172.21.15.106:0/4182698940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf90cb10 msgr2=0x5631cf973da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.100+0000 7fe574b91740 1 --2- 172.21.15.106:0/4182698940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf90cb10 0x5631cf973da0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe564053160 tx=0x7fe564066040 comp rx=0 tx=0).stop 2024-08-17T02:28:06.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.100+0000 7fe574b91740 1 -- 172.21.15.106:0/4182698940 shutdown_connections 2024-08-17T02:28:06.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.100+0000 7fe574b91740 1 --2- 172.21.15.106:0/4182698940 >> [v2:172.21.15.171:6834/3901195482,v1:172.21.15.171:6835/3901195482] conn(0x5631cf8c7df0 0x5631cf8c81c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.100+0000 7fe574b91740 1 --2- 172.21.15.106:0/4182698940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5631cf90cb10 0x5631cf973da0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.100+0000 7fe574b91740 1 --2- 172.21.15.106:0/4182698940 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x5631cf8eea30 0x5631cf8eda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.100+0000 7fe54fe00640 0 client.4659 ms_handle_reset on v2:172.21.15.171:6834/3901195482 2024-08-17T02:28:06.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.100+0000 7fe574b91740 1 --2- 172.21.15.106:0/4182698940 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5631cf8ca0a0 0x5631cf8ed4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.100+0000 7fe574b91740 1 -- 172.21.15.106:0/4182698940 >> 172.21.15.106:0/4182698940 conn(0x5631cf862030 msgr2=0x5631cf91cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:06.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.100+0000 7fe574b91740 1 -- 172.21.15.106:0/4182698940 shutdown_connections 2024-08-17T02:28:06.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.100+0000 7fe574b91740 1 -- 172.21.15.106:0/4182698940 wait complete. 2024-08-17T02:28:06.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.100+0000 7fe574b91740 20 client.4659 trim_cache size 0 max 16384 2024-08-17T02:28:06.105 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-08-17T02:28:06.105 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_fsid": "2c52f2d2-3c39-4be0-9e1a-50df01bd49c4", 2024-08-17T02:28:06.105 INFO:teuthology.orchestra.run.smithi106.stdout: "whoami": 0, 2024-08-17T02:28:06.105 INFO:teuthology.orchestra.run.smithi106.stdout: "id": 4300, 2024-08-17T02:28:06.105 INFO:teuthology.orchestra.run.smithi106.stdout: "want_state": "up:active", 2024-08-17T02:28:06.106 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "up:active", 2024-08-17T02:28:06.106 INFO:teuthology.orchestra.run.smithi106.stdout: "fs_name": "cephfs", 2024-08-17T02:28:06.106 INFO:teuthology.orchestra.run.smithi106.stdout: "rank_uptime": 14.825223392, 2024-08-17T02:28:06.106 INFO:teuthology.orchestra.run.smithi106.stdout: "mdsmap_epoch": 8, 2024-08-17T02:28:06.106 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_epoch": 20, 2024-08-17T02:28:06.106 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_epoch_barrier": 20, 2024-08-17T02:28:06.106 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 22.359714612000001 2024-08-17T02:28:06.106 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-08-17T02:28:06.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.100+0000 7fe572600640 1 -- 172.21.15.106:0/3822247423 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe548065180 msgr2=0x7fe548067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.100+0000 7fe572600640 1 --2- 172.21.15.106:0/3822247423 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe548065180 0x7fe548067630 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe55c033000 tx=0x7fe55c034000 comp rx=0 tx=0).stop 2024-08-17T02:28:06.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.100+0000 7fe572600640 1 -- 172.21.15.106:0/3822247423 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe56c09ad00 msgr2=0x7fe56c09b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.100+0000 7fe572600640 1 --2- 172.21.15.106:0/3822247423 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe56c09ad00 0x7fe56c09b1a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe56c0ad480 tx=0x7fe564007ca0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.101+0000 7fe572600640 1 -- 172.21.15.106:0/3822247423 shutdown_connections 2024-08-17T02:28:06.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.101+0000 7fe572600640 1 --2- 172.21.15.106:0/3822247423 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe548065180 0x7fe548067630 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.101+0000 7fe572600640 1 --2- 172.21.15.106:0/3822247423 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe56c09ad00 0x7fe56c09b1a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.101+0000 7fe572600640 1 --2- 172.21.15.106:0/3822247423 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe56c0c6d10 0x7fe56c09a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.101+0000 7fe572600640 1 --2- 172.21.15.106:0/3822247423 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe550003b90 0x7fe56c169d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.101+0000 7fe572600640 1 -- 172.21.15.106:0/3822247423 >> 172.21.15.106:0/3822247423 conn(0x7fe56c096a70 msgr2=0x7fe56c06bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:06.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.101+0000 7fe572600640 1 -- 172.21.15.106:0/3822247423 shutdown_connections 2024-08-17T02:28:06.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.101+0000 7fe572600640 1 -- 172.21.15.106:0/3822247423 wait complete. 2024-08-17T02:28:06.117 INFO:teuthology.run_tasks:Running task kclient... 2024-08-17T02:28:06.143 INFO:tasks.kclient:Mounting kernel clients... 2024-08-17T02:28:06.143 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-08-17T02:28:06.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:06.143 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-08-17T02:28:06.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:06.179 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link delete ceph-brx 2024-08-17T02:28:06.278 INFO:teuthology.orchestra.run.smithi106.stderr:Cannot find device "ceph-brx" 2024-08-17T02:28:06.281 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:28:06.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:06.282 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-08-17T02:28:06.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:06.318 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link delete ceph-brx 2024-08-17T02:28:06.417 INFO:teuthology.orchestra.run.smithi106.stderr:Cannot find device "ceph-brx" 2024-08-17T02:28:06.419 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:28:06.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:06.420 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-08-17T02:28:06.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:06.458 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link delete ceph-brx 2024-08-17T02:28:06.559 INFO:teuthology.orchestra.run.smithi171.stderr:Cannot find device "ceph-brx" 2024-08-17T02:28:06.562 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:28:06.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:06.562 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-08-17T02:28:06.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:06.598 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link delete ceph-brx 2024-08-17T02:28:06.696 INFO:teuthology.orchestra.run.smithi171.stderr:Cannot find device "ceph-brx" 2024-08-17T02:28:06.698 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:28:06.699 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-08-17T02:28:06.699 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:28:06.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.846+0000 7f1de8200640 1 Processor -- start 2024-08-17T02:28:06.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.846+0000 7f1de8200640 1 -- start start 2024-08-17T02:28:06.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.847+0000 7f1de8200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1de006df00 0x7f1de00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.847+0000 7f1de8200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1de0155df0 0x7f1de00ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.847+0000 7f1de8200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de0156670 con 0x7f1de0155a20 2024-08-17T02:28:06.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.847+0000 7f1de8200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de00b0350 con 0x7f1de0155df0 2024-08-17T02:28:06.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.847+0000 7f1de8200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de006e5e0 con 0x7f1de006df00 2024-08-17T02:28:06.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.848+0000 7f1de4e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1de006df00 0x7f1de00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.848+0000 7f1de6200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1de0155df0 0x7f1de00ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.848+0000 7f1de5800640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f1de0155a20 0x7f1de006d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:47746/0 (socket says 172.21.15.106:47746) 2024-08-17T02:28:06.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.848+0000 7f1de4e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1de006df00 0x7f1de00adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:39140/0 (socket says 172.21.15.106:39140) 2024-08-17T02:28:06.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.848+0000 7f1de5800640 1 -- 172.21.15.106:0/1843295534 learned_addr learned my addr 172.21.15.106:0/1843295534 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:06.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.848+0000 7f1de4e00640 1 -- 172.21.15.106:0/1843295534 >> v2:172.21.15.171:3300/0 conn(0x7f1de0155df0 msgr2=0x7f1de00ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:06.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.848+0000 7f1de4e00640 1 --2- 172.21.15.106:0/1843295534 >> v2:172.21.15.171:3300/0 conn(0x7f1de0155df0 0x7f1de00ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.848+0000 7f1de4e00640 1 -- 172.21.15.106:0/1843295534 >> v1:172.21.15.171:6789/0 conn(0x7f1de0155a20 legacy=0x7f1de006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.848+0000 7f1de4e00640 1 -- 172.21.15.106:0/1843295534 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de006e8c0 con 0x7f1de006df00 2024-08-17T02:28:06.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.848+0000 7f1de6200640 1 --2- 172.21.15.106:0/1843295534 >> v2:172.21.15.171:3300/0 conn(0x7f1de0155df0 0x7f1de00ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:06.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.849+0000 7f1de4e00640 1 --2- 172.21.15.106:0/1843295534 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1de006df00 0x7f1de00adf10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009850 tx=0x7f1dcc0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14f675b02d77adad server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.849+0000 7f1ddfe00640 1 -- 172.21.15.106:0/1843295534 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc02ad90 con 0x7f1de006df00 2024-08-17T02:28:06.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.849+0000 7f1ddfe00640 1 -- 172.21.15.106:0/1843295534 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dcc032440 con 0x7f1de006df00 2024-08-17T02:28:06.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.849+0000 7f1ddfe00640 1 -- 172.21.15.106:0/1843295534 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc032820 con 0x7f1de006df00 2024-08-17T02:28:06.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.850+0000 7f1de8200640 1 -- 172.21.15.106:0/1843295534 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1de006df00 msgr2=0x7f1de00adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.850+0000 7f1de8200640 1 --2- 172.21.15.106:0/1843295534 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1de006df00 0x7f1de00adf10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009850 tx=0x7f1dcc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.850+0000 7f1de8200640 1 -- 172.21.15.106:0/1843295534 shutdown_connections 2024-08-17T02:28:06.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.850+0000 7f1de8200640 1 --2- 172.21.15.106:0/1843295534 >> v2:172.21.15.171:3300/0 conn(0x7f1de0155df0 0x7f1de00ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.850+0000 7f1de8200640 1 --2- 172.21.15.106:0/1843295534 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1de006df00 0x7f1de00adf10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.850+0000 7f1de8200640 1 -- 172.21.15.106:0/1843295534 >> 172.21.15.106:0/1843295534 conn(0x7f1de00cb9b0 msgr2=0x7f1de00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:06.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.850+0000 7f1de8200640 1 -- 172.21.15.106:0/1843295534 shutdown_connections 2024-08-17T02:28:06.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.850+0000 7f1de8200640 1 -- 172.21.15.106:0/1843295534 wait complete. 2024-08-17T02:28:06.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.851+0000 7f1de8200640 1 Processor -- start 2024-08-17T02:28:06.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.852+0000 7f1de8200640 1 -- start start 2024-08-17T02:28:06.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.852+0000 7f1de8200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1de006df00 0x7f1de013c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.852+0000 7f1de8200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1de0155a20 0x7f1de0154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.852+0000 7f1de8200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1de0155df0 0x7f1de0154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.853+0000 7f1de8200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de014e680 con 0x7f1de006df00 2024-08-17T02:28:06.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.853+0000 7f1de8200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de014e960 con 0x7f1de0155df0 2024-08-17T02:28:06.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.853+0000 7f1de8200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de014ec40 con 0x7f1de0155a20 2024-08-17T02:28:06.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.853+0000 7f1de5800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1de006df00 0x7f1de013c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.853+0000 7f1de6200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1de0155df0 0x7f1de0154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.853+0000 7f1de4e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1de0155a20 0x7f1de0154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.853+0000 7f1de6200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1de0155df0 0x7f1de0154790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:52468/0 (socket says 172.21.15.106:52468) 2024-08-17T02:28:06.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.853+0000 7f1de6200640 1 -- 172.21.15.106:0/2867113785 learned_addr learned my addr 172.21.15.106:0/2867113785 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:06.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.853+0000 7f1de4e00640 1 -- 172.21.15.106:0/2867113785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1de0155df0 msgr2=0x7f1de0154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.853+0000 7f1de4e00640 1 --2- 172.21.15.106:0/2867113785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1de0155df0 0x7f1de0154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.853+0000 7f1de4e00640 1 -- 172.21.15.106:0/2867113785 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1de006df00 msgr2=0x7f1de013c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:06.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.853+0000 7f1de4e00640 1 --2- 172.21.15.106:0/2867113785 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1de006df00 0x7f1de013c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:06.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.853+0000 7f1de4e00640 1 -- 172.21.15.106:0/2867113785 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd8009a20 con 0x7f1de0155a20 2024-08-17T02:28:06.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.853+0000 7f1de6200640 1 --2- 172.21.15.106:0/2867113785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1de0155df0 0x7f1de0154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:06.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.854+0000 7f1de4e00640 1 --2- 172.21.15.106:0/2867113785 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1de0155a20 0x7f1de0154250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc031000 tx=0x7f1dcc032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.854+0000 7f1ddcc00640 1 -- 172.21.15.106:0/2867113785 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc000d10 con 0x7f1de0155a20 2024-08-17T02:28:06.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.854+0000 7f1ddcc00640 1 -- 172.21.15.106:0/2867113785 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dcc031de0 con 0x7f1de0155a20 2024-08-17T02:28:06.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.854+0000 7f1de8200640 1 -- 172.21.15.106:0/2867113785 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dcc009390 con 0x7f1de0155a20 2024-08-17T02:28:06.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.854+0000 7f1ddcc00640 1 -- 172.21.15.106:0/2867113785 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc03d670 con 0x7f1de0155a20 2024-08-17T02:28:06.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.854+0000 7f1de8200640 1 -- 172.21.15.106:0/2867113785 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de014f200 con 0x7f1de0155a20 2024-08-17T02:28:06.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.855+0000 7f1de8200640 1 -- 172.21.15.106:0/2867113785 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de014eaa0 con 0x7f1de0155a20 2024-08-17T02:28:06.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.856+0000 7f1ddcc00640 1 -- 172.21.15.106:0/2867113785 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1dcc039040 con 0x7f1de0155a20 2024-08-17T02:28:06.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.857+0000 7f1ddcc00640 1 --2- 172.21.15.106:0/2867113785 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1dc00651d0 0x7f1dc0067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:06.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.857+0000 7f1ddcc00640 1 -- 172.21.15.106:0/2867113785 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1dcc0a2330 con 0x7f1de0155a20 2024-08-17T02:28:06.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.857+0000 7f1de5800640 1 --2- 172.21.15.106:0/2867113785 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1dc00651d0 0x7f1dc0067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:06.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.857+0000 7f1de5800640 1 --2- 172.21.15.106:0/2867113785 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1dc00651d0 0x7f1dc0067680 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4007880 tx=0x7f1dd4007e20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:06.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:06.862+0000 7f1ddcc00640 1 -- 172.21.15.106:0/2867113785 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1de014eaa0 con 0x7f1de0155a20 2024-08-17T02:28:07.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:07.069+0000 7f1de8200640 1 -- 172.21.15.106:0/2867113785 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1de014eaa0 con 0x7f1de0155a20 2024-08-17T02:28:07.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:07.069+0000 7f1ddcc00640 1 -- 172.21.15.106:0/2867113785 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1de014eaa0 con 0x7f1de0155a20 2024-08-17T02:28:07.071 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:28:07.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:07.071+0000 7f1de8200640 1 -- 172.21.15.106:0/2867113785 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1dc00651d0 msgr2=0x7f1dc0067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:07.071+0000 7f1de8200640 1 --2- 172.21.15.106:0/2867113785 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1dc00651d0 0x7f1dc0067680 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4007880 tx=0x7f1dd4007e20 comp rx=0 tx=0).stop 2024-08-17T02:28:07.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:07.071+0000 7f1de8200640 1 -- 172.21.15.106:0/2867113785 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1de0155a20 msgr2=0x7f1de0154250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:07.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:07.071+0000 7f1de8200640 1 --2- 172.21.15.106:0/2867113785 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1de0155a20 0x7f1de0154250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc031000 tx=0x7f1dcc032000 comp rx=0 tx=0).stop 2024-08-17T02:28:07.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:07.072+0000 7f1de8200640 1 -- 172.21.15.106:0/2867113785 shutdown_connections 2024-08-17T02:28:07.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:07.072+0000 7f1de8200640 1 --2- 172.21.15.106:0/2867113785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1de0155df0 0x7f1de0154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:07.072+0000 7f1de8200640 1 --2- 172.21.15.106:0/2867113785 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1de0155a20 0x7f1de0154250 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:07.072+0000 7f1de8200640 1 --2- 172.21.15.106:0/2867113785 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1dc00651d0 0x7f1dc0067680 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:07.072+0000 7f1de8200640 1 --2- 172.21.15.106:0/2867113785 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1de006df00 0x7f1de013c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:07.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:07.072+0000 7f1de8200640 1 -- 172.21.15.106:0/2867113785 >> 172.21.15.106:0/2867113785 conn(0x7f1de00cb9b0 msgr2=0x7f1de0156b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:07.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:07.072+0000 7f1de8200640 1 -- 172.21.15.106:0/2867113785 shutdown_connections 2024-08-17T02:28:07.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:07.072+0000 7f1de8200640 1 -- 172.21.15.106:0/2867113785 wait complete. 2024-08-17T02:28:07.087 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:28:07.088 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:28:07.088 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi106.front.sepia.ceph.com 2024-08-17T02:28:07.088 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:28:07.088 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:28:07.088 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:28:07.088 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:28:07.088 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:28:07.088 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:28:07.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:07.088 DEBUG:teuthology.orchestra.run.smithi106:> ip addr 2024-08-17T02:28:07.123 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:28:07.124 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:28:07.124 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:28:07.124 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:07.124 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2024-08-17T02:28:07.124 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:07.124 INFO:teuthology.orchestra.run.smithi106.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:07.124 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2a brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:07.124 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f0 2024-08-17T02:28:07.124 INFO:teuthology.orchestra.run.smithi106.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:07.124 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:07.124 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f1 2024-08-17T02:28:07.125 INFO:teuthology.orchestra.run.smithi106.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:07.125 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6c brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:07.125 INFO:teuthology.orchestra.run.smithi106.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:28:07.125 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6d brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:07.125 INFO:teuthology.orchestra.run.smithi106.stdout: inet 172.21.15.106/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:28:07.125 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft 42560sec preferred_lft 42560sec 2024-08-17T02:28:07.125 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::ec4:7aff:fe8f:ce6d/64 scope link 2024-08-17T02:28:07.125 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:07.125 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:28:07.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:07.126 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-08-17T02:28:07.126 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-08-17T02:28:07.126 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:28:07.126 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip addr flush dev ceph-brx 2024-08-17T02:28:07.126 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set ceph-brx up 2024-08-17T02:28:07.126 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:28:07.126 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-08-17T02:28:07.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:07.484 DEBUG:teuthology.orchestra.run.smithi106:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:28:07.539 INFO:teuthology.orchestra.run.smithi106.stdout:1 2024-08-17T02:28:07.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:07.543 DEBUG:teuthology.orchestra.run.smithi106:> route 2024-08-17T02:28:07.595 INFO:teuthology.orchestra.run.smithi106.stdout:Kernel IP routing table 2024-08-17T02:28:07.595 INFO:teuthology.orchestra.run.smithi106.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:28:07.595 INFO:teuthology.orchestra.run.smithi106.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:28:07.595 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:28:07.595 INFO:teuthology.orchestra.run.smithi106.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:28:07.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:07.596 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-08-17T02:28:07.596 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-08-17T02:28:07.596 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:28:07.596 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:28:07.596 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:28:07.596 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-08-17T02:28:08.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:08.115 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-08-17T02:28:08.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:08.151 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list-id 2024-08-17T02:28:08.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:08.225 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-08-17T02:28:08.225 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-08-17T02:28:08.226 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:28:08.226 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-17T02:28:08.226 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-08-17T02:28:08.351 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-17T02:28:08.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:08.352 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-08-17T02:28:08.352 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-08-17T02:28:08.352 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-17T02:28:08.352 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:28:08.352 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-17T02:28:08.352 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-17T02:28:08.352 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-17T02:28:08.352 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-08-17T02:28:08.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:08.535 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-08-17T02:28:08.535 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-08-17T02:28:08.535 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set brx.0 up 2024-08-17T02:28:08.535 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:28:08.536 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-08-17T02:28:08.651 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:08.651 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:28:08.687 INFO:teuthology.orchestra.run.smithi106.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:28:08.687 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:08.687 DEBUG:teuthology.orchestra.run.smithi106:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:28:08.762 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:28:08.762 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:28:08.762 DEBUG:teuthology.orchestra.run.smithi106:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:08.894 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:08.894 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:28:09.543 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:09.543 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:28:09.543 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-08-17T02:28:09.543 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: trying mount with new device syntax: 0@2c52f2d2-3c39-4be0-9e1a-50df01bd49c4.cephfs=/ 2024-08-17T02:28:09.543 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.106:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-08-17T02:28:09.544 INFO:teuthology.orchestra.run.smithi106.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:28:09.544 INFO:teuthology.orchestra.run.smithi106.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:28:09.544 INFO:teuthology.orchestra.run.smithi106.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:28:09.544 INFO:teuthology.orchestra.run.smithi106.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:28:09.544 INFO:teuthology.orchestra.run.smithi106.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:28:09.547 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:28:09.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:09.548 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:28:09.605 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-08-17T02:28:09.605 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:28:09.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.752+0000 7f7822a00640 1 Processor -- start 2024-08-17T02:28:09.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.752+0000 7f7822a00640 1 -- start start 2024-08-17T02:28:09.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.753+0000 7f7822a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f781c06df00 0x7f781c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.753+0000 7f7822a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f781c155df0 0x7f781c0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.753+0000 7f7822a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f781c156670 con 0x7f781c155a20 2024-08-17T02:28:09.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.753+0000 7f7822a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f781c0b0350 con 0x7f781c155df0 2024-08-17T02:28:09.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.753+0000 7f7822a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f781c06e5e0 con 0x7f781c06df00 2024-08-17T02:28:09.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.754+0000 7f7820a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f781c155df0 0x7f781c0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.754+0000 7f781be00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f781c155a20 0x7f781c06d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:46350/0 (socket says 172.21.15.106:46350) 2024-08-17T02:28:09.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.754+0000 7f781be00640 1 -- 172.21.15.106:0/633295991 learned_addr learned my addr 172.21.15.106:0/633295991 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:09.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.754+0000 7f781b400640 1 --2- 172.21.15.106:0/633295991 >> v2:172.21.15.171:3300/0 conn(0x7f781c06df00 0x7f781c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.754+0000 7f7820a00640 1 -- 172.21.15.106:0/633295991 >> v2:172.21.15.171:3300/0 conn(0x7f781c06df00 msgr2=0x7f781c0adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:09.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.754+0000 7f7820a00640 1 --2- 172.21.15.106:0/633295991 >> v2:172.21.15.171:3300/0 conn(0x7f781c06df00 0x7f781c0adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.754+0000 7f7820a00640 1 -- 172.21.15.106:0/633295991 >> v1:172.21.15.106:6789/0 conn(0x7f781c155a20 legacy=0x7f781c06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.754+0000 7f7820a00640 1 -- 172.21.15.106:0/633295991 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c06e8c0 con 0x7f781c155df0 2024-08-17T02:28:09.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.755+0000 7f7820a00640 1 --2- 172.21.15.106:0/633295991 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f781c155df0 0x7f781c0ad9b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f781c06aa40 tx=0x7f7814009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230c4751ea0bf94e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:09.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.755+0000 7f781aa00640 1 -- 172.21.15.106:0/633295991 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7814007550 con 0x7f781c155df0 2024-08-17T02:28:09.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.755+0000 7f781aa00640 1 -- 172.21.15.106:0/633295991 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781402d050 con 0x7f781c155df0 2024-08-17T02:28:09.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.755+0000 7f781aa00640 1 -- 172.21.15.106:0/633295991 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7814007920 con 0x7f781c155df0 2024-08-17T02:28:09.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.756+0000 7f7822a00640 1 -- 172.21.15.106:0/633295991 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f781c155df0 msgr2=0x7f781c0ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.756+0000 7f7822a00640 1 --2- 172.21.15.106:0/633295991 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f781c155df0 0x7f781c0ad9b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f781c06aa40 tx=0x7f7814009780 comp rx=0 tx=0).stop 2024-08-17T02:28:09.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.756+0000 7f7822a00640 1 -- 172.21.15.106:0/633295991 shutdown_connections 2024-08-17T02:28:09.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.756+0000 7f7822a00640 1 --2- 172.21.15.106:0/633295991 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f781c155df0 0x7f781c0ad9b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.756+0000 7f7822a00640 1 --2- 172.21.15.106:0/633295991 >> v2:172.21.15.171:3300/0 conn(0x7f781c06df00 0x7f781c0adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.756+0000 7f7822a00640 1 -- 172.21.15.106:0/633295991 >> 172.21.15.106:0/633295991 conn(0x7f781c0cb9b0 msgr2=0x7f781c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:09.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.756+0000 7f7822a00640 1 -- 172.21.15.106:0/633295991 shutdown_connections 2024-08-17T02:28:09.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.756+0000 7f7822a00640 1 -- 172.21.15.106:0/633295991 wait complete. 2024-08-17T02:28:09.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.757+0000 7f7822a00640 1 Processor -- start 2024-08-17T02:28:09.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.757+0000 7f7822a00640 1 -- start start 2024-08-17T02:28:09.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.758+0000 7f7822a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f781c06df00 0x7f781c13fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.758+0000 7f7822a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f781c155a20 0x7f781c0acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.758+0000 7f7822a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f781c155df0 0x7f781c0ad320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.758+0000 7f7822a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c0ab0a0 con 0x7f781c155df0 2024-08-17T02:28:09.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.758+0000 7f7822a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c0aa490 con 0x7f781c155a20 2024-08-17T02:28:09.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.758+0000 7f7822a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781c0aa770 con 0x7f781c06df00 2024-08-17T02:28:09.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.759+0000 7f7820a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f781c155df0 0x7f781c0ad320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.759+0000 7f7820a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f781c155df0 0x7f781c0ad320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:53754/0 (socket says 172.21.15.106:53754) 2024-08-17T02:28:09.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.759+0000 7f7820a00640 1 -- 172.21.15.106:0/2271096888 learned_addr learned my addr 172.21.15.106:0/2271096888 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:09.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.759+0000 7f781be00640 1 --2- 172.21.15.106:0/2271096888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f781c06df00 0x7f781c13fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.759+0000 7f781b400640 1 --2- 172.21.15.106:0/2271096888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f781c155a20 0x7f781c0acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.759+0000 7f7820a00640 1 -- 172.21.15.106:0/2271096888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f781c06df00 msgr2=0x7f781c13fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.759+0000 7f7820a00640 1 --2- 172.21.15.106:0/2271096888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f781c06df00 0x7f781c13fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.759+0000 7f7820a00640 1 -- 172.21.15.106:0/2271096888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f781c155a20 msgr2=0x7f781c0acde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.759+0000 7f7820a00640 1 --2- 172.21.15.106:0/2271096888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f781c155a20 0x7f781c0acde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.759+0000 7f7820a00640 1 -- 172.21.15.106:0/2271096888 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7814009a20 con 0x7f781c155df0 2024-08-17T02:28:09.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.759+0000 7f7820a00640 1 --2- 172.21.15.106:0/2271096888 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f781c155df0 0x7f781c0ad320 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f78140097c0 tx=0x7f7814037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:09.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.759+0000 7f7813400640 1 -- 172.21.15.106:0/2271096888 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7814031c10 con 0x7f781c155df0 2024-08-17T02:28:09.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.759+0000 7f7813400640 1 -- 172.21.15.106:0/2271096888 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7814031d70 con 0x7f781c155df0 2024-08-17T02:28:09.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.759+0000 7f7813400640 1 -- 172.21.15.106:0/2271096888 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781403c630 con 0x7f781c155df0 2024-08-17T02:28:09.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.760+0000 7f7822a00640 1 -- 172.21.15.106:0/2271096888 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f781c0aaa50 con 0x7f781c155df0 2024-08-17T02:28:09.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.760+0000 7f7822a00640 1 -- 172.21.15.106:0/2271096888 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f781c140060 con 0x7f781c155df0 2024-08-17T02:28:09.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.761+0000 7f7822a00640 1 -- 172.21.15.106:0/2271096888 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f781c0ab210 con 0x7f781c155df0 2024-08-17T02:28:09.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.761+0000 7f7813400640 1 -- 172.21.15.106:0/2271096888 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f781403c9a0 con 0x7f781c155df0 2024-08-17T02:28:09.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.762+0000 7f7813400640 1 --2- 172.21.15.106:0/2271096888 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f77fc065150 0x7f77fc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:09.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.762+0000 7f7813400640 1 -- 172.21.15.106:0/2271096888 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f78140a3eb0 con 0x7f781c155df0 2024-08-17T02:28:09.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.762+0000 7f781be00640 1 --2- 172.21.15.106:0/2271096888 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f77fc065150 0x7f77fc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:09.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.763+0000 7f781be00640 1 --2- 172.21.15.106:0/2271096888 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f77fc065150 0x7f77fc067600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f780c007fd0 tx=0x7f780c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:09.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.767+0000 7f7813400640 1 -- 172.21.15.106:0/2271096888 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7814071ed0 con 0x7f781c155df0 2024-08-17T02:28:09.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.974+0000 7f7822a00640 1 -- 172.21.15.106:0/2271096888 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f781c1402a0 con 0x7f781c155df0 2024-08-17T02:28:09.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.975+0000 7f7813400640 1 -- 172.21.15.106:0/2271096888 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7814040060 con 0x7f781c155df0 2024-08-17T02:28:09.976 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:28:09.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.977+0000 7f7822a00640 1 -- 172.21.15.106:0/2271096888 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f77fc065150 msgr2=0x7f77fc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.977+0000 7f7822a00640 1 --2- 172.21.15.106:0/2271096888 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f77fc065150 0x7f77fc067600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f780c007fd0 tx=0x7f780c009040 comp rx=0 tx=0).stop 2024-08-17T02:28:09.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.977+0000 7f7822a00640 1 -- 172.21.15.106:0/2271096888 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f781c155df0 msgr2=0x7f781c0ad320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:09.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.977+0000 7f7822a00640 1 --2- 172.21.15.106:0/2271096888 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f781c155df0 0x7f781c0ad320 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f78140097c0 tx=0x7f7814037000 comp rx=0 tx=0).stop 2024-08-17T02:28:09.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.977+0000 7f7822a00640 1 -- 172.21.15.106:0/2271096888 shutdown_connections 2024-08-17T02:28:09.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.977+0000 7f7822a00640 1 --2- 172.21.15.106:0/2271096888 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f77fc065150 0x7f77fc067600 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.977+0000 7f7822a00640 1 --2- 172.21.15.106:0/2271096888 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f781c155df0 0x7f781c0ad320 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.977+0000 7f7822a00640 1 --2- 172.21.15.106:0/2271096888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f781c155a20 0x7f781c0acde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.977+0000 7f7822a00640 1 --2- 172.21.15.106:0/2271096888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f781c06df00 0x7f781c13fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:09.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.977+0000 7f7822a00640 1 -- 172.21.15.106:0/2271096888 >> 172.21.15.106:0/2271096888 conn(0x7f781c0cb9b0 msgr2=0x7f781c0cb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:09.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.977+0000 7f7822a00640 1 -- 172.21.15.106:0/2271096888 shutdown_connections 2024-08-17T02:28:09.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:09.977+0000 7f7822a00640 1 -- 172.21.15.106:0/2271096888 wait complete. 2024-08-17T02:28:09.993 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:28:09.993 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:28:09.993 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi106.front.sepia.ceph.com 2024-08-17T02:28:09.993 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-08-17T02:28:09.993 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-08-17T02:28:09.993 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:28:09.993 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:28:09.993 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:28:09.993 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:28:09.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:09.994 DEBUG:teuthology.orchestra.run.smithi106:> ip addr 2024-08-17T02:28:10.029 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:28:10.030 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:28:10.030 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:28:10.030 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:10.030 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2024-08-17T02:28:10.030 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:10.030 INFO:teuthology.orchestra.run.smithi106.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:10.030 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2a brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:10.030 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f0 2024-08-17T02:28:10.031 INFO:teuthology.orchestra.run.smithi106.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:10.031 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:10.031 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f1 2024-08-17T02:28:10.031 INFO:teuthology.orchestra.run.smithi106.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:10.031 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6c brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:10.031 INFO:teuthology.orchestra.run.smithi106.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:28:10.031 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6d brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:10.031 INFO:teuthology.orchestra.run.smithi106.stdout: inet 172.21.15.106/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:28:10.031 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft 42557sec preferred_lft 42557sec 2024-08-17T02:28:10.032 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::ec4:7aff:fe8f:ce6d/64 scope link 2024-08-17T02:28:10.032 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:10.032 INFO:teuthology.orchestra.run.smithi106.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:28:10.032 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 8a:95:df:fe:35:fc brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:10.032 INFO:teuthology.orchestra.run.smithi106.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:28:10.032 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:10.032 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::a874:9aff:fe78:df5c/64 scope link 2024-08-17T02:28:10.032 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:10.032 INFO:teuthology.orchestra.run.smithi106.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:28:10.033 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 8a:95:df:fe:35:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:28:10.033 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::8895:dfff:fefe:35fc/64 scope link 2024-08-17T02:28:10.033 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:10.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:10.033 DEBUG:teuthology.orchestra.run.smithi106:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:28:10.123 INFO:teuthology.orchestra.run.smithi106.stdout:1 2024-08-17T02:28:10.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:10.126 DEBUG:teuthology.orchestra.run.smithi106:> route 2024-08-17T02:28:10.162 INFO:teuthology.orchestra.run.smithi106.stdout:Kernel IP routing table 2024-08-17T02:28:10.162 INFO:teuthology.orchestra.run.smithi106.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:28:10.162 INFO:teuthology.orchestra.run.smithi106.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:28:10.162 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:28:10.162 INFO:teuthology.orchestra.run.smithi106.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:28:10.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:10.163 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-08-17T02:28:10.163 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-08-17T02:28:10.163 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:28:10.163 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:28:10.163 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:28:10.163 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-08-17T02:28:10.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:10.308 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-08-17T02:28:10.343 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:28:10.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:10.343 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list-id 2024-08-17T02:28:10.421 INFO:teuthology.orchestra.run.smithi106.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-08-17T02:28:10.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:10.422 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-08-17T02:28:10.422 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-08-17T02:28:10.422 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:28:10.422 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-08-17T02:28:10.422 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-08-17T02:28:10.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:10.546 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:28:10.601 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:28:10.601 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:28:10.601 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:28:10.601 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:10.602 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2024-08-17T02:28:10.602 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:10.602 INFO:teuthology.orchestra.run.smithi106.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:28:10.602 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 52:9e:8f:b0:0b:ba brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:28:10.602 INFO:teuthology.orchestra.run.smithi106.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:28:10.602 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:10.602 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::509e:8fff:feb0:bba/64 scope link 2024-08-17T02:28:10.602 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:10.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:10.604 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:28:10.659 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:28:10.660 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:28:10.660 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:28:10.660 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:10.660 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2024-08-17T02:28:10.660 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:10.660 INFO:teuthology.orchestra.run.smithi106.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:28:10.660 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 52:9e:8f:b0:0b:ba brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:28:10.660 INFO:teuthology.orchestra.run.smithi106.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:28:10.660 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:10.660 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::509e:8fff:feb0:bba/64 scope link 2024-08-17T02:28:10.660 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:10.662 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-08-17T02:28:10.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:10.663 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-08-17T02:28:10.663 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-08-17T02:28:10.663 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-08-17T02:28:10.663 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:28:10.663 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-08-17T02:28:10.663 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-08-17T02:28:10.663 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-08-17T02:28:10.663 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-08-17T02:28:10.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:10.830 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-08-17T02:28:10.830 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-08-17T02:28:10.830 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set brx.1 up 2024-08-17T02:28:10.830 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:28:10.830 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-08-17T02:28:10.944 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:10.945 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-08-17T02:28:10.980 INFO:teuthology.orchestra.run.smithi106.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:28:10.980 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:10.980 DEBUG:teuthology.orchestra.run.smithi106:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:28:11.054 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-08-17T02:28:11.055 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:28:11.055 DEBUG:teuthology.orchestra.run.smithi106:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:11.175 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:11.175 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:28:11.204 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:11.204 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:28:11.204 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-08-17T02:28:11.204 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: trying mount with new device syntax: 2@2c52f2d2-3c39-4be0-9e1a-50df01bd49c4.cephfs=/ 2024-08-17T02:28:11.204 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.106:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-08-17T02:28:11.206 INFO:teuthology.orchestra.run.smithi106.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-08-17T02:28:11.206 INFO:teuthology.orchestra.run.smithi106.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:28:11.206 INFO:teuthology.orchestra.run.smithi106.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:28:11.206 INFO:teuthology.orchestra.run.smithi106.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:28:11.206 INFO:teuthology.orchestra.run.smithi106.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:28:11.209 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:28:11.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:11.209 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:28:11.212 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:11.216 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:11.265 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-08-17T02:28:11.266 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:28:11.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.482+0000 7f93acc00640 1 Processor -- start 2024-08-17T02:28:11.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.482+0000 7f93acc00640 1 -- start start 2024-08-17T02:28:11.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.484+0000 7f93acc00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f93a806df00 0x7f93a80adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.484+0000 7f93acc00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f93a8155df0 0x7f93a80ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.484+0000 7f93acc00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a8156670 con 0x7f93a8155a20 2024-08-17T02:28:11.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.484+0000 7f93acc00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a80b0350 con 0x7f93a806df00 2024-08-17T02:28:11.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.484+0000 7f93acc00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a806e5e0 con 0x7f93a8155df0 2024-08-17T02:28:11.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.484+0000 7f93a5e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f93a8155a20 0x7f93a806d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39308/0 (socket says 172.21.15.106:39308) 2024-08-17T02:28:11.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.484+0000 7f93a5e00640 1 -- 172.21.15.106:0/3948288885 learned_addr learned my addr 172.21.15.106:0/3948288885 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:11.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.484+0000 7f939d400640 1 --2- 172.21.15.106:0/3948288885 >> v2:172.21.15.106:3300/0 conn(0x7f93a806df00 0x7f93a80adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.484+0000 7f93a6800640 1 --2- 172.21.15.106:0/3948288885 >> v2:172.21.15.171:3300/0 conn(0x7f93a8155df0 0x7f93a80ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.484+0000 7f93a5400640 1 -- 172.21.15.106:0/3948288885 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410833334 0 0) 0x7f93a8156670 con 0x7f93a8155a20 2024-08-17T02:28:11.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.484+0000 7f939d400640 1 -- 172.21.15.106:0/3948288885 >> v2:172.21.15.171:3300/0 conn(0x7f93a8155df0 msgr2=0x7f93a80ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:11.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.484+0000 7f939d400640 1 --2- 172.21.15.106:0/3948288885 >> v2:172.21.15.171:3300/0 conn(0x7f93a8155df0 0x7f93a80ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.484+0000 7f939d400640 1 -- 172.21.15.106:0/3948288885 >> v1:172.21.15.106:6789/0 conn(0x7f93a8155a20 legacy=0x7f93a806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.484+0000 7f939d400640 1 -- 172.21.15.106:0/3948288885 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a806e8c0 con 0x7f93a806df00 2024-08-17T02:28:11.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.484+0000 7f93a6800640 1 --2- 172.21.15.106:0/3948288885 >> v2:172.21.15.171:3300/0 conn(0x7f93a8155df0 0x7f93a80ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:11.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.485+0000 7f939d400640 1 --2- 172.21.15.106:0/3948288885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93a806df00 0x7f93a80adf10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f93a80b0710 tx=0x7f93900090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a61967990360855 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.486+0000 7f93a5400640 1 -- 172.21.15.106:0/3948288885 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939002ad20 con 0x7f93a806df00 2024-08-17T02:28:11.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.486+0000 7f93a5400640 1 -- 172.21.15.106:0/3948288885 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939002ae80 con 0x7f93a806df00 2024-08-17T02:28:11.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.486+0000 7f93a5400640 1 -- 172.21.15.106:0/3948288885 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9390032670 con 0x7f93a806df00 2024-08-17T02:28:11.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.486+0000 7f93acc00640 1 -- 172.21.15.106:0/3948288885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93a806df00 msgr2=0x7f93a80adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.486+0000 7f93acc00640 1 --2- 172.21.15.106:0/3948288885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93a806df00 0x7f93a80adf10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f93a80b0710 tx=0x7f93900090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.486+0000 7f93acc00640 1 -- 172.21.15.106:0/3948288885 shutdown_connections 2024-08-17T02:28:11.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.486+0000 7f93acc00640 1 --2- 172.21.15.106:0/3948288885 >> v2:172.21.15.171:3300/0 conn(0x7f93a8155df0 0x7f93a80ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.486+0000 7f93acc00640 1 --2- 172.21.15.106:0/3948288885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93a806df00 0x7f93a80adf10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.486+0000 7f93acc00640 1 -- 172.21.15.106:0/3948288885 >> 172.21.15.106:0/3948288885 conn(0x7f93a80cb9b0 msgr2=0x7f93a80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:11.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.486+0000 7f93acc00640 1 -- 172.21.15.106:0/3948288885 shutdown_connections 2024-08-17T02:28:11.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.486+0000 7f93acc00640 1 -- 172.21.15.106:0/3948288885 wait complete. 2024-08-17T02:28:11.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.488+0000 7f93acc00640 1 Processor -- start 2024-08-17T02:28:11.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.488+0000 7f93acc00640 1 -- start start 2024-08-17T02:28:11.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.489+0000 7f93acc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93a806df00 0x7f93a8166eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.489+0000 7f93acc00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f93a8155a20 0x7f93a8169cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.489+0000 7f93acc00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f93a8155df0 0x7f93a813bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.489+0000 7f93acc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a816b410 con 0x7f93a806df00 2024-08-17T02:28:11.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.489+0000 7f93acc00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a816a200 con 0x7f93a8155a20 2024-08-17T02:28:11.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.489+0000 7f93acc00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a816a800 con 0x7f93a8155df0 2024-08-17T02:28:11.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.489+0000 7f93a5e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93a806df00 0x7f93a8166eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.489+0000 7f93a5e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93a806df00 0x7f93a8166eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40536/0 (socket says 172.21.15.106:40536) 2024-08-17T02:28:11.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.489+0000 7f93a5e00640 1 -- 172.21.15.106:0/52937440 learned_addr learned my addr 172.21.15.106:0/52937440 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:11.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.489+0000 7f93a5e00640 1 -- 172.21.15.106:0/52937440 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f93a8155df0 msgr2=0x7f93a813bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.489+0000 7f93a6800640 1 --2- 172.21.15.106:0/52937440 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f93a8155df0 0x7f93a813bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.489+0000 7f939d400640 1 --2- 172.21.15.106:0/52937440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f93a8155a20 0x7f93a8169cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.489+0000 7f93a5e00640 1 --2- 172.21.15.106:0/52937440 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f93a8155df0 0x7f93a813bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.489+0000 7f93a5e00640 1 -- 172.21.15.106:0/52937440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f93a8155a20 msgr2=0x7f93a8169cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.489+0000 7f93a5e00640 1 --2- 172.21.15.106:0/52937440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f93a8155a20 0x7f93a8169cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.489+0000 7f93a5e00640 1 -- 172.21.15.106:0/52937440 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9390009390 con 0x7f93a806df00 2024-08-17T02:28:11.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.489+0000 7f93a6800640 1 --2- 172.21.15.106:0/52937440 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f93a8155df0 0x7f93a813bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:11.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.489+0000 7f939d400640 1 --2- 172.21.15.106:0/52937440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f93a8155a20 0x7f93a8169cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:11.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.490+0000 7f93a5e00640 1 --2- 172.21.15.106:0/52937440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93a806df00 0x7f93a8166eb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f939800c5e0 tx=0x7f9398007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.490+0000 7f939e000640 1 -- 172.21.15.106:0/52937440 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9398005aa0 con 0x7f93a806df00 2024-08-17T02:28:11.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.490+0000 7f939e000640 1 -- 172.21.15.106:0/52937440 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9398005c00 con 0x7f93a806df00 2024-08-17T02:28:11.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.490+0000 7f939e000640 1 -- 172.21.15.106:0/52937440 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93980070f0 con 0x7f93a806df00 2024-08-17T02:28:11.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.490+0000 7f93acc00640 1 -- 172.21.15.106:0/52937440 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a816aae0 con 0x7f93a806df00 2024-08-17T02:28:11.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.490+0000 7f93acc00640 1 -- 172.21.15.106:0/52937440 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a816b0a0 con 0x7f93a806df00 2024-08-17T02:28:11.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.491+0000 7f93acc00640 1 -- 172.21.15.106:0/52937440 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a8064db0 con 0x7f93a806df00 2024-08-17T02:28:11.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.492+0000 7f939e000640 1 -- 172.21.15.106:0/52937440 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9398007520 con 0x7f93a806df00 2024-08-17T02:28:11.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.493+0000 7f939e000640 1 --2- 172.21.15.106:0/52937440 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9384065150 0x7f9384067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:11.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.493+0000 7f939e000640 1 -- 172.21.15.106:0/52937440 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9398081ff0 con 0x7f93a806df00 2024-08-17T02:28:11.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.493+0000 7f939d400640 1 --2- 172.21.15.106:0/52937440 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9384065150 0x7f9384067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:11.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.493+0000 7f939d400640 1 --2- 172.21.15.106:0/52937440 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9384065150 0x7f9384067600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9390034000 tx=0x7f9390032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:11.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.496+0000 7f939e000640 1 -- 172.21.15.106:0/52937440 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f93980500f0 con 0x7f93a806df00 2024-08-17T02:28:11.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.704+0000 7f93acc00640 1 -- 172.21.15.106:0/52937440 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f93a815a410 con 0x7f93a806df00 2024-08-17T02:28:11.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.704+0000 7f939e000640 1 -- 172.21.15.106:0/52937440 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9398053710 con 0x7f93a806df00 2024-08-17T02:28:11.706 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:28:11.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.706+0000 7f93acc00640 1 -- 172.21.15.106:0/52937440 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9384065150 msgr2=0x7f9384067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.706+0000 7f93acc00640 1 --2- 172.21.15.106:0/52937440 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9384065150 0x7f9384067600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9390034000 tx=0x7f9390032000 comp rx=0 tx=0).stop 2024-08-17T02:28:11.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.706+0000 7f93acc00640 1 -- 172.21.15.106:0/52937440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93a806df00 msgr2=0x7f93a8166eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:11.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.706+0000 7f93acc00640 1 --2- 172.21.15.106:0/52937440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93a806df00 0x7f93a8166eb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f939800c5e0 tx=0x7f9398007d60 comp rx=0 tx=0).stop 2024-08-17T02:28:11.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.706+0000 7f93acc00640 1 -- 172.21.15.106:0/52937440 shutdown_connections 2024-08-17T02:28:11.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.706+0000 7f93acc00640 1 --2- 172.21.15.106:0/52937440 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f93a8155df0 0x7f93a813bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.706+0000 7f93acc00640 1 --2- 172.21.15.106:0/52937440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f93a8155a20 0x7f93a8169cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.706+0000 7f93acc00640 1 --2- 172.21.15.106:0/52937440 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9384065150 0x7f9384067600 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.706+0000 7f93acc00640 1 --2- 172.21.15.106:0/52937440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93a806df00 0x7f93a8166eb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:11.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.706+0000 7f93acc00640 1 -- 172.21.15.106:0/52937440 >> 172.21.15.106:0/52937440 conn(0x7f93a80cb9b0 msgr2=0x7f93a815a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:11.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.706+0000 7f93acc00640 1 -- 172.21.15.106:0/52937440 shutdown_connections 2024-08-17T02:28:11.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:11.706+0000 7f93acc00640 1 -- 172.21.15.106:0/52937440 wait complete. 2024-08-17T02:28:11.723 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:28:11.723 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:28:11.723 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-08-17T02:28:11.723 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:28:11.723 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:11.723 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:28:11.723 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:28:11.723 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:28:11.723 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:28:11.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:11.724 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-08-17T02:28:11.764 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:28:11.764 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:28:11.764 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:28:11.764 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:11.764 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-08-17T02:28:11.764 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:11.764 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:11.764 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:11.764 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-08-17T02:28:11.765 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:11.765 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:11.765 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-08-17T02:28:11.765 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:11.765 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:11.765 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:28:11.765 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:11.765 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:28:11.765 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42627sec preferred_lft 42627sec 2024-08-17T02:28:11.765 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link 2024-08-17T02:28:11.765 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:11.766 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:28:11.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:11.766 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec bash -c ' 2024-08-17T02:28:11.766 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-08-17T02:28:11.766 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:28:11.766 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip addr flush dev ceph-brx 2024-08-17T02:28:11.766 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set ceph-brx up 2024-08-17T02:28:11.766 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:28:11.766 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-08-17T02:28:12.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:12.131 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:28:12.188 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-08-17T02:28:12.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:12.192 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-08-17T02:28:12.253 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-08-17T02:28:12.254 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:28:12.254 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:28:12.254 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:28:12.254 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:28:12.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:12.254 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec bash -c ' 2024-08-17T02:28:12.254 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-08-17T02:28:12.254 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:28:12.254 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:28:12.254 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:28:12.254 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-08-17T02:28:12.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:12.840 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-08-17T02:28:12.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:12.877 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list-id 2024-08-17T02:28:12.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:12.952 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec bash -c ' 2024-08-17T02:28:12.953 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-08-17T02:28:12.953 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:28:12.953 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-17T02:28:12.953 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-08-17T02:28:13.081 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-17T02:28:13.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:13.082 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec bash -c ' 2024-08-17T02:28:13.082 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-08-17T02:28:13.082 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-17T02:28:13.082 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:28:13.082 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-17T02:28:13.082 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-17T02:28:13.082 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-17T02:28:13.082 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-08-17T02:28:13.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:13.267 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec bash -c ' 2024-08-17T02:28:13.267 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-08-17T02:28:13.267 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.0 up 2024-08-17T02:28:13.267 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:28:13.268 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-08-17T02:28:13.384 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:13.384 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:13.419 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:28:13.420 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:13.420 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:13.494 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:28:13.494 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:28:13.495 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:13.639 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:13.639 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:28:14.274 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:14.275 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:28:14.275 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-08-17T02:28:14.275 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with new device syntax: 1@2c52f2d2-3c39-4be0-9e1a-50df01bd49c4.cephfs=/ 2024-08-17T02:28:14.275 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.106:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-08-17T02:28:14.275 INFO:teuthology.orchestra.run.smithi171.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:28:14.276 INFO:teuthology.orchestra.run.smithi171.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:28:14.276 INFO:teuthology.orchestra.run.smithi171.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:28:14.276 INFO:teuthology.orchestra.run.smithi171.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:28:14.276 INFO:teuthology.orchestra.run.smithi171.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:28:14.279 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:28:14.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:14.279 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:14.336 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-08-17T02:28:14.336 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:28:14.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.492+0000 7fa5e1800640 1 Processor -- start 2024-08-17T02:28:14.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.492+0000 7fa5e1800640 1 -- start start 2024-08-17T02:28:14.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.493+0000 7fa5e1800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa5dc140580 0x7fa5dc0c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.493+0000 7fa5e1800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5dc0caa80 con 0x7fa5dc1401b0 2024-08-17T02:28:14.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.493+0000 7fa5e1800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5dc0c9e70 con 0x7fa5dc0b1440 2024-08-17T02:28:14.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.493+0000 7fa5e1800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5dc0c9c90 con 0x7fa5dc140580 2024-08-17T02:28:14.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.493+0000 7fa5daa00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa5dc1401b0 0x7fa5dc0b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39324/0 (socket says 172.21.15.106:39324) 2024-08-17T02:28:14.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.493+0000 7fa5daa00640 1 -- 172.21.15.106:0/969849173 learned_addr learned my addr 172.21.15.106:0/969849173 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:14.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.494+0000 7fa5db400640 1 --2- 172.21.15.106:0/969849173 >> v2:172.21.15.171:3300/0 conn(0x7fa5dc140580 0x7fa5dc0c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.494+0000 7fa5d9600640 1 -- 172.21.15.106:0/969849173 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797555665 0 0) 0x7fa5dc0caa80 con 0x7fa5dc1401b0 2024-08-17T02:28:14.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.494+0000 7fa5d9600640 1 -- 172.21.15.106:0/969849173 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5c00034e0 con 0x7fa5dc1401b0 2024-08-17T02:28:14.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.494+0000 7fa5d9600640 1 -- 172.21.15.106:0/969849173 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126824793 0 0) 0x7fa5dc0c9e70 con 0x7fa5dc0b1440 2024-08-17T02:28:14.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.494+0000 7fa5d9600640 1 -- 172.21.15.106:0/969849173 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5dc0caa80 con 0x7fa5dc0b1440 2024-08-17T02:28:14.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.494+0000 7fa5db400640 1 -- 172.21.15.106:0/969849173 >> v1:172.21.15.171:6789/0 conn(0x7fa5dc0b1440 legacy=0x7fa5dc0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.494+0000 7fa5db400640 1 -- 172.21.15.106:0/969849173 >> v1:172.21.15.106:6789/0 conn(0x7fa5dc1401b0 legacy=0x7fa5dc0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.494+0000 7fa5db400640 1 -- 172.21.15.106:0/969849173 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc0ca150 con 0x7fa5dc140580 2024-08-17T02:28:14.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.495+0000 7fa5db400640 1 --2- 172.21.15.106:0/969849173 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5dc140580 0x7fa5dc0c9750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4009e60 tx=0x7fa5d4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f72678d0a0f56d6b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:14.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.495+0000 7fa5d9600640 1 -- 172.21.15.106:0/969849173 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d4007550 con 0x7fa5dc140580 2024-08-17T02:28:14.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.496+0000 7fa5d9600640 1 -- 172.21.15.106:0/969849173 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d402d050 con 0x7fa5dc140580 2024-08-17T02:28:14.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.496+0000 7fa5d9600640 1 -- 172.21.15.106:0/969849173 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d40078c0 con 0x7fa5dc140580 2024-08-17T02:28:14.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.496+0000 7fa5e1800640 1 -- 172.21.15.106:0/969849173 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5dc140580 msgr2=0x7fa5dc0c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.496+0000 7fa5e1800640 1 --2- 172.21.15.106:0/969849173 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5dc140580 0x7fa5dc0c9750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4009e60 tx=0x7fa5d4009780 comp rx=0 tx=0).stop 2024-08-17T02:28:14.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.496+0000 7fa5e1800640 1 -- 172.21.15.106:0/969849173 shutdown_connections 2024-08-17T02:28:14.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.496+0000 7fa5e1800640 1 --2- 172.21.15.106:0/969849173 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5dc140580 0x7fa5dc0c9750 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.496+0000 7fa5e1800640 1 -- 172.21.15.106:0/969849173 >> 172.21.15.106:0/969849173 conn(0x7fa5dc0cb9b0 msgr2=0x7fa5dc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:14.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.496+0000 7fa5e1800640 1 -- 172.21.15.106:0/969849173 shutdown_connections 2024-08-17T02:28:14.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.496+0000 7fa5e1800640 1 -- 172.21.15.106:0/969849173 wait complete. 2024-08-17T02:28:14.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.498+0000 7fa5e1800640 1 Processor -- start 2024-08-17T02:28:14.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.498+0000 7fa5e1800640 1 -- start start 2024-08-17T02:28:14.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.499+0000 7fa5e1800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5dc0b1440 0x7fa5dc15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.499+0000 7fa5e1800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5dc1401b0 0x7fa5dc13bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.499+0000 7fa5e1800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5dc140580 0x7fa5dc13d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.499+0000 7fa5e1800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc13ba60 con 0x7fa5dc140580 2024-08-17T02:28:14.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.499+0000 7fa5e1800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc13ab70 con 0x7fa5dc1401b0 2024-08-17T02:28:14.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.499+0000 7fa5e1800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc13ae50 con 0x7fa5dc0b1440 2024-08-17T02:28:14.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.499+0000 7fa5db400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5dc140580 0x7fa5dc13d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.499+0000 7fa5db400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5dc140580 0x7fa5dc13d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40550/0 (socket says 172.21.15.106:40550) 2024-08-17T02:28:14.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.499+0000 7fa5db400640 1 -- 172.21.15.106:0/3466421766 learned_addr learned my addr 172.21.15.106:0/3466421766 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:14.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.500+0000 7fa5db400640 1 -- 172.21.15.106:0/3466421766 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5dc0b1440 msgr2=0x7fa5dc15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.500+0000 7fa5db400640 1 --2- 172.21.15.106:0/3466421766 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5dc0b1440 0x7fa5dc15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.500+0000 7fa5db400640 1 -- 172.21.15.106:0/3466421766 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5dc1401b0 msgr2=0x7fa5dc13bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.500+0000 7fa5da000640 1 --2- 172.21.15.106:0/3466421766 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5dc1401b0 0x7fa5dc13bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.500+0000 7fa5db400640 1 --2- 172.21.15.106:0/3466421766 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5dc1401b0 0x7fa5dc13bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.500+0000 7fa5db400640 1 -- 172.21.15.106:0/3466421766 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d4009a20 con 0x7fa5dc140580 2024-08-17T02:28:14.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.500+0000 7fa5da000640 1 --2- 172.21.15.106:0/3466421766 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5dc1401b0 0x7fa5dc13bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:14.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.500+0000 7fa5db400640 1 --2- 172.21.15.106:0/3466421766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5dc140580 0x7fa5dc13d0b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa5d40097c0 tx=0x7fa5d4037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:14.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.500+0000 7fa5d2000640 1 -- 172.21.15.106:0/3466421766 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d4031ac0 con 0x7fa5dc140580 2024-08-17T02:28:14.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.500+0000 7fa5d2000640 1 -- 172.21.15.106:0/3466421766 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d4031c20 con 0x7fa5dc140580 2024-08-17T02:28:14.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.500+0000 7fa5d2000640 1 -- 172.21.15.106:0/3466421766 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d4045460 con 0x7fa5dc140580 2024-08-17T02:28:14.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.500+0000 7fa5e1800640 1 -- 172.21.15.106:0/3466421766 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5dc13b130 con 0x7fa5dc140580 2024-08-17T02:28:14.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.500+0000 7fa5e1800640 1 -- 172.21.15.106:0/3466421766 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5dc13b6f0 con 0x7fa5dc140580 2024-08-17T02:28:14.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.502+0000 7fa5e1800640 1 -- 172.21.15.106:0/3466421766 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5dc064db0 con 0x7fa5dc140580 2024-08-17T02:28:14.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.502+0000 7fa5d2000640 1 -- 172.21.15.106:0/3466421766 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa5d403c420 con 0x7fa5dc140580 2024-08-17T02:28:14.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.503+0000 7fa5d2000640 1 --2- 172.21.15.106:0/3466421766 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa5bc065150 0x7fa5bc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:14.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.503+0000 7fa5d2000640 1 -- 172.21.15.106:0/3466421766 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa5d40a3fa0 con 0x7fa5dc140580 2024-08-17T02:28:14.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.504+0000 7fa5daa00640 1 --2- 172.21.15.106:0/3466421766 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa5bc065150 0x7fa5bc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:14.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.504+0000 7fa5daa00640 1 --2- 172.21.15.106:0/3466421766 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa5bc065150 0x7fa5bc067600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc005840 tx=0x7fa5cc007960 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:14.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.508+0000 7fa5d2000640 1 -- 172.21.15.106:0/3466421766 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa5d4072110 con 0x7fa5dc140580 2024-08-17T02:28:14.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.715+0000 7fa5e1800640 1 -- 172.21.15.106:0/3466421766 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa5dc13bba0 con 0x7fa5dc140580 2024-08-17T02:28:14.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.716+0000 7fa5d2000640 1 -- 172.21.15.106:0/3466421766 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa5d4040060 con 0x7fa5dc140580 2024-08-17T02:28:14.717 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:28:14.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.718+0000 7fa5e1800640 1 -- 172.21.15.106:0/3466421766 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa5bc065150 msgr2=0x7fa5bc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.718+0000 7fa5e1800640 1 --2- 172.21.15.106:0/3466421766 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa5bc065150 0x7fa5bc067600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc005840 tx=0x7fa5cc007960 comp rx=0 tx=0).stop 2024-08-17T02:28:14.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.718+0000 7fa5e1800640 1 -- 172.21.15.106:0/3466421766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5dc140580 msgr2=0x7fa5dc13d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:14.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.718+0000 7fa5e1800640 1 --2- 172.21.15.106:0/3466421766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5dc140580 0x7fa5dc13d0b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa5d40097c0 tx=0x7fa5d4037000 comp rx=0 tx=0).stop 2024-08-17T02:28:14.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.718+0000 7fa5e1800640 1 -- 172.21.15.106:0/3466421766 shutdown_connections 2024-08-17T02:28:14.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.718+0000 7fa5e1800640 1 --2- 172.21.15.106:0/3466421766 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa5bc065150 0x7fa5bc067600 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.718+0000 7fa5e1800640 1 --2- 172.21.15.106:0/3466421766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5dc140580 0x7fa5dc13d0b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.718+0000 7fa5e1800640 1 --2- 172.21.15.106:0/3466421766 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5dc1401b0 0x7fa5dc13bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.718+0000 7fa5e1800640 1 --2- 172.21.15.106:0/3466421766 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa5dc0b1440 0x7fa5dc15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:14.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.718+0000 7fa5e1800640 1 -- 172.21.15.106:0/3466421766 >> 172.21.15.106:0/3466421766 conn(0x7fa5dc0cb9b0 msgr2=0x7fa5dc13ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:14.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.718+0000 7fa5e1800640 1 -- 172.21.15.106:0/3466421766 shutdown_connections 2024-08-17T02:28:14.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:14.718+0000 7fa5e1800640 1 -- 172.21.15.106:0/3466421766 wait complete. 2024-08-17T02:28:14.733 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:28:14.734 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:28:14.734 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-08-17T02:28:14.734 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-08-17T02:28:14.734 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-08-17T02:28:14.734 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:28:14.734 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:28:14.734 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:28:14.734 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:28:14.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:14.735 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-08-17T02:28:14.771 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:28:14.771 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:28:14.771 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:28:14.771 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:14.771 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-08-17T02:28:14.771 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:14.771 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:14.771 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:14.771 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-08-17T02:28:14.771 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:14.771 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:14.771 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-08-17T02:28:14.772 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:14.772 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:14.772 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:28:14.772 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:14.772 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:28:14.772 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42624sec preferred_lft 42624sec 2024-08-17T02:28:14.772 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link 2024-08-17T02:28:14.772 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:14.772 INFO:teuthology.orchestra.run.smithi171.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:28:14.772 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether e6:a4:13:42:80:60 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:14.772 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:28:14.772 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:14.772 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::44f0:85ff:fef1:f4b/64 scope link 2024-08-17T02:28:14.772 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:14.773 INFO:teuthology.orchestra.run.smithi171.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:28:14.773 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether e6:a4:13:42:80:60 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:28:14.773 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::e4a4:13ff:fe42:8060/64 scope link tentative 2024-08-17T02:28:14.773 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:14.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:14.774 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:28:14.867 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-08-17T02:28:14.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:14.871 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-08-17T02:28:14.907 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-08-17T02:28:14.907 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:28:14.907 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:28:14.907 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:28:14.907 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:28:14.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:14.908 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec bash -c ' 2024-08-17T02:28:14.908 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-08-17T02:28:14.908 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:28:14.908 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:28:14.908 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:28:14.908 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-08-17T02:28:15.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:15.054 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-08-17T02:28:15.088 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:28:15.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:15.090 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list-id 2024-08-17T02:28:15.164 INFO:teuthology.orchestra.run.smithi171.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-08-17T02:28:15.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:15.164 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec bash -c ' 2024-08-17T02:28:15.165 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-08-17T02:28:15.165 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:28:15.165 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-08-17T02:28:15.165 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-08-17T02:28:15.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:15.289 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:28:15.346 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:28:15.346 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:28:15.346 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:28:15.346 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:15.346 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-08-17T02:28:15.347 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:15.347 INFO:teuthology.orchestra.run.smithi171.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:28:15.347 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 8e:e1:95:ee:cc:59 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:28:15.347 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:28:15.347 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:15.347 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::8ce1:95ff:feee:cc59/64 scope link 2024-08-17T02:28:15.347 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:15.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:15.349 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:28:15.405 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:28:15.405 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:28:15.406 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:28:15.406 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:15.406 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-08-17T02:28:15.406 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:15.406 INFO:teuthology.orchestra.run.smithi171.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:28:15.406 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 8e:e1:95:ee:cc:59 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:28:15.406 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:28:15.406 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:15.406 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::8ce1:95ff:feee:cc59/64 scope link 2024-08-17T02:28:15.406 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:15.408 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-08-17T02:28:15.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:15.409 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec bash -c ' 2024-08-17T02:28:15.409 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-08-17T02:28:15.409 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-08-17T02:28:15.409 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:28:15.409 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-08-17T02:28:15.409 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-08-17T02:28:15.409 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-08-17T02:28:15.409 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-08-17T02:28:15.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:15.573 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec bash -c ' 2024-08-17T02:28:15.573 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-08-17T02:28:15.573 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.1 up 2024-08-17T02:28:15.574 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:28:15.574 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-08-17T02:28:15.689 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:15.689 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-08-17T02:28:15.724 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:28:15.724 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:15.724 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:28:15.798 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-08-17T02:28:15.798 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:28:15.799 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:15.920 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:15.920 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:28:15.947 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:15.947 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:28:15.947 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-08-17T02:28:15.947 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with new device syntax: 3@2c52f2d2-3c39-4be0-9e1a-50df01bd49c4.cephfs=/ 2024-08-17T02:28:15.947 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.106:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-08-17T02:28:15.948 INFO:teuthology.orchestra.run.smithi171.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-08-17T02:28:15.948 INFO:teuthology.orchestra.run.smithi171.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:28:15.948 INFO:teuthology.orchestra.run.smithi171.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:28:15.948 INFO:teuthology.orchestra.run.smithi171.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:28:15.948 INFO:teuthology.orchestra.run.smithi171.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:28:15.951 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:28:15.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:15.951 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:28:16.007 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-08-17T02:28:16.023 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:16.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.178+0000 7fa110c00640 1 Processor -- start 2024-08-17T02:28:16.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.178+0000 7fa110c00640 1 -- start start 2024-08-17T02:28:16.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.179+0000 7fa110c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa10c155550 0x7fa10c0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.179+0000 7fa110c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa10c06e080 0x7fa10c06e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.179+0000 7fa110c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa10c0afc10 con 0x7fa10c155180 2024-08-17T02:28:16.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.179+0000 7fa110c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa10c06ea00 con 0x7fa10c06e080 2024-08-17T02:28:16.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.179+0000 7fa110c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa10c0af000 con 0x7fa10c155550 2024-08-17T02:28:16.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.180+0000 7fa10a800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa10c06e080 0x7fa10c06e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.180+0000 7fa10a800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa10c06e080 0x7fa10c06e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40560/0 (socket says 172.21.15.106:40560) 2024-08-17T02:28:16.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.180+0000 7fa10a800640 1 -- 172.21.15.106:0/532949167 learned_addr learned my addr 172.21.15.106:0/532949167 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:16.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.180+0000 7fa109e00640 1 --1- 172.21.15.106:0/532949167 >> v1:172.21.15.106:6789/0 conn(0x7fa10c155180 0x7fa10c0ae070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39332/0 (socket says 172.21.15.106:39332) 2024-08-17T02:28:16.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.180+0000 7fa109400640 1 --2- 172.21.15.106:0/532949167 >> v2:172.21.15.171:3300/0 conn(0x7fa10c155550 0x7fa10c0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.180+0000 7fa10a800640 1 -- 172.21.15.106:0/532949167 >> v2:172.21.15.171:3300/0 conn(0x7fa10c155550 msgr2=0x7fa10c0aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:16.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.180+0000 7fa10a800640 1 --2- 172.21.15.106:0/532949167 >> v2:172.21.15.171:3300/0 conn(0x7fa10c155550 0x7fa10c0aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.180+0000 7fa10a800640 1 -- 172.21.15.106:0/532949167 >> v1:172.21.15.106:6789/0 conn(0x7fa10c155180 legacy=0x7fa10c0ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.180+0000 7fa10a800640 1 -- 172.21.15.106:0/532949167 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10c0af2e0 con 0x7fa10c06e080 2024-08-17T02:28:16.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.180+0000 7fa108a00640 1 -- 172.21.15.106:0/532949167 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 333267527 0 0) 0x7fa10c0afc10 con 0x7fa10c155180 2024-08-17T02:28:16.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.181+0000 7fa10a800640 1 --2- 172.21.15.106:0/532949167 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa10c06e080 0x7fa10c06e4c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa10c06c770 tx=0x7fa104009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9d7450f80bd0aa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.181+0000 7fa108a00640 1 -- 172.21.15.106:0/532949167 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10402e050 con 0x7fa10c06e080 2024-08-17T02:28:16.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.182+0000 7fa108a00640 1 -- 172.21.15.106:0/532949167 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa104007400 con 0x7fa10c06e080 2024-08-17T02:28:16.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.182+0000 7fa108a00640 1 -- 172.21.15.106:0/532949167 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1040077a0 con 0x7fa10c06e080 2024-08-17T02:28:16.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.182+0000 7fa110c00640 1 -- 172.21.15.106:0/532949167 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa10c06e080 msgr2=0x7fa10c06e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.182+0000 7fa110c00640 1 --2- 172.21.15.106:0/532949167 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa10c06e080 0x7fa10c06e4c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa10c06c770 tx=0x7fa104009840 comp rx=0 tx=0).stop 2024-08-17T02:28:16.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.182+0000 7fa110c00640 1 -- 172.21.15.106:0/532949167 shutdown_connections 2024-08-17T02:28:16.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.182+0000 7fa110c00640 1 --2- 172.21.15.106:0/532949167 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa10c06e080 0x7fa10c06e4c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.182+0000 7fa110c00640 1 --2- 172.21.15.106:0/532949167 >> v2:172.21.15.171:3300/0 conn(0x7fa10c155550 0x7fa10c0aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.182+0000 7fa110c00640 1 -- 172.21.15.106:0/532949167 >> 172.21.15.106:0/532949167 conn(0x7fa10c0cb9b0 msgr2=0x7fa10c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:16.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.182+0000 7fa110c00640 1 -- 172.21.15.106:0/532949167 shutdown_connections 2024-08-17T02:28:16.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.182+0000 7fa110c00640 1 -- 172.21.15.106:0/532949167 wait complete. 2024-08-17T02:28:16.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.183+0000 7fa110c00640 1 Processor -- start 2024-08-17T02:28:16.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.184+0000 7fa110c00640 1 -- start start 2024-08-17T02:28:16.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.184+0000 7fa110c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa10c06e080 0x7fa10c1484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.184+0000 7fa110c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa10c155180 0x7fa10c0c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.185+0000 7fa110c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa10c155550 0x7fa10c0c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.185+0000 7fa110c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c148a30 con 0x7fa10c155550 2024-08-17T02:28:16.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.185+0000 7fa110c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c0c1090 con 0x7fa10c06e080 2024-08-17T02:28:16.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.185+0000 7fa110c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c0c46f0 con 0x7fa10c155180 2024-08-17T02:28:16.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.185+0000 7fa10a800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa10c155550 0x7fa10c0c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.185+0000 7fa10a800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa10c155550 0x7fa10c0c5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40568/0 (socket says 172.21.15.106:40568) 2024-08-17T02:28:16.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.185+0000 7fa10a800640 1 -- 172.21.15.106:0/1827378856 learned_addr learned my addr 172.21.15.106:0/1827378856 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:16.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.185+0000 7fa109e00640 1 --2- 172.21.15.106:0/1827378856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa10c06e080 0x7fa10c1484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.185+0000 7fa109400640 1 --2- 172.21.15.106:0/1827378856 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa10c155180 0x7fa10c0c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.185+0000 7fa10a800640 1 -- 172.21.15.106:0/1827378856 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa10c155180 msgr2=0x7fa10c0c3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.185+0000 7fa10a800640 1 --2- 172.21.15.106:0/1827378856 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa10c155180 0x7fa10c0c3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.185+0000 7fa10a800640 1 -- 172.21.15.106:0/1827378856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa10c06e080 msgr2=0x7fa10c1484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.185+0000 7fa10a800640 1 --2- 172.21.15.106:0/1827378856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa10c06e080 0x7fa10c1484f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.185+0000 7fa10a800640 1 -- 172.21.15.106:0/1827378856 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa104009ae0 con 0x7fa10c155550 2024-08-17T02:28:16.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.186+0000 7fa10a800640 1 --2- 172.21.15.106:0/1827378856 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa10c155550 0x7fa10c0c5460 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa10402ad60 tx=0x7fa104037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.186+0000 7fa101600640 1 -- 172.21.15.106:0/1827378856 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa104033ac0 con 0x7fa10c155550 2024-08-17T02:28:16.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.186+0000 7fa101600640 1 -- 172.21.15.106:0/1827378856 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa104033c60 con 0x7fa10c155550 2024-08-17T02:28:16.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.186+0000 7fa101600640 1 -- 172.21.15.106:0/1827378856 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10403c410 con 0x7fa10c155550 2024-08-17T02:28:16.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.186+0000 7fa110c00640 1 -- 172.21.15.106:0/1827378856 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa10c0c0a40 con 0x7fa10c155550 2024-08-17T02:28:16.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.186+0000 7fa110c00640 1 -- 172.21.15.106:0/1827378856 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa10c0c49d0 con 0x7fa10c155550 2024-08-17T02:28:16.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.187+0000 7fa110c00640 1 -- 172.21.15.106:0/1827378856 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa10c0c1220 con 0x7fa10c155550 2024-08-17T02:28:16.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.188+0000 7fa101600640 1 -- 172.21.15.106:0/1827378856 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa104039050 con 0x7fa10c155550 2024-08-17T02:28:16.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.189+0000 7fa101600640 1 --2- 172.21.15.106:0/1827378856 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa0ec065150 0x7fa0ec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.189+0000 7fa101600640 1 -- 172.21.15.106:0/1827378856 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa1040a2b70 con 0x7fa10c155550 2024-08-17T02:28:16.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.189+0000 7fa109e00640 1 --2- 172.21.15.106:0/1827378856 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa0ec065150 0x7fa0ec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.190+0000 7fa109e00640 1 --2- 172.21.15.106:0/1827378856 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa0ec065150 0x7fa0ec067600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc0011e0 tx=0x7fa0fc007cc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.192+0000 7fa101600640 1 -- 172.21.15.106:0/1827378856 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa104070c40 con 0x7fa10c155550 2024-08-17T02:28:16.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.370+0000 7fa110c00640 1 -- 172.21.15.106:0/1827378856 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa10c064db0 con 0x7fa10c155550 2024-08-17T02:28:16.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.371+0000 7fa101600640 1 -- 172.21.15.106:0/1827378856 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fa104040090 con 0x7fa10c155550 2024-08-17T02:28:16.372 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:16.372 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:27:52.284039+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:48.547438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:49.671073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:16.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.373+0000 7fa110c00640 1 -- 172.21.15.106:0/1827378856 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa0ec065150 msgr2=0x7fa0ec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.373+0000 7fa110c00640 1 --2- 172.21.15.106:0/1827378856 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa0ec065150 0x7fa0ec067600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc0011e0 tx=0x7fa0fc007cc0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.373+0000 7fa110c00640 1 -- 172.21.15.106:0/1827378856 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa10c155550 msgr2=0x7fa10c0c5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.373+0000 7fa110c00640 1 --2- 172.21.15.106:0/1827378856 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa10c155550 0x7fa10c0c5460 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa10402ad60 tx=0x7fa104037000 comp rx=0 tx=0).stop 2024-08-17T02:28:16.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.373+0000 7fa110c00640 1 -- 172.21.15.106:0/1827378856 shutdown_connections 2024-08-17T02:28:16.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.373+0000 7fa110c00640 1 --2- 172.21.15.106:0/1827378856 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa0ec065150 0x7fa0ec067600 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.373+0000 7fa110c00640 1 --2- 172.21.15.106:0/1827378856 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa10c155550 0x7fa10c0c5460 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.373+0000 7fa110c00640 1 --2- 172.21.15.106:0/1827378856 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa10c155180 0x7fa10c0c3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.373+0000 7fa110c00640 1 --2- 172.21.15.106:0/1827378856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa10c06e080 0x7fa10c1484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.373+0000 7fa110c00640 1 -- 172.21.15.106:0/1827378856 >> 172.21.15.106:0/1827378856 conn(0x7fa10c0cb9b0 msgr2=0x7fa10c0687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:16.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.373+0000 7fa110c00640 1 -- 172.21.15.106:0/1827378856 shutdown_connections 2024-08-17T02:28:16.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.373+0000 7fa110c00640 1 -- 172.21.15.106:0/1827378856 wait complete. 2024-08-17T02:28:16.390 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:37.928826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:48.547438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:49.671073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:28:16.390 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:28:16.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.539+0000 7f17a7200640 1 Processor -- start 2024-08-17T02:28:16.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.539+0000 7f17a7200640 1 -- start start 2024-08-17T02:28:16.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.540+0000 7f17a7200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17a0157e10 0x7f17a00b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.540+0000 7f17a7200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f17a00adec0 0x7f17a015a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.540+0000 7f17a7200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a0157070 con 0x7f17a00b0a80 2024-08-17T02:28:16.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.540+0000 7f17a7200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a00b1390 con 0x7f17a00adec0 2024-08-17T02:28:16.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.540+0000 7f17a7200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a015b410 con 0x7f17a0157e10 2024-08-17T02:28:16.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.540+0000 7f1797400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17a0157e10 0x7f17a00b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.540+0000 7f1797400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17a0157e10 0x7f17a00b0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:46626/0 (socket says 172.21.15.106:46626) 2024-08-17T02:28:16.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.540+0000 7f1797400640 1 -- 172.21.15.106:0/3519925249 learned_addr learned my addr 172.21.15.106:0/3519925249 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:16.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.540+0000 7f17a5200640 1 --2- 172.21.15.106:0/3519925249 >> v2:172.21.15.171:3300/0 conn(0x7f17a00adec0 0x7f17a015a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.541+0000 7f179f400640 1 -- 172.21.15.106:0/3519925249 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642674617 0 0) 0x7f17a0157070 con 0x7f17a00b0a80 2024-08-17T02:28:16.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.541+0000 7f1797400640 1 -- 172.21.15.106:0/3519925249 >> v2:172.21.15.171:3300/0 conn(0x7f17a00adec0 msgr2=0x7f17a015a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:16.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.541+0000 7f1797400640 1 --2- 172.21.15.106:0/3519925249 >> v2:172.21.15.171:3300/0 conn(0x7f17a00adec0 0x7f17a015a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.541+0000 7f1797400640 1 -- 172.21.15.106:0/3519925249 >> v1:172.21.15.171:6789/0 conn(0x7f17a00b0a80 legacy=0x7f17a00ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.541+0000 7f1797400640 1 -- 172.21.15.106:0/3519925249 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a0157330 con 0x7f17a0157e10 2024-08-17T02:28:16.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.542+0000 7f1797400640 1 --2- 172.21.15.106:0/3519925249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17a0157e10 0x7f17a00b0e50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1788009910 tx=0x7f17880091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfd11499effd9476 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.542+0000 7f179f400640 1 -- 172.21.15.106:0/3519925249 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178802adb0 con 0x7f17a0157e10 2024-08-17T02:28:16.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.542+0000 7f179f400640 1 -- 172.21.15.106:0/3519925249 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1788032440 con 0x7f17a0157e10 2024-08-17T02:28:16.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.542+0000 7f179f400640 1 -- 172.21.15.106:0/3519925249 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17880327e0 con 0x7f17a0157e10 2024-08-17T02:28:16.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.543+0000 7f17a7200640 1 -- 172.21.15.106:0/3519925249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17a0157e10 msgr2=0x7f17a00b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.543+0000 7f17a7200640 1 --2- 172.21.15.106:0/3519925249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17a0157e10 0x7f17a00b0e50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1788009910 tx=0x7f17880091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.543+0000 7f17a7200640 1 -- 172.21.15.106:0/3519925249 shutdown_connections 2024-08-17T02:28:16.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.543+0000 7f17a7200640 1 --2- 172.21.15.106:0/3519925249 >> v2:172.21.15.171:3300/0 conn(0x7f17a00adec0 0x7f17a015a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.543+0000 7f17a7200640 1 --2- 172.21.15.106:0/3519925249 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17a0157e10 0x7f17a00b0e50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.543+0000 7f17a7200640 1 -- 172.21.15.106:0/3519925249 >> 172.21.15.106:0/3519925249 conn(0x7f17a0067750 msgr2=0x7f17a00cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:16.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.543+0000 7f17a7200640 1 -- 172.21.15.106:0/3519925249 shutdown_connections 2024-08-17T02:28:16.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.543+0000 7f17a7200640 1 -- 172.21.15.106:0/3519925249 wait complete. 2024-08-17T02:28:16.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.544+0000 7f17a7200640 1 Processor -- start 2024-08-17T02:28:16.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.544+0000 7f17a7200640 1 -- start start 2024-08-17T02:28:16.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.545+0000 7f17a7200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17a00adec0 0x7f17a0138db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.545+0000 7f17a7200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17a00b0a80 0x7f17a014e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.545+0000 7f17a7200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17a0157e10 0x7f17a014eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.545+0000 7f17a7200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a014ff80 con 0x7f17a00adec0 2024-08-17T02:28:16.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.545+0000 7f17a7200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a01392f0 con 0x7f17a00b0a80 2024-08-17T02:28:16.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.545+0000 7f17a7200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a014f0c0 con 0x7f17a0157e10 2024-08-17T02:28:16.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.545+0000 7f179fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17a00adec0 0x7f17a0138db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.546+0000 7f1797400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17a00b0a80 0x7f17a014e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.546+0000 7f17a5200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17a0157e10 0x7f17a014eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.546+0000 7f179fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17a00adec0 0x7f17a0138db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40572/0 (socket says 172.21.15.106:40572) 2024-08-17T02:28:16.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.546+0000 7f179fe00640 1 -- 172.21.15.106:0/777103296 learned_addr learned my addr 172.21.15.106:0/777103296 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:16.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.546+0000 7f1797400640 1 --2- 172.21.15.106:0/777103296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17a00b0a80 0x7f17a014e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:60676/0 (socket says 172.21.15.106:60676) 2024-08-17T02:28:16.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.546+0000 7f1797400640 1 -- 172.21.15.106:0/777103296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17a0157e10 msgr2=0x7f17a014eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.546+0000 7f1797400640 1 --2- 172.21.15.106:0/777103296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17a0157e10 0x7f17a014eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.546+0000 7f1797400640 1 -- 172.21.15.106:0/777103296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17a00adec0 msgr2=0x7f17a0138db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.546+0000 7f1797400640 1 --2- 172.21.15.106:0/777103296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17a00adec0 0x7f17a0138db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.546+0000 7f1797400640 1 -- 172.21.15.106:0/777103296 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1788009450 con 0x7f17a00b0a80 2024-08-17T02:28:16.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.546+0000 7f179fe00640 1 --2- 172.21.15.106:0/777103296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17a00adec0 0x7f17a0138db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:16.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.546+0000 7f1797400640 1 --2- 172.21.15.106:0/777103296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17a00b0a80 0x7f17a014e640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1788031000 tx=0x7f1788032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.546+0000 7f1797e00640 1 -- 172.21.15.106:0/777103296 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1788000d10 con 0x7f17a00b0a80 2024-08-17T02:28:16.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.547+0000 7f1797e00640 1 -- 172.21.15.106:0/777103296 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1788031de0 con 0x7f17a00b0a80 2024-08-17T02:28:16.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.547+0000 7f1797e00640 1 -- 172.21.15.106:0/777103296 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178803d690 con 0x7f17a00b0a80 2024-08-17T02:28:16.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.547+0000 7f17a7200640 1 -- 172.21.15.106:0/777103296 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a014f370 con 0x7f17a00b0a80 2024-08-17T02:28:16.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.547+0000 7f17a7200640 1 -- 172.21.15.106:0/777103296 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a014f930 con 0x7f17a00b0a80 2024-08-17T02:28:16.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.548+0000 7f17a7200640 1 -- 172.21.15.106:0/777103296 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a01500f0 con 0x7f17a00b0a80 2024-08-17T02:28:16.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.548+0000 7f1797e00640 1 -- 172.21.15.106:0/777103296 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1788039040 con 0x7f17a00b0a80 2024-08-17T02:28:16.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.549+0000 7f1797e00640 1 --2- 172.21.15.106:0/777103296 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f177c065150 0x7f177c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.549+0000 7f1797e00640 1 -- 172.21.15.106:0/777103296 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f17880a25a0 con 0x7f17a00b0a80 2024-08-17T02:28:16.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.549+0000 7f179fe00640 1 --2- 172.21.15.106:0/777103296 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f177c065150 0x7f177c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.550+0000 7f179fe00640 1 --2- 172.21.15.106:0/777103296 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f177c065150 0x7f177c067600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f17900011e0 tx=0x7f1790009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.554+0000 7f1797e00640 1 -- 172.21.15.106:0/777103296 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1788070670 con 0x7f17a00b0a80 2024-08-17T02:28:16.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.725+0000 7f17a7200640 1 -- 172.21.15.106:0/777103296 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f17a0064db0 con 0x7f17a00b0a80 2024-08-17T02:28:16.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.726+0000 7f1797e00640 1 -- 172.21.15.106:0/777103296 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1788073c90 con 0x7f17a00b0a80 2024-08-17T02:28:16.728 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-08-17T02:28:16.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.728+0000 7f17a7200640 1 -- 172.21.15.106:0/777103296 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f177c065150 msgr2=0x7f177c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.728+0000 7f17a7200640 1 --2- 172.21.15.106:0/777103296 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f177c065150 0x7f177c067600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f17900011e0 tx=0x7f1790009040 comp rx=0 tx=0).stop 2024-08-17T02:28:16.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.728+0000 7f17a7200640 1 -- 172.21.15.106:0/777103296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17a00b0a80 msgr2=0x7f17a014e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.728+0000 7f17a7200640 1 --2- 172.21.15.106:0/777103296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17a00b0a80 0x7f17a014e640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1788031000 tx=0x7f1788032000 comp rx=0 tx=0).stop 2024-08-17T02:28:16.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.728+0000 7f17a7200640 1 -- 172.21.15.106:0/777103296 shutdown_connections 2024-08-17T02:28:16.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.728+0000 7f17a7200640 1 --2- 172.21.15.106:0/777103296 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17a0157e10 0x7f17a014eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.728+0000 7f17a7200640 1 --2- 172.21.15.106:0/777103296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17a00b0a80 0x7f17a014e640 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.728+0000 7f17a7200640 1 --2- 172.21.15.106:0/777103296 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f177c065150 0x7f177c067600 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.728+0000 7f17a7200640 1 --2- 172.21.15.106:0/777103296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17a00adec0 0x7f17a0138db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.728+0000 7f17a7200640 1 -- 172.21.15.106:0/777103296 >> 172.21.15.106:0/777103296 conn(0x7f17a0067750 msgr2=0x7f17a00cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:16.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.728+0000 7f17a7200640 1 -- 172.21.15.106:0/777103296 shutdown_connections 2024-08-17T02:28:16.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.728+0000 7f17a7200640 1 -- 172.21.15.106:0/777103296 wait complete. 2024-08-17T02:28:16.745 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:28:16.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.893+0000 7f78ea400640 1 Processor -- start 2024-08-17T02:28:16.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.893+0000 7f78ea400640 1 -- start start 2024-08-17T02:28:16.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.894+0000 7f78ea400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78e4155a80 0x7f78e406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.895+0000 7f78ea400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f78e40c92e0 0x7f78e40aea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.895+0000 7f78ea400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78e41598f0 con 0x7f78e40c7db0 2024-08-17T02:28:16.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.895+0000 7f78ea400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78e4159bd0 con 0x7f78e40c92e0 2024-08-17T02:28:16.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.895+0000 7f78ea400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e4159eb0 con 0x7f78e4155a80 2024-08-17T02:28:16.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.895+0000 7f78e2a00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f78e40c7db0 0x7f78e40c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39340/0 (socket says 172.21.15.106:39340) 2024-08-17T02:28:16.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.895+0000 7f78e2a00640 1 -- 172.21.15.106:0/2420200149 learned_addr learned my addr 172.21.15.106:0/2420200149 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:16.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.895+0000 7f78e3400640 1 --2- 172.21.15.106:0/2420200149 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78e4155a80 0x7f78e406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.895+0000 7f78e3e00640 1 --2- 172.21.15.106:0/2420200149 >> v2:172.21.15.171:3300/0 conn(0x7f78e40c92e0 0x7f78e40aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.895+0000 7f78e2000640 1 -- 172.21.15.106:0/2420200149 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187713168 0 0) 0x7f78e41598f0 con 0x7f78e40c7db0 2024-08-17T02:28:16.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.895+0000 7f78e2000640 1 -- 172.21.15.106:0/2420200149 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78c80034e0 con 0x7f78e40c7db0 2024-08-17T02:28:16.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.896+0000 7f78e3400640 1 -- 172.21.15.106:0/2420200149 >> v2:172.21.15.171:3300/0 conn(0x7f78e40c92e0 msgr2=0x7f78e40aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:16.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.896+0000 7f78e3400640 1 --2- 172.21.15.106:0/2420200149 >> v2:172.21.15.171:3300/0 conn(0x7f78e40c92e0 0x7f78e40aea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.896+0000 7f78e3400640 1 -- 172.21.15.106:0/2420200149 >> v1:172.21.15.106:6789/0 conn(0x7f78e40c7db0 legacy=0x7f78e40c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.896+0000 7f78e3400640 1 -- 172.21.15.106:0/2420200149 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e415a190 con 0x7f78e4155a80 2024-08-17T02:28:16.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.897+0000 7f78e3400640 1 --2- 172.21.15.106:0/2420200149 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78e4155a80 0x7f78e406dc00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f78d4009850 tx=0x7f78d40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27b195c1d8f7fa72 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.897+0000 7f78e2000640 1 -- 172.21.15.106:0/2420200149 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d402ae10 con 0x7f78e4155a80 2024-08-17T02:28:16.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.897+0000 7f78e2000640 1 -- 172.21.15.106:0/2420200149 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d4032440 con 0x7f78e4155a80 2024-08-17T02:28:16.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.897+0000 7f78e2000640 1 -- 172.21.15.106:0/2420200149 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d4032820 con 0x7f78e4155a80 2024-08-17T02:28:16.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.897+0000 7f78ea400640 1 -- 172.21.15.106:0/2420200149 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78e4155a80 msgr2=0x7f78e406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.897+0000 7f78ea400640 1 --2- 172.21.15.106:0/2420200149 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78e4155a80 0x7f78e406dc00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f78d4009850 tx=0x7f78d40090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.897+0000 7f78ea400640 1 -- 172.21.15.106:0/2420200149 shutdown_connections 2024-08-17T02:28:16.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.897+0000 7f78ea400640 1 --2- 172.21.15.106:0/2420200149 >> v2:172.21.15.171:3300/0 conn(0x7f78e40c92e0 0x7f78e40aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.897+0000 7f78ea400640 1 --2- 172.21.15.106:0/2420200149 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78e4155a80 0x7f78e406dc00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.897+0000 7f78ea400640 1 -- 172.21.15.106:0/2420200149 >> 172.21.15.106:0/2420200149 conn(0x7f78e4067750 msgr2=0x7f78e40c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:16.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.898+0000 7f78ea400640 1 -- 172.21.15.106:0/2420200149 shutdown_connections 2024-08-17T02:28:16.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.898+0000 7f78ea400640 1 -- 172.21.15.106:0/2420200149 wait complete. 2024-08-17T02:28:16.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.899+0000 7f78ea400640 1 Processor -- start 2024-08-17T02:28:16.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.899+0000 7f78ea400640 1 -- start start 2024-08-17T02:28:16.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.900+0000 7f78ea400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78e40c7db0 0x7f78e4157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.900+0000 7f78ea400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78e40c92e0 0x7f78e4145c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.900+0000 7f78ea400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78e4155a80 0x7f78e4146180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.900+0000 7f78ea400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e41474b0 con 0x7f78e40c7db0 2024-08-17T02:28:16.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.900+0000 7f78ea400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e41489d0 con 0x7f78e4155a80 2024-08-17T02:28:16.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.900+0000 7f78ea400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e40a5570 con 0x7f78e40c92e0 2024-08-17T02:28:16.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.900+0000 7f78e3400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78e40c7db0 0x7f78e4157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.900+0000 7f78e3400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78e40c7db0 0x7f78e4157bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40578/0 (socket says 172.21.15.106:40578) 2024-08-17T02:28:16.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.900+0000 7f78e3400640 1 -- 172.21.15.106:0/3973707564 learned_addr learned my addr 172.21.15.106:0/3973707564 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:16.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.900+0000 7f78e3e00640 1 --2- 172.21.15.106:0/3973707564 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78e4155a80 0x7f78e4146180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.900+0000 7f78e2a00640 1 --2- 172.21.15.106:0/3973707564 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78e40c92e0 0x7f78e4145c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.900+0000 7f78e3400640 1 -- 172.21.15.106:0/3973707564 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78e40c92e0 msgr2=0x7f78e4145c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.900+0000 7f78e3400640 1 --2- 172.21.15.106:0/3973707564 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78e40c92e0 0x7f78e4145c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.900+0000 7f78e3400640 1 -- 172.21.15.106:0/3973707564 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78e4155a80 msgr2=0x7f78e4146180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:16.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.900+0000 7f78e3400640 1 --2- 172.21.15.106:0/3973707564 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78e4155a80 0x7f78e4146180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:16.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.901+0000 7f78e3400640 1 -- 172.21.15.106:0/3973707564 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d4009390 con 0x7f78e40c7db0 2024-08-17T02:28:16.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.901+0000 7f78e2a00640 1 --2- 172.21.15.106:0/3973707564 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78e40c92e0 0x7f78e4145c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:16.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.901+0000 7f78e3400640 1 --2- 172.21.15.106:0/3973707564 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78e40c7db0 0x7f78e4157bc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f78d4035040 tx=0x7f78d4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.901+0000 7f78daa00640 1 -- 172.21.15.106:0/3973707564 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d4031ca0 con 0x7f78e40c7db0 2024-08-17T02:28:16.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.901+0000 7f78daa00640 1 -- 172.21.15.106:0/3973707564 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d4031e00 con 0x7f78e40c7db0 2024-08-17T02:28:16.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.901+0000 7f78daa00640 1 -- 172.21.15.106:0/3973707564 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d403e6a0 con 0x7f78e40c7db0 2024-08-17T02:28:16.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.901+0000 7f78ea400640 1 -- 172.21.15.106:0/3973707564 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e40a5850 con 0x7f78e40c7db0 2024-08-17T02:28:16.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.901+0000 7f78ea400640 1 -- 172.21.15.106:0/3973707564 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e40a5e10 con 0x7f78e40c7db0 2024-08-17T02:28:16.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.902+0000 7f78ea400640 1 -- 172.21.15.106:0/3973707564 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e40a6000 con 0x7f78e40c7db0 2024-08-17T02:28:16.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.903+0000 7f78daa00640 1 -- 172.21.15.106:0/3973707564 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f78d403c400 con 0x7f78e40c7db0 2024-08-17T02:28:16.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.904+0000 7f78daa00640 1 --2- 172.21.15.106:0/3973707564 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f78c4065150 0x7f78c4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:16.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.904+0000 7f78daa00640 1 -- 172.21.15.106:0/3973707564 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f78d40a28f0 con 0x7f78e40c7db0 2024-08-17T02:28:16.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.904+0000 7f78e2a00640 1 --2- 172.21.15.106:0/3973707564 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f78c4065150 0x7f78c4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:16.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.905+0000 7f78e2a00640 1 --2- 172.21.15.106:0/3973707564 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f78c4065150 0x7f78c4067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f78e406a8e0 tx=0x7f78d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:16.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:16.908+0000 7f78daa00640 1 -- 172.21.15.106:0/3973707564 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f78d40709c0 con 0x7f78e40c7db0 2024-08-17T02:28:17.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.079+0000 7f78ea400640 1 -- 172.21.15.106:0/3973707564 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f78e4071050 con 0x7f78e40c7db0 2024-08-17T02:28:17.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.080+0000 7f78daa00640 1 -- 172.21.15.106:0/3973707564 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f78d40430a0 con 0x7f78e40c7db0 2024-08-17T02:28:17.081 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-08-17T02:28:17.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.082+0000 7f78ea400640 1 -- 172.21.15.106:0/3973707564 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f78c4065150 msgr2=0x7f78c4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.082+0000 7f78ea400640 1 --2- 172.21.15.106:0/3973707564 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f78c4065150 0x7f78c4067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f78e406a8e0 tx=0x7f78d0009040 comp rx=0 tx=0).stop 2024-08-17T02:28:17.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.082+0000 7f78ea400640 1 -- 172.21.15.106:0/3973707564 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78e40c7db0 msgr2=0x7f78e4157bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.082+0000 7f78ea400640 1 --2- 172.21.15.106:0/3973707564 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78e40c7db0 0x7f78e4157bc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f78d4035040 tx=0x7f78d4032000 comp rx=0 tx=0).stop 2024-08-17T02:28:17.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.082+0000 7f78ea400640 1 -- 172.21.15.106:0/3973707564 shutdown_connections 2024-08-17T02:28:17.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.082+0000 7f78ea400640 1 --2- 172.21.15.106:0/3973707564 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78e4155a80 0x7f78e4146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.082+0000 7f78ea400640 1 --2- 172.21.15.106:0/3973707564 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f78e40c92e0 0x7f78e4145c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.082+0000 7f78ea400640 1 --2- 172.21.15.106:0/3973707564 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f78c4065150 0x7f78c4067600 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.082+0000 7f78ea400640 1 --2- 172.21.15.106:0/3973707564 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78e40c7db0 0x7f78e4157bc0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.082+0000 7f78ea400640 1 -- 172.21.15.106:0/3973707564 >> 172.21.15.106:0/3973707564 conn(0x7f78e4067750 msgr2=0x7f78e4068900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:17.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.082+0000 7f78ea400640 1 -- 172.21.15.106:0/3973707564 shutdown_connections 2024-08-17T02:28:17.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.082+0000 7f78ea400640 1 -- 172.21.15.106:0/3973707564 wait complete. 2024-08-17T02:28:17.098 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:28:17.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.247+0000 7f6968e00640 1 Processor -- start 2024-08-17T02:28:17.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.247+0000 7f6968e00640 1 -- start start 2024-08-17T02:28:17.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.248+0000 7f6968e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6964156c50 0x7f69640c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.248+0000 7f6968e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f69640adcf0 0x7f69640ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.248+0000 7f6968e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69640ab130 con 0x7f69640abb00 2024-08-17T02:28:17.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.248+0000 7f6968e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69640ae5a0 con 0x7f6964156c50 2024-08-17T02:28:17.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.248+0000 7f6968e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69640ae2c0 con 0x7f69640adcf0 2024-08-17T02:28:17.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.248+0000 7f6961e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6964156c50 0x7f69640c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.248+0000 7f6961e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6964156c50 0x7f69640c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40594/0 (socket says 172.21.15.106:40594) 2024-08-17T02:28:17.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.248+0000 7f6961e00640 1 -- 172.21.15.106:0/2579317997 learned_addr learned my addr 172.21.15.106:0/2579317997 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:17.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.249+0000 7f695be00640 1 --2- 172.21.15.106:0/2579317997 >> v2:172.21.15.171:3300/0 conn(0x7f69640adcf0 0x7f69640ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.249+0000 7f6961e00640 1 -- 172.21.15.106:0/2579317997 >> v2:172.21.15.171:3300/0 conn(0x7f69640adcf0 msgr2=0x7f69640ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:17.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.249+0000 7f6961e00640 1 --2- 172.21.15.106:0/2579317997 >> v2:172.21.15.171:3300/0 conn(0x7f69640adcf0 0x7f69640ab5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.249+0000 7f6961e00640 1 -- 172.21.15.106:0/2579317997 >> v1:172.21.15.171:6789/0 conn(0x7f69640abb00 legacy=0x7f69640c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:17.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.249+0000 7f6961e00640 1 -- 172.21.15.106:0/2579317997 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69640aaae0 con 0x7f6964156c50 2024-08-17T02:28:17.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.249+0000 7f695be00640 1 --2- 172.21.15.106:0/2579317997 >> v2:172.21.15.171:3300/0 conn(0x7f69640adcf0 0x7f69640ab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:17.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.250+0000 7f6961e00640 1 --2- 172.21.15.106:0/2579317997 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6964156c50 0x7f69640c7cf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f696406f0c0 tx=0x7f69540091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654332e428791205 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:17.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.250+0000 7f6961400640 1 -- 172.21.15.106:0/2579317997 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695402acc0 con 0x7f6964156c50 2024-08-17T02:28:17.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.250+0000 7f6961400640 1 -- 172.21.15.106:0/2579317997 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695402ae20 con 0x7f6964156c50 2024-08-17T02:28:17.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.250+0000 7f6961400640 1 -- 172.21.15.106:0/2579317997 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6954032670 con 0x7f6964156c50 2024-08-17T02:28:17.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.251+0000 7f6968e00640 1 -- 172.21.15.106:0/2579317997 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6964156c50 msgr2=0x7f69640c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.251+0000 7f6968e00640 1 --2- 172.21.15.106:0/2579317997 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6964156c50 0x7f69640c7cf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f696406f0c0 tx=0x7f69540091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.251+0000 7f6968e00640 1 -- 172.21.15.106:0/2579317997 shutdown_connections 2024-08-17T02:28:17.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.251+0000 7f6968e00640 1 --2- 172.21.15.106:0/2579317997 >> v2:172.21.15.171:3300/0 conn(0x7f69640adcf0 0x7f69640ab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.251+0000 7f6968e00640 1 --2- 172.21.15.106:0/2579317997 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6964156c50 0x7f69640c7cf0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.251+0000 7f6968e00640 1 -- 172.21.15.106:0/2579317997 >> 172.21.15.106:0/2579317997 conn(0x7f6964067750 msgr2=0x7f69640c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:17.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.251+0000 7f6968e00640 1 -- 172.21.15.106:0/2579317997 shutdown_connections 2024-08-17T02:28:17.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.251+0000 7f6968e00640 1 -- 172.21.15.106:0/2579317997 wait complete. 2024-08-17T02:28:17.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.252+0000 7f6968e00640 1 Processor -- start 2024-08-17T02:28:17.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.252+0000 7f6968e00640 1 -- start start 2024-08-17T02:28:17.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.253+0000 7f6968e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69640abb00 0x7f6964152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.253+0000 7f6968e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69640adcf0 0x7f6964157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.253+0000 7f6968e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6964156c50 0x7f6964069ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.253+0000 7f6968e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6964154ba0 con 0x7f69640abb00 2024-08-17T02:28:17.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.253+0000 7f6968e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69641579a0 con 0x7f6964156c50 2024-08-17T02:28:17.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.253+0000 7f6968e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6964154270 con 0x7f69640adcf0 2024-08-17T02:28:17.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.253+0000 7f6961e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69640abb00 0x7f6964152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.253+0000 7f6961e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69640abb00 0x7f6964152340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40600/0 (socket says 172.21.15.106:40600) 2024-08-17T02:28:17.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.253+0000 7f6961e00640 1 -- 172.21.15.106:0/3983526780 learned_addr learned my addr 172.21.15.106:0/3983526780 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:17.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.254+0000 7f695be00640 1 --2- 172.21.15.106:0/3983526780 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69640adcf0 0x7f6964157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.254+0000 7f6961e00640 1 -- 172.21.15.106:0/3983526780 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69640adcf0 msgr2=0x7f6964157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.254+0000 7f6962800640 1 --2- 172.21.15.106:0/3983526780 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6964156c50 0x7f6964069ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.254+0000 7f6961e00640 1 --2- 172.21.15.106:0/3983526780 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69640adcf0 0x7f6964157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.254+0000 7f6961e00640 1 -- 172.21.15.106:0/3983526780 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6964156c50 msgr2=0x7f6964069ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.254+0000 7f6961e00640 1 --2- 172.21.15.106:0/3983526780 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6964156c50 0x7f6964069ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.254+0000 7f6961e00640 1 -- 172.21.15.106:0/3983526780 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6954009450 con 0x7f69640abb00 2024-08-17T02:28:17.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.254+0000 7f6962800640 1 --2- 172.21.15.106:0/3983526780 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6964156c50 0x7f6964069ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:17.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.254+0000 7f695be00640 1 --2- 172.21.15.106:0/3983526780 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69640adcf0 0x7f6964157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:17.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.254+0000 7f6961e00640 1 --2- 172.21.15.106:0/3983526780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69640abb00 0x7f6964152340 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6954035040 tx=0x7f6954032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:17.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.254+0000 7f6959600640 1 -- 172.21.15.106:0/3983526780 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695403d700 con 0x7f69640abb00 2024-08-17T02:28:17.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.254+0000 7f6959600640 1 -- 172.21.15.106:0/3983526780 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695403d880 con 0x7f69640abb00 2024-08-17T02:28:17.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.254+0000 7f6968e00640 1 -- 172.21.15.106:0/3983526780 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6964154550 con 0x7f69640abb00 2024-08-17T02:28:17.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.254+0000 7f6959600640 1 -- 172.21.15.106:0/3983526780 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695403dc40 con 0x7f69640abb00 2024-08-17T02:28:17.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.254+0000 7f6968e00640 1 -- 172.21.15.106:0/3983526780 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69641576b0 con 0x7f69640abb00 2024-08-17T02:28:17.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.255+0000 7f6968e00640 1 -- 172.21.15.106:0/3983526780 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6964071050 con 0x7f69640abb00 2024-08-17T02:28:17.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.256+0000 7f6959600640 1 -- 172.21.15.106:0/3983526780 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6954039040 con 0x7f69640abb00 2024-08-17T02:28:17.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.257+0000 7f6959600640 1 --2- 172.21.15.106:0/3983526780 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6940065150 0x7f6940067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.257+0000 7f6959600640 1 -- 172.21.15.106:0/3983526780 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f69540a20d0 con 0x7f69640abb00 2024-08-17T02:28:17.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.257+0000 7f695be00640 1 --2- 172.21.15.106:0/3983526780 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6940065150 0x7f6940067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.258+0000 7f695be00640 1 --2- 172.21.15.106:0/3983526780 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6940065150 0x7f6940067600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f69640cb4a0 tx=0x7f694c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:17.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.261+0000 7f6959600640 1 -- 172.21.15.106:0/3983526780 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f69540700f0 con 0x7f69640abb00 2024-08-17T02:28:17.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.432+0000 7f6968e00640 1 -- 172.21.15.106:0/3983526780 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f696414cdd0 con 0x7f69640abb00 2024-08-17T02:28:17.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.432+0000 7f6959600640 1 -- 172.21.15.106:0/3983526780 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6954073710 con 0x7f69640abb00 2024-08-17T02:28:17.434 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-08-17T02:28:17.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.434+0000 7f6968e00640 1 -- 172.21.15.106:0/3983526780 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6940065150 msgr2=0x7f6940067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.434+0000 7f6968e00640 1 --2- 172.21.15.106:0/3983526780 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6940065150 0x7f6940067600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f69640cb4a0 tx=0x7f694c008040 comp rx=0 tx=0).stop 2024-08-17T02:28:17.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.435+0000 7f6968e00640 1 -- 172.21.15.106:0/3983526780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69640abb00 msgr2=0x7f6964152340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.435+0000 7f6968e00640 1 --2- 172.21.15.106:0/3983526780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69640abb00 0x7f6964152340 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6954035040 tx=0x7f6954032000 comp rx=0 tx=0).stop 2024-08-17T02:28:17.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.435+0000 7f6968e00640 1 -- 172.21.15.106:0/3983526780 shutdown_connections 2024-08-17T02:28:17.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.435+0000 7f6968e00640 1 --2- 172.21.15.106:0/3983526780 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6964156c50 0x7f6964069ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.435+0000 7f6968e00640 1 --2- 172.21.15.106:0/3983526780 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69640adcf0 0x7f6964157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.435+0000 7f6968e00640 1 --2- 172.21.15.106:0/3983526780 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6940065150 0x7f6940067600 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.435+0000 7f6968e00640 1 --2- 172.21.15.106:0/3983526780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69640abb00 0x7f6964152340 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.435+0000 7f6968e00640 1 -- 172.21.15.106:0/3983526780 >> 172.21.15.106:0/3983526780 conn(0x7f6964067750 msgr2=0x7f69640aa280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:17.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.435+0000 7f6968e00640 1 -- 172.21.15.106:0/3983526780 shutdown_connections 2024-08-17T02:28:17.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.435+0000 7f6968e00640 1 -- 172.21.15.106:0/3983526780 wait complete. 2024-08-17T02:28:17.451 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:17.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.600+0000 7f302dc00640 1 Processor -- start 2024-08-17T02:28:17.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.601+0000 7f302dc00640 1 -- start start 2024-08-17T02:28:17.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.602+0000 7f302dc00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f30280d0770 0x7f30281633e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.602+0000 7f302dc00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30280cef60 con 0x7f3028158ed0 2024-08-17T02:28:17.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.602+0000 7f302dc00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30280cf200 con 0x7f30280ca830 2024-08-17T02:28:17.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.602+0000 7f302dc00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30280cf4c0 con 0x7f30280d0770 2024-08-17T02:28:17.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.602+0000 7f302d200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f30280d0770 0x7f30281633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.602+0000 7f302d200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f30280d0770 0x7f30281633e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40606/0 (socket says 172.21.15.106:40606) 2024-08-17T02:28:17.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.602+0000 7f302d200640 1 -- 172.21.15.106:0/489263908 learned_addr learned my addr 172.21.15.106:0/489263908 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:17.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.602+0000 7f302d200640 1 -- 172.21.15.106:0/489263908 >> v1:172.21.15.171:6789/0 conn(0x7f30280ca830 legacy=0x7f30280cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.602+0000 7f302d200640 1 -- 172.21.15.106:0/489263908 >> v1:172.21.15.106:6789/0 conn(0x7f3028158ed0 legacy=0x7f30280ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.602+0000 7f302d200640 1 -- 172.21.15.106:0/489263908 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30280cf7a0 con 0x7f30280d0770 2024-08-17T02:28:17.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.603+0000 7f302d200640 1 --2- 172.21.15.106:0/489263908 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30280d0770 0x7f30281633e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3020009910 tx=0x7f30200091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00cc0b38a4ee3df server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:17.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.604+0000 7f3026a00640 1 -- 172.21.15.106:0/489263908 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3020032440 con 0x7f30280d0770 2024-08-17T02:28:17.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.604+0000 7f3026a00640 1 -- 172.21.15.106:0/489263908 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30200325a0 con 0x7f30280d0770 2024-08-17T02:28:17.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.604+0000 7f3026a00640 1 -- 172.21.15.106:0/489263908 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3020032980 con 0x7f30280d0770 2024-08-17T02:28:17.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.604+0000 7f302dc00640 1 -- 172.21.15.106:0/489263908 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30280d0770 msgr2=0x7f30281633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.604+0000 7f302dc00640 1 --2- 172.21.15.106:0/489263908 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30280d0770 0x7f30281633e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3020009910 tx=0x7f30200091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.604+0000 7f302dc00640 1 -- 172.21.15.106:0/489263908 shutdown_connections 2024-08-17T02:28:17.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.604+0000 7f302dc00640 1 --2- 172.21.15.106:0/489263908 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30280d0770 0x7f30281633e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.604+0000 7f302dc00640 1 -- 172.21.15.106:0/489263908 >> 172.21.15.106:0/489263908 conn(0x7f302806eb90 msgr2=0x7f30280cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:17.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.604+0000 7f302dc00640 1 -- 172.21.15.106:0/489263908 shutdown_connections 2024-08-17T02:28:17.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.604+0000 7f302dc00640 1 -- 172.21.15.106:0/489263908 wait complete. 2024-08-17T02:28:17.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.606+0000 7f302dc00640 1 Processor -- start 2024-08-17T02:28:17.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.606+0000 7f302dc00640 1 -- start start 2024-08-17T02:28:17.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.607+0000 7f302dc00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30280ca830 0x7f3028152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.607+0000 7f302dc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30280d0770 0x7f3028067a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.607+0000 7f302dc00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3028158ed0 0x7f3028067fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.607+0000 7f302dc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3028169e30 con 0x7f30280d0770 2024-08-17T02:28:17.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.607+0000 7f302dc00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3028152650 con 0x7f3028158ed0 2024-08-17T02:28:17.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.607+0000 7f302dc00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302809c620 con 0x7f30280ca830 2024-08-17T02:28:17.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.607+0000 7f3027400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30280d0770 0x7f3028067a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.607+0000 7f3027400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30280d0770 0x7f3028067a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40622/0 (socket says 172.21.15.106:40622) 2024-08-17T02:28:17.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.607+0000 7f3027400640 1 -- 172.21.15.106:0/3239825392 learned_addr learned my addr 172.21.15.106:0/3239825392 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:17.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.607+0000 7f302d200640 1 --2- 172.21.15.106:0/3239825392 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3028158ed0 0x7f3028067fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.607+0000 7f3027e00640 1 --2- 172.21.15.106:0/3239825392 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30280ca830 0x7f3028152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.607+0000 7f3027400640 1 -- 172.21.15.106:0/3239825392 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30280ca830 msgr2=0x7f3028152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.607+0000 7f3027400640 1 --2- 172.21.15.106:0/3239825392 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30280ca830 0x7f3028152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.607+0000 7f3027400640 1 -- 172.21.15.106:0/3239825392 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3028158ed0 msgr2=0x7f3028067fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.607+0000 7f3027400640 1 --2- 172.21.15.106:0/3239825392 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3028158ed0 0x7f3028067fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.607+0000 7f3027400640 1 -- 172.21.15.106:0/3239825392 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3020009450 con 0x7f30280d0770 2024-08-17T02:28:17.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.608+0000 7f3027400640 1 --2- 172.21.15.106:0/3239825392 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30280d0770 0x7f3028067a70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f301400c590 tx=0x7f3014007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:17.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.608+0000 7f301f400640 1 -- 172.21.15.106:0/3239825392 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3014011590 con 0x7f30280d0770 2024-08-17T02:28:17.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.608+0000 7f301f400640 1 -- 172.21.15.106:0/3239825392 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3014011710 con 0x7f30280d0770 2024-08-17T02:28:17.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.608+0000 7f301f400640 1 -- 172.21.15.106:0/3239825392 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3014011ad0 con 0x7f30280d0770 2024-08-17T02:28:17.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.608+0000 7f302dc00640 1 -- 172.21.15.106:0/3239825392 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f302809c900 con 0x7f30280d0770 2024-08-17T02:28:17.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.608+0000 7f302dc00640 1 -- 172.21.15.106:0/3239825392 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f302809cec0 con 0x7f30280d0770 2024-08-17T02:28:17.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.609+0000 7f302dc00640 1 -- 172.21.15.106:0/3239825392 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3028169fa0 con 0x7f30280d0770 2024-08-17T02:28:17.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.610+0000 7f301f400640 1 -- 172.21.15.106:0/3239825392 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f301401b3b0 con 0x7f30280d0770 2024-08-17T02:28:17.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.611+0000 7f301f400640 1 --2- 172.21.15.106:0/3239825392 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f3008065150 0x7f3008067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.611+0000 7f301f400640 1 -- 172.21.15.106:0/3239825392 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3014081990 con 0x7f30280d0770 2024-08-17T02:28:17.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.611+0000 7f3027e00640 1 --2- 172.21.15.106:0/3239825392 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f3008065150 0x7f3008067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.612+0000 7f3027e00640 1 --2- 172.21.15.106:0/3239825392 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f3008065150 0x7f3008067600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f30280cd540 tx=0x7f3018009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:17.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.615+0000 7f301f400640 1 -- 172.21.15.106:0/3239825392 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f301404fa60 con 0x7f30280d0770 2024-08-17T02:28:17.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.788+0000 7f302dc00640 1 -- 172.21.15.106:0/3239825392 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3028071050 con 0x7f30280d0770 2024-08-17T02:28:17.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.788+0000 7f301f400640 1 -- 172.21.15.106:0/3239825392 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f3014017070 con 0x7f30280d0770 2024-08-17T02:28:17.790 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:17.790 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:27:52.284039+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:48.547438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:49.671073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:17.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.790+0000 7f302dc00640 1 -- 172.21.15.106:0/3239825392 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f3008065150 msgr2=0x7f3008067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.790+0000 7f302dc00640 1 --2- 172.21.15.106:0/3239825392 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f3008065150 0x7f3008067600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f30280cd540 tx=0x7f3018009040 comp rx=0 tx=0).stop 2024-08-17T02:28:17.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.790+0000 7f302dc00640 1 -- 172.21.15.106:0/3239825392 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30280d0770 msgr2=0x7f3028067a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.790+0000 7f302dc00640 1 --2- 172.21.15.106:0/3239825392 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30280d0770 0x7f3028067a70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f301400c590 tx=0x7f3014007ec0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.791+0000 7f302dc00640 1 -- 172.21.15.106:0/3239825392 shutdown_connections 2024-08-17T02:28:17.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.791+0000 7f302dc00640 1 --2- 172.21.15.106:0/3239825392 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3028158ed0 0x7f3028067fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.791+0000 7f302dc00640 1 --2- 172.21.15.106:0/3239825392 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f3008065150 0x7f3008067600 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.791+0000 7f302dc00640 1 --2- 172.21.15.106:0/3239825392 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30280d0770 0x7f3028067a70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.791+0000 7f302dc00640 1 --2- 172.21.15.106:0/3239825392 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30280ca830 0x7f3028152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.791+0000 7f302dc00640 1 -- 172.21.15.106:0/3239825392 >> 172.21.15.106:0/3239825392 conn(0x7f302806eb90 msgr2=0x7f30280c8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:17.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.791+0000 7f302dc00640 1 -- 172.21.15.106:0/3239825392 shutdown_connections 2024-08-17T02:28:17.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.791+0000 7f302dc00640 1 -- 172.21.15.106:0/3239825392 wait complete. 2024-08-17T02:28:17.807 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:37.928826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:48.547438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:49.671073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:28:17.808 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:28:17.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.958+0000 7fb3c5400640 1 Processor -- start 2024-08-17T02:28:17.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.959+0000 7fb3c5400640 1 -- start start 2024-08-17T02:28:17.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.961+0000 7fb3c5400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb3c006df00 0x7fb3c006e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.961+0000 7fb3c5400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb3c015a0e0 0x7fb3c00aa900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.961+0000 7fb3c5400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c00af5f0 con 0x7fb3c00aae40 2024-08-17T02:28:17.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.961+0000 7fb3c5400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c0159600 con 0x7fb3c015a0e0 2024-08-17T02:28:17.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.961+0000 7fb3c5400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c01598e0 con 0x7fb3c006df00 2024-08-17T02:28:17.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.961+0000 7fb3b7400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb3c015a0e0 0x7fb3c00aa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.961+0000 7fb3b7400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb3c015a0e0 0x7fb3c00aa900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40624/0 (socket says 172.21.15.106:40624) 2024-08-17T02:28:17.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.961+0000 7fb3b7400640 1 -- 172.21.15.106:0/4025211635 learned_addr learned my addr 172.21.15.106:0/4025211635 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:17.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.961+0000 7fb3bfe00640 1 --2- 172.21.15.106:0/4025211635 >> v2:172.21.15.171:3300/0 conn(0x7fb3c006df00 0x7fb3c006e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.961+0000 7fb3b7400640 1 -- 172.21.15.106:0/4025211635 >> v2:172.21.15.171:3300/0 conn(0x7fb3c006df00 msgr2=0x7fb3c006e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:17.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.961+0000 7fb3b7400640 1 --2- 172.21.15.106:0/4025211635 >> v2:172.21.15.171:3300/0 conn(0x7fb3c006df00 0x7fb3c006e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.961+0000 7fb3b7400640 1 -- 172.21.15.106:0/4025211635 >> v1:172.21.15.171:6789/0 conn(0x7fb3c00aae40 legacy=0x7fb3c00ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.961+0000 7fb3b7400640 1 -- 172.21.15.106:0/4025211635 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c0159bc0 con 0x7fb3c015a0e0 2024-08-17T02:28:17.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.962+0000 7fb3b7400640 1 --2- 172.21.15.106:0/4025211635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3c015a0e0 0x7fb3c00aa900 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0060670 tx=0x7fb3a80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ace7f586b068b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:17.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.962+0000 7fb3bf400640 1 -- 172.21.15.106:0/4025211635 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a802ae80 con 0x7fb3c015a0e0 2024-08-17T02:28:17.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.962+0000 7fb3bf400640 1 -- 172.21.15.106:0/4025211635 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a8032440 con 0x7fb3c015a0e0 2024-08-17T02:28:17.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.962+0000 7fb3bf400640 1 -- 172.21.15.106:0/4025211635 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8032800 con 0x7fb3c015a0e0 2024-08-17T02:28:17.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.962+0000 7fb3c5400640 1 -- 172.21.15.106:0/4025211635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3c015a0e0 msgr2=0x7fb3c00aa900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.962+0000 7fb3c5400640 1 --2- 172.21.15.106:0/4025211635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3c015a0e0 0x7fb3c00aa900 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0060670 tx=0x7fb3a80091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.962+0000 7fb3c5400640 1 -- 172.21.15.106:0/4025211635 shutdown_connections 2024-08-17T02:28:17.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.962+0000 7fb3c5400640 1 --2- 172.21.15.106:0/4025211635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3c015a0e0 0x7fb3c00aa900 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.962+0000 7fb3c5400640 1 --2- 172.21.15.106:0/4025211635 >> v2:172.21.15.171:3300/0 conn(0x7fb3c006df00 0x7fb3c006e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.962+0000 7fb3c5400640 1 -- 172.21.15.106:0/4025211635 >> 172.21.15.106:0/4025211635 conn(0x7fb3c0067750 msgr2=0x7fb3c006c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:17.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.963+0000 7fb3c5400640 1 -- 172.21.15.106:0/4025211635 shutdown_connections 2024-08-17T02:28:17.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.963+0000 7fb3c5400640 1 -- 172.21.15.106:0/4025211635 wait complete. 2024-08-17T02:28:17.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.964+0000 7fb3c5400640 1 Processor -- start 2024-08-17T02:28:17.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.964+0000 7fb3c5400640 1 -- start start 2024-08-17T02:28:17.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.965+0000 7fb3c5400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3c006df00 0x7fb3c014a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.965+0000 7fb3c5400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3c00aae40 0x7fb3c0158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.965+0000 7fb3c5400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3c015a0e0 0x7fb3c014a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.965+0000 7fb3c5400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c0068a50 con 0x7fb3c006df00 2024-08-17T02:28:17.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.965+0000 7fb3c5400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c0156000 con 0x7fb3c00aae40 2024-08-17T02:28:17.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.965+0000 7fb3c5400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c01562e0 con 0x7fb3c015a0e0 2024-08-17T02:28:17.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.965+0000 7fb3bfe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3c006df00 0x7fb3c014a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.965+0000 7fb3bfe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3c006df00 0x7fb3c014a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40634/0 (socket says 172.21.15.106:40634) 2024-08-17T02:28:17.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.965+0000 7fb3bfe00640 1 -- 172.21.15.106:0/1389855476 learned_addr learned my addr 172.21.15.106:0/1389855476 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:17.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.966+0000 7fb3c4a00640 1 --2- 172.21.15.106:0/1389855476 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3c015a0e0 0x7fb3c014a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.965+0000 7fb3b7400640 1 --2- 172.21.15.106:0/1389855476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3c00aae40 0x7fb3c0158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.966+0000 7fb3bfe00640 1 -- 172.21.15.106:0/1389855476 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3c015a0e0 msgr2=0x7fb3c014a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.966+0000 7fb3bfe00640 1 --2- 172.21.15.106:0/1389855476 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3c015a0e0 0x7fb3c014a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.966+0000 7fb3bfe00640 1 -- 172.21.15.106:0/1389855476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3c00aae40 msgr2=0x7fb3c0158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:17.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.966+0000 7fb3bfe00640 1 --2- 172.21.15.106:0/1389855476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3c00aae40 0x7fb3c0158690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:17.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.966+0000 7fb3bfe00640 1 -- 172.21.15.106:0/1389855476 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a8009450 con 0x7fb3c006df00 2024-08-17T02:28:17.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.966+0000 7fb3b7400640 1 --2- 172.21.15.106:0/1389855476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3c00aae40 0x7fb3c0158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:17.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.966+0000 7fb3c4a00640 1 --2- 172.21.15.106:0/1389855476 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3c015a0e0 0x7fb3c014a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:17.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.966+0000 7fb3bfe00640 1 --2- 172.21.15.106:0/1389855476 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3c006df00 0x7fb3c014a9e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000d890 tx=0x7fb3b0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:17.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.966+0000 7fb3b7e00640 1 -- 172.21.15.106:0/1389855476 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b000de20 con 0x7fb3c006df00 2024-08-17T02:28:17.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.966+0000 7fb3b7e00640 1 -- 172.21.15.106:0/1389855476 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b000b8d0 con 0x7fb3c006df00 2024-08-17T02:28:17.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.966+0000 7fb3b7e00640 1 -- 172.21.15.106:0/1389855476 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b000bc90 con 0x7fb3c006df00 2024-08-17T02:28:17.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.966+0000 7fb3c5400640 1 -- 172.21.15.106:0/1389855476 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c01565c0 con 0x7fb3c006df00 2024-08-17T02:28:17.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.966+0000 7fb3c5400640 1 -- 172.21.15.106:0/1389855476 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c0158bd0 con 0x7fb3c006df00 2024-08-17T02:28:17.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.967+0000 7fb3c5400640 1 -- 172.21.15.106:0/1389855476 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c0071050 con 0x7fb3c006df00 2024-08-17T02:28:17.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.968+0000 7fb3b7e00640 1 -- 172.21.15.106:0/1389855476 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb3b001e460 con 0x7fb3c006df00 2024-08-17T02:28:17.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.969+0000 7fb3b7e00640 1 --2- 172.21.15.106:0/1389855476 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb39c0651d0 0x7fb39c067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:17.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.969+0000 7fb3b7e00640 1 -- 172.21.15.106:0/1389855476 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb3b0082b90 con 0x7fb3c006df00 2024-08-17T02:28:17.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.969+0000 7fb3b7400640 1 --2- 172.21.15.106:0/1389855476 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb39c0651d0 0x7fb39c067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:17.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.970+0000 7fb3b7400640 1 --2- 172.21.15.106:0/1389855476 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb39c0651d0 0x7fb39c067680 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8034000 tx=0x7fb3a8032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:17.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:17.973+0000 7fb3b7e00640 1 -- 172.21.15.106:0/1389855476 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb3b0050c60 con 0x7fb3c006df00 2024-08-17T02:28:18.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.145+0000 7fb3c5400640 1 -- 172.21.15.106:0/1389855476 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb3c00ad9a0 con 0x7fb3c006df00 2024-08-17T02:28:18.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.146+0000 7fb3b7e00640 1 -- 172.21.15.106:0/1389855476 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb3b0054280 con 0x7fb3c006df00 2024-08-17T02:28:18.147 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-08-17T02:28:18.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.148+0000 7fb3c5400640 1 -- 172.21.15.106:0/1389855476 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb39c0651d0 msgr2=0x7fb39c067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.148+0000 7fb3c5400640 1 --2- 172.21.15.106:0/1389855476 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb39c0651d0 0x7fb39c067680 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8034000 tx=0x7fb3a8032000 comp rx=0 tx=0).stop 2024-08-17T02:28:18.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.148+0000 7fb3c5400640 1 -- 172.21.15.106:0/1389855476 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3c006df00 msgr2=0x7fb3c014a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.148+0000 7fb3c5400640 1 --2- 172.21.15.106:0/1389855476 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3c006df00 0x7fb3c014a9e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000d890 tx=0x7fb3b0008040 comp rx=0 tx=0).stop 2024-08-17T02:28:18.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.148+0000 7fb3c5400640 1 -- 172.21.15.106:0/1389855476 shutdown_connections 2024-08-17T02:28:18.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.148+0000 7fb3c5400640 1 --2- 172.21.15.106:0/1389855476 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb3c015a0e0 0x7fb3c014a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.148+0000 7fb3c5400640 1 --2- 172.21.15.106:0/1389855476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3c00aae40 0x7fb3c0158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.148+0000 7fb3c5400640 1 --2- 172.21.15.106:0/1389855476 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb39c0651d0 0x7fb39c067680 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.148+0000 7fb3c5400640 1 --2- 172.21.15.106:0/1389855476 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb3c006df00 0x7fb3c014a9e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.148+0000 7fb3c5400640 1 -- 172.21.15.106:0/1389855476 >> 172.21.15.106:0/1389855476 conn(0x7fb3c0067750 msgr2=0x7fb3c00c9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:18.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.148+0000 7fb3c5400640 1 -- 172.21.15.106:0/1389855476 shutdown_connections 2024-08-17T02:28:18.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.148+0000 7fb3c5400640 1 -- 172.21.15.106:0/1389855476 wait complete. 2024-08-17T02:28:18.164 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:28:18.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.316+0000 7fe69cc00640 1 Processor -- start 2024-08-17T02:28:18.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.316+0000 7fe69cc00640 1 -- start start 2024-08-17T02:28:18.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.317+0000 7fe69cc00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe6980caa20 0x7fe6980c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.317+0000 7fe69cc00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe6980c3390 0x7fe6980c7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.317+0000 7fe69cc00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6980cb540 con 0x7fe698158e20 2024-08-17T02:28:18.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.317+0000 7fe69cc00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6980cf7f0 con 0x7fe6980caa20 2024-08-17T02:28:18.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.317+0000 7fe69cc00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6980caef0 con 0x7fe6980c3390 2024-08-17T02:28:18.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.317+0000 7fe695400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe6980caa20 0x7fe6980c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.317+0000 7fe695400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe6980caa20 0x7fe6980c6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40650/0 (socket says 172.21.15.106:40650) 2024-08-17T02:28:18.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.317+0000 7fe695400640 1 -- 172.21.15.106:0/113387809 learned_addr learned my addr 172.21.15.106:0/113387809 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:18.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.317+0000 7fe696800640 1 --2- 172.21.15.106:0/113387809 >> v2:172.21.15.171:3300/0 conn(0x7fe6980c3390 0x7fe6980c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.318+0000 7fe695400640 1 -- 172.21.15.106:0/113387809 >> v2:172.21.15.171:3300/0 conn(0x7fe6980c3390 msgr2=0x7fe6980c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:18.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.318+0000 7fe695400640 1 --2- 172.21.15.106:0/113387809 >> v2:172.21.15.171:3300/0 conn(0x7fe6980c3390 0x7fe6980c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.318+0000 7fe695400640 1 -- 172.21.15.106:0/113387809 >> v1:172.21.15.171:6789/0 conn(0x7fe698158e20 legacy=0x7fe6980ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.318+0000 7fe695400640 1 -- 172.21.15.106:0/113387809 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6980cb1d0 con 0x7fe6980caa20 2024-08-17T02:28:18.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.319+0000 7fe695400640 1 --2- 172.21.15.106:0/113387809 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6980caa20 0x7fe6980c6e10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe69806f650 tx=0x7fe6840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2955a5ad468a18b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:18.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.319+0000 7fe694a00640 1 -- 172.21.15.106:0/113387809 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68402ae80 con 0x7fe6980caa20 2024-08-17T02:28:18.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.319+0000 7fe694a00640 1 -- 172.21.15.106:0/113387809 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe684032440 con 0x7fe6980caa20 2024-08-17T02:28:18.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.319+0000 7fe694a00640 1 -- 172.21.15.106:0/113387809 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe684032800 con 0x7fe6980caa20 2024-08-17T02:28:18.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.320+0000 7fe69cc00640 1 -- 172.21.15.106:0/113387809 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6980caa20 msgr2=0x7fe6980c6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.320+0000 7fe69cc00640 1 --2- 172.21.15.106:0/113387809 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6980caa20 0x7fe6980c6e10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe69806f650 tx=0x7fe6840091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.320+0000 7fe69cc00640 1 -- 172.21.15.106:0/113387809 shutdown_connections 2024-08-17T02:28:18.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.320+0000 7fe69cc00640 1 --2- 172.21.15.106:0/113387809 >> v2:172.21.15.171:3300/0 conn(0x7fe6980c3390 0x7fe6980c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.320+0000 7fe69cc00640 1 --2- 172.21.15.106:0/113387809 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6980caa20 0x7fe6980c6e10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.320+0000 7fe69cc00640 1 -- 172.21.15.106:0/113387809 >> 172.21.15.106:0/113387809 conn(0x7fe6980cfd70 msgr2=0x7fe6980d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:18.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.320+0000 7fe69cc00640 1 -- 172.21.15.106:0/113387809 shutdown_connections 2024-08-17T02:28:18.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.320+0000 7fe69cc00640 1 -- 172.21.15.106:0/113387809 wait complete. 2024-08-17T02:28:18.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.322+0000 7fe69cc00640 1 Processor -- start 2024-08-17T02:28:18.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.322+0000 7fe69cc00640 1 -- start start 2024-08-17T02:28:18.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.323+0000 7fe69cc00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6980c3390 0x7fe698144230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.323+0000 7fe69cc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6980caa20 0x7fe6980c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.323+0000 7fe69cc00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe698158e20 0x7fe6980c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.323+0000 7fe69cc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe698157630 con 0x7fe6980caa20 2024-08-17T02:28:18.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.323+0000 7fe69cc00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe698144cf0 con 0x7fe6980c3390 2024-08-17T02:28:18.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.323+0000 7fe69cc00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe698144fd0 con 0x7fe698158e20 2024-08-17T02:28:18.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.323+0000 7fe695400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6980caa20 0x7fe6980c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.323+0000 7fe695400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6980caa20 0x7fe6980c47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40654/0 (socket says 172.21.15.106:40654) 2024-08-17T02:28:18.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.323+0000 7fe695400640 1 -- 172.21.15.106:0/278238080 learned_addr learned my addr 172.21.15.106:0/278238080 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:18.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.323+0000 7fe695400640 1 -- 172.21.15.106:0/278238080 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe698158e20 msgr2=0x7fe6980c4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.323+0000 7fe695400640 1 --2- 172.21.15.106:0/278238080 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe698158e20 0x7fe6980c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.323+0000 7fe695400640 1 -- 172.21.15.106:0/278238080 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6980c3390 msgr2=0x7fe698144230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.323+0000 7fe695400640 1 --2- 172.21.15.106:0/278238080 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6980c3390 0x7fe698144230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.323+0000 7fe695400640 1 -- 172.21.15.106:0/278238080 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe684009450 con 0x7fe6980caa20 2024-08-17T02:28:18.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.324+0000 7fe695400640 1 --2- 172.21.15.106:0/278238080 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6980caa20 0x7fe6980c47a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe684009210 tx=0x7fe684032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:18.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.324+0000 7fe68d600640 1 -- 172.21.15.106:0/278238080 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe684000d10 con 0x7fe6980caa20 2024-08-17T02:28:18.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.324+0000 7fe68d600640 1 -- 172.21.15.106:0/278238080 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe684031de0 con 0x7fe6980caa20 2024-08-17T02:28:18.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.324+0000 7fe68d600640 1 -- 172.21.15.106:0/278238080 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68403d690 con 0x7fe6980caa20 2024-08-17T02:28:18.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.324+0000 7fe69cc00640 1 -- 172.21.15.106:0/278238080 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6981452b0 con 0x7fe6980caa20 2024-08-17T02:28:18.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.324+0000 7fe69cc00640 1 -- 172.21.15.106:0/278238080 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe698145870 con 0x7fe6980caa20 2024-08-17T02:28:18.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.325+0000 7fe69cc00640 1 -- 172.21.15.106:0/278238080 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe698145ab0 con 0x7fe6980caa20 2024-08-17T02:28:18.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.326+0000 7fe68d600640 1 -- 172.21.15.106:0/278238080 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe684039040 con 0x7fe6980caa20 2024-08-17T02:28:18.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.327+0000 7fe68d600640 1 --2- 172.21.15.106:0/278238080 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe678065150 0x7fe678067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.327+0000 7fe68d600640 1 -- 172.21.15.106:0/278238080 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe6840a24c0 con 0x7fe6980caa20 2024-08-17T02:28:18.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.327+0000 7fe695e00640 1 --2- 172.21.15.106:0/278238080 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe678065150 0x7fe678067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.328+0000 7fe695e00640 1 --2- 172.21.15.106:0/278238080 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe678065150 0x7fe678067600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe688001600 tx=0x7fe688007ab0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:18.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.331+0000 7fe68d600640 1 -- 172.21.15.106:0/278238080 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe698145ab0 con 0x7fe6980caa20 2024-08-17T02:28:18.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.512+0000 7fe69cc00640 1 -- 172.21.15.106:0/278238080 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe698145ab0 con 0x7fe6980caa20 2024-08-17T02:28:18.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.513+0000 7fe68d600640 1 -- 172.21.15.106:0/278238080 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe698145ab0 con 0x7fe6980caa20 2024-08-17T02:28:18.514 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-08-17T02:28:18.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.515+0000 7fe69cc00640 1 -- 172.21.15.106:0/278238080 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe678065150 msgr2=0x7fe678067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.515+0000 7fe69cc00640 1 --2- 172.21.15.106:0/278238080 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe678065150 0x7fe678067600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe688001600 tx=0x7fe688007ab0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.515+0000 7fe69cc00640 1 -- 172.21.15.106:0/278238080 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6980caa20 msgr2=0x7fe6980c47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.515+0000 7fe69cc00640 1 --2- 172.21.15.106:0/278238080 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6980caa20 0x7fe6980c47a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe684009210 tx=0x7fe684032000 comp rx=0 tx=0).stop 2024-08-17T02:28:18.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.515+0000 7fe69cc00640 1 -- 172.21.15.106:0/278238080 shutdown_connections 2024-08-17T02:28:18.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.515+0000 7fe69cc00640 1 --2- 172.21.15.106:0/278238080 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe698158e20 0x7fe6980c4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.515+0000 7fe69cc00640 1 --2- 172.21.15.106:0/278238080 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe678065150 0x7fe678067600 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.515+0000 7fe69cc00640 1 --2- 172.21.15.106:0/278238080 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6980caa20 0x7fe6980c47a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.515+0000 7fe69cc00640 1 --2- 172.21.15.106:0/278238080 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6980c3390 0x7fe698144230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.515+0000 7fe69cc00640 1 -- 172.21.15.106:0/278238080 >> 172.21.15.106:0/278238080 conn(0x7fe6980cfd70 msgr2=0x7fe6980c90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:18.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.515+0000 7fe69cc00640 1 -- 172.21.15.106:0/278238080 shutdown_connections 2024-08-17T02:28:18.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.515+0000 7fe69cc00640 1 -- 172.21.15.106:0/278238080 wait complete. 2024-08-17T02:28:18.533 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:28:18.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.687+0000 7f8804200640 1 Processor -- start 2024-08-17T02:28:18.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.687+0000 7f8804200640 1 -- start start 2024-08-17T02:28:18.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.688+0000 7f8804200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f87fc0adcf0 0x7f87fc0ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.688+0000 7f8804200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87fc0abb00 0x7f87fc0c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.688+0000 7f8804200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87fc0ab130 con 0x7f87fc156c50 2024-08-17T02:28:18.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.688+0000 7f8804200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87fc0ae5a0 con 0x7f87fc0adcf0 2024-08-17T02:28:18.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.688+0000 7f8804200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc0ae2c0 con 0x7f87fc0abb00 2024-08-17T02:28:18.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.688+0000 7f8800e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f87fc0adcf0 0x7f87fc0ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.688+0000 7f8800e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f87fc0adcf0 0x7f87fc0ab5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40664/0 (socket says 172.21.15.106:40664) 2024-08-17T02:28:18.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.688+0000 7f8800e00640 1 -- 172.21.15.106:0/1338518643 learned_addr learned my addr 172.21.15.106:0/1338518643 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:18.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.688+0000 7f8802200640 1 --2- 172.21.15.106:0/1338518643 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87fc0abb00 0x7f87fc0c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.689+0000 7f8800e00640 1 -- 172.21.15.106:0/1338518643 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87fc0abb00 msgr2=0x7f87fc0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:18.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.689+0000 7f8800e00640 1 --2- 172.21.15.106:0/1338518643 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87fc0abb00 0x7f87fc0c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.689+0000 7f8800e00640 1 -- 172.21.15.106:0/1338518643 >> v1:172.21.15.171:6789/0 conn(0x7f87fc156c50 legacy=0x7f87fc0c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.689+0000 7f8800e00640 1 -- 172.21.15.106:0/1338518643 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87fc0aaae0 con 0x7f87fc0adcf0 2024-08-17T02:28:18.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.690+0000 7f8800e00640 1 --2- 172.21.15.106:0/1338518643 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87fc0adcf0 0x7f87fc0ab5c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009910 tx=0x7f87e80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ffb5c077eebf88 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:18.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.690+0000 7f87fbe00640 1 -- 172.21.15.106:0/1338518643 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e802ad20 con 0x7f87fc0adcf0 2024-08-17T02:28:18.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.690+0000 7f87fbe00640 1 -- 172.21.15.106:0/1338518643 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e802ae80 con 0x7f87fc0adcf0 2024-08-17T02:28:18.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.690+0000 7f87fbe00640 1 -- 172.21.15.106:0/1338518643 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e8032670 con 0x7f87fc0adcf0 2024-08-17T02:28:18.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.691+0000 7f8804200640 1 -- 172.21.15.106:0/1338518643 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87fc0adcf0 msgr2=0x7f87fc0ab5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.691+0000 7f8804200640 1 --2- 172.21.15.106:0/1338518643 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87fc0adcf0 0x7f87fc0ab5c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009910 tx=0x7f87e80091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.691+0000 7f8804200640 1 -- 172.21.15.106:0/1338518643 shutdown_connections 2024-08-17T02:28:18.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.691+0000 7f8804200640 1 --2- 172.21.15.106:0/1338518643 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87fc0abb00 0x7f87fc0c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.691+0000 7f8804200640 1 --2- 172.21.15.106:0/1338518643 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87fc0adcf0 0x7f87fc0ab5c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.691+0000 7f8804200640 1 -- 172.21.15.106:0/1338518643 >> 172.21.15.106:0/1338518643 conn(0x7f87fc067750 msgr2=0x7f87fc0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:18.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.691+0000 7f8804200640 1 -- 172.21.15.106:0/1338518643 shutdown_connections 2024-08-17T02:28:18.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.691+0000 7f8804200640 1 -- 172.21.15.106:0/1338518643 wait complete. 2024-08-17T02:28:18.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.692+0000 7f8804200640 1 Processor -- start 2024-08-17T02:28:18.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.692+0000 7f8804200640 1 -- start start 2024-08-17T02:28:18.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.693+0000 7f8804200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87fc0abb00 0x7f87fc06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.693+0000 7f8804200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87fc0adcf0 0x7f87fc149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.693+0000 7f8804200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87fc156c50 0x7f87fc155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.693+0000 7f8804200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc14d270 con 0x7f87fc156c50 2024-08-17T02:28:18.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.693+0000 7f8804200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc14e4f0 con 0x7f87fc0abb00 2024-08-17T02:28:18.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.693+0000 7f8804200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc14d450 con 0x7f87fc0adcf0 2024-08-17T02:28:18.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.694+0000 7f8802200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87fc156c50 0x7f87fc155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.694+0000 7f8802200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87fc156c50 0x7f87fc155660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40666/0 (socket says 172.21.15.106:40666) 2024-08-17T02:28:18.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.694+0000 7f8802200640 1 -- 172.21.15.106:0/3618949052 learned_addr learned my addr 172.21.15.106:0/3618949052 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:18.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.694+0000 7f8800e00640 1 --2- 172.21.15.106:0/3618949052 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87fc0adcf0 0x7f87fc149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.694+0000 7f8801800640 1 --2- 172.21.15.106:0/3618949052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87fc0abb00 0x7f87fc06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.694+0000 7f8802200640 1 -- 172.21.15.106:0/3618949052 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87fc0adcf0 msgr2=0x7f87fc149240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.694+0000 7f8802200640 1 --2- 172.21.15.106:0/3618949052 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87fc0adcf0 0x7f87fc149240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.694+0000 7f8802200640 1 -- 172.21.15.106:0/3618949052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87fc0abb00 msgr2=0x7f87fc06e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.694+0000 7f8802200640 1 --2- 172.21.15.106:0/3618949052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87fc0abb00 0x7f87fc06e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.694+0000 7f8802200640 1 -- 172.21.15.106:0/3618949052 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e8009450 con 0x7f87fc156c50 2024-08-17T02:28:18.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.694+0000 7f8802200640 1 --2- 172.21.15.106:0/3618949052 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87fc156c50 0x7f87fc155660 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009ef0 tx=0x7f87f400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:18.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.695+0000 7f87f8c00640 1 -- 172.21.15.106:0/3618949052 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f400ce10 con 0x7f87fc156c50 2024-08-17T02:28:18.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.695+0000 7f87f8c00640 1 -- 172.21.15.106:0/3618949052 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f400f040 con 0x7f87fc156c50 2024-08-17T02:28:18.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.695+0000 7f8804200640 1 -- 172.21.15.106:0/3618949052 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87fc14d730 con 0x7f87fc156c50 2024-08-17T02:28:18.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.695+0000 7f87f8c00640 1 -- 172.21.15.106:0/3618949052 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f40146d0 con 0x7f87fc156c50 2024-08-17T02:28:18.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.695+0000 7f8804200640 1 -- 172.21.15.106:0/3618949052 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87fc14dcf0 con 0x7f87fc156c50 2024-08-17T02:28:18.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.696+0000 7f8804200640 1 -- 172.21.15.106:0/3618949052 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87fc071050 con 0x7f87fc156c50 2024-08-17T02:28:18.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.698+0000 7f87f8c00640 1 -- 172.21.15.106:0/3618949052 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f87f4014a80 con 0x7f87fc156c50 2024-08-17T02:28:18.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.698+0000 7f87f8c00640 1 --2- 172.21.15.106:0/3618949052 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f87dc065150 0x7f87dc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:18.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.699+0000 7f87f8c00640 1 -- 172.21.15.106:0/3618949052 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f87f4083280 con 0x7f87fc156c50 2024-08-17T02:28:18.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.699+0000 7f8801800640 1 --2- 172.21.15.106:0/3618949052 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f87dc065150 0x7f87dc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:18.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.700+0000 7f8801800640 1 --2- 172.21.15.106:0/3618949052 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f87dc065150 0x7f87dc067600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f87f0007fd0 tx=0x7f87f0007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:18.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.703+0000 7f87f8c00640 1 -- 172.21.15.106:0/3618949052 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f87f4051410 con 0x7f87fc156c50 2024-08-17T02:28:18.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.885+0000 7f8804200640 1 -- 172.21.15.106:0/3618949052 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f87fc0cb230 con 0x7f87fc156c50 2024-08-17T02:28:18.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.886+0000 7f87f8c00640 1 -- 172.21.15.106:0/3618949052 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87f4054a30 con 0x7f87fc156c50 2024-08-17T02:28:18.888 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-08-17T02:28:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.888+0000 7f8804200640 1 -- 172.21.15.106:0/3618949052 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f87dc065150 msgr2=0x7f87dc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.888+0000 7f8804200640 1 --2- 172.21.15.106:0/3618949052 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f87dc065150 0x7f87dc067600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f87f0007fd0 tx=0x7f87f0007e30 comp rx=0 tx=0).stop 2024-08-17T02:28:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.888+0000 7f8804200640 1 -- 172.21.15.106:0/3618949052 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87fc156c50 msgr2=0x7f87fc155660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.888+0000 7f8804200640 1 --2- 172.21.15.106:0/3618949052 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87fc156c50 0x7f87fc155660 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009ef0 tx=0x7f87f400b040 comp rx=0 tx=0).stop 2024-08-17T02:28:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.888+0000 7f8804200640 1 -- 172.21.15.106:0/3618949052 shutdown_connections 2024-08-17T02:28:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.888+0000 7f8804200640 1 --2- 172.21.15.106:0/3618949052 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f87dc065150 0x7f87dc067600 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.888+0000 7f8804200640 1 --2- 172.21.15.106:0/3618949052 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87fc156c50 0x7f87fc155660 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.888+0000 7f8804200640 1 --2- 172.21.15.106:0/3618949052 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87fc0adcf0 0x7f87fc149240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.888+0000 7f8804200640 1 --2- 172.21.15.106:0/3618949052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87fc0abb00 0x7f87fc06e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:18.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.888+0000 7f8804200640 1 -- 172.21.15.106:0/3618949052 >> 172.21.15.106:0/3618949052 conn(0x7f87fc067750 msgr2=0x7f87fc0ca730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:18.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.888+0000 7f8804200640 1 -- 172.21.15.106:0/3618949052 shutdown_connections 2024-08-17T02:28:18.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:18.888+0000 7f8804200640 1 -- 172.21.15.106:0/3618949052 wait complete. 2024-08-17T02:28:18.905 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:19.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.057+0000 7f5d39600640 1 Processor -- start 2024-08-17T02:28:19.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.057+0000 7f5d39600640 1 -- start start 2024-08-17T02:28:19.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.058+0000 7f5d39600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5d34159c40 0x7f5d340c8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.058+0000 7f5d39600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d340ae6b0 con 0x7f5d340addf0 2024-08-17T02:28:19.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.058+0000 7f5d39600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d340af230 con 0x7f5d340ada20 2024-08-17T02:28:19.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.058+0000 7f5d39600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d340ae1e0 con 0x7f5d34159c40 2024-08-17T02:28:19.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.058+0000 7f5d33400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5d34159c40 0x7f5d340c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.058+0000 7f5d38c00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5d340addf0 0x7f5d34154e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39356/0 (socket says 172.21.15.106:39356) 2024-08-17T02:28:19.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.059+0000 7f5d38c00640 1 -- 172.21.15.106:0/2584946772 learned_addr learned my addr 172.21.15.106:0/2584946772 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:19.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.059+0000 7f5d33400640 1 -- 172.21.15.106:0/2584946772 >> v1:172.21.15.171:6789/0 conn(0x7f5d340ada20 legacy=0x7f5d340cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.059+0000 7f5d33400640 1 -- 172.21.15.106:0/2584946772 >> v1:172.21.15.106:6789/0 conn(0x7f5d340addf0 legacy=0x7f5d34154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.059+0000 7f5d33400640 1 -- 172.21.15.106:0/2584946772 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d340ae900 con 0x7f5d34159c40 2024-08-17T02:28:19.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.060+0000 7f5d33400640 1 --2- 172.21.15.106:0/2584946772 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d34159c40 0x7f5d340c8060 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009850 tx=0x7f5d200090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ee8a9e11e43b07 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:19.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.060+0000 7f5d32a00640 1 -- 172.21.15.106:0/2584946772 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d20030510 con 0x7f5d34159c40 2024-08-17T02:28:19.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.060+0000 7f5d32a00640 1 -- 172.21.15.106:0/2584946772 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2002e050 con 0x7f5d34159c40 2024-08-17T02:28:19.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.060+0000 7f5d32a00640 1 -- 172.21.15.106:0/2584946772 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d200308e0 con 0x7f5d34159c40 2024-08-17T02:28:19.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.061+0000 7f5d39600640 1 -- 172.21.15.106:0/2584946772 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d34159c40 msgr2=0x7f5d340c8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.061+0000 7f5d39600640 1 --2- 172.21.15.106:0/2584946772 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d34159c40 0x7f5d340c8060 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009850 tx=0x7f5d200090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.061+0000 7f5d39600640 1 -- 172.21.15.106:0/2584946772 shutdown_connections 2024-08-17T02:28:19.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.061+0000 7f5d39600640 1 --2- 172.21.15.106:0/2584946772 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d34159c40 0x7f5d340c8060 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.061+0000 7f5d39600640 1 -- 172.21.15.106:0/2584946772 >> 172.21.15.106:0/2584946772 conn(0x7f5d34067750 msgr2=0x7f5d340cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:19.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.061+0000 7f5d39600640 1 -- 172.21.15.106:0/2584946772 shutdown_connections 2024-08-17T02:28:19.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.061+0000 7f5d39600640 1 -- 172.21.15.106:0/2584946772 wait complete. 2024-08-17T02:28:19.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.063+0000 7f5d39600640 1 Processor -- start 2024-08-17T02:28:19.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.063+0000 7f5d39600640 1 -- start start 2024-08-17T02:28:19.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.064+0000 7f5d39600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d340ada20 0x7f5d340c0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.064+0000 7f5d39600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d340addf0 0x7f5d3416ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.064+0000 7f5d39600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d34159c40 0x7f5d34168da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.064+0000 7f5d39600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d34157c60 con 0x7f5d340ada20 2024-08-17T02:28:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.064+0000 7f5d39600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3416d360 con 0x7f5d340addf0 2024-08-17T02:28:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.064+0000 7f5d39600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d341692e0 con 0x7f5d34159c40 2024-08-17T02:28:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.064+0000 7f5d33e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d340ada20 0x7f5d340c0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.064+0000 7f5d33e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d340ada20 0x7f5d340c0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40686/0 (socket says 172.21.15.106:40686) 2024-08-17T02:28:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.064+0000 7f5d33e00640 1 -- 172.21.15.106:0/2009178376 learned_addr learned my addr 172.21.15.106:0/2009178376 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.064+0000 7f5d38c00640 1 --2- 172.21.15.106:0/2009178376 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d34159c40 0x7f5d34168da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.064+0000 7f5d33400640 1 --2- 172.21.15.106:0/2009178376 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d340addf0 0x7f5d3416ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.064+0000 7f5d33e00640 1 -- 172.21.15.106:0/2009178376 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d34159c40 msgr2=0x7f5d34168da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.064+0000 7f5d33e00640 1 --2- 172.21.15.106:0/2009178376 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d34159c40 0x7f5d34168da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.064+0000 7f5d33e00640 1 -- 172.21.15.106:0/2009178376 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d340addf0 msgr2=0x7f5d3416ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.064+0000 7f5d33e00640 1 --2- 172.21.15.106:0/2009178376 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d340addf0 0x7f5d3416ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.064+0000 7f5d33e00640 1 -- 172.21.15.106:0/2009178376 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d20009390 con 0x7f5d340ada20 2024-08-17T02:28:19.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.065+0000 7f5d33e00640 1 --2- 172.21.15.106:0/2009178376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d340ada20 0x7f5d340c0fd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5d2400c590 tx=0x7f5d24007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:19.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.065+0000 7f5d2b400640 1 -- 172.21.15.106:0/2009178376 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d24012630 con 0x7f5d340ada20 2024-08-17T02:28:19.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.065+0000 7f5d2b400640 1 -- 172.21.15.106:0/2009178376 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d240127b0 con 0x7f5d340ada20 2024-08-17T02:28:19.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.065+0000 7f5d2b400640 1 -- 172.21.15.106:0/2009178376 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d24012b70 con 0x7f5d340ada20 2024-08-17T02:28:19.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.065+0000 7f5d39600640 1 -- 172.21.15.106:0/2009178376 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d34157330 con 0x7f5d340ada20 2024-08-17T02:28:19.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.065+0000 7f5d39600640 1 -- 172.21.15.106:0/2009178376 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d341578f0 con 0x7f5d340ada20 2024-08-17T02:28:19.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.066+0000 7f5d39600640 1 -- 172.21.15.106:0/2009178376 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d34071050 con 0x7f5d340ada20 2024-08-17T02:28:19.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.067+0000 7f5d2b400640 1 -- 172.21.15.106:0/2009178376 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5d2401b400 con 0x7f5d340ada20 2024-08-17T02:28:19.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.068+0000 7f5d2b400640 1 --2- 172.21.15.106:0/2009178376 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5d14065150 0x7f5d14067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.068+0000 7f5d2b400640 1 -- 172.21.15.106:0/2009178376 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5d24081f40 con 0x7f5d340ada20 2024-08-17T02:28:19.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.068+0000 7f5d33400640 1 --2- 172.21.15.106:0/2009178376 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5d14065150 0x7f5d14067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.069+0000 7f5d33400640 1 --2- 172.21.15.106:0/2009178376 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5d14065150 0x7f5d14067600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5d20035000 tx=0x7f5d20036000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:19.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.072+0000 7f5d2b400640 1 -- 172.21.15.106:0/2009178376 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5d2404ff60 con 0x7f5d340ada20 2024-08-17T02:28:19.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.250+0000 7f5d39600640 1 -- 172.21.15.106:0/2009178376 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d3406a620 con 0x7f5d340ada20 2024-08-17T02:28:19.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.251+0000 7f5d2b400640 1 -- 172.21.15.106:0/2009178376 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f5d24053580 con 0x7f5d340ada20 2024-08-17T02:28:19.252 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:19.252 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:27:52.284039+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:48.547438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:49.671073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:19.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.253+0000 7f5d39600640 1 -- 172.21.15.106:0/2009178376 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5d14065150 msgr2=0x7f5d14067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.253+0000 7f5d39600640 1 --2- 172.21.15.106:0/2009178376 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5d14065150 0x7f5d14067600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5d20035000 tx=0x7f5d20036000 comp rx=0 tx=0).stop 2024-08-17T02:28:19.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.253+0000 7f5d39600640 1 -- 172.21.15.106:0/2009178376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d340ada20 msgr2=0x7f5d340c0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.253+0000 7f5d39600640 1 --2- 172.21.15.106:0/2009178376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d340ada20 0x7f5d340c0fd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5d2400c590 tx=0x7f5d24007ef0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.253+0000 7f5d39600640 1 -- 172.21.15.106:0/2009178376 shutdown_connections 2024-08-17T02:28:19.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.253+0000 7f5d39600640 1 --2- 172.21.15.106:0/2009178376 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5d34159c40 0x7f5d34168da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.253+0000 7f5d39600640 1 --2- 172.21.15.106:0/2009178376 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d340addf0 0x7f5d3416ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.253+0000 7f5d39600640 1 --2- 172.21.15.106:0/2009178376 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5d14065150 0x7f5d14067600 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.253+0000 7f5d39600640 1 --2- 172.21.15.106:0/2009178376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d340ada20 0x7f5d340c0fd0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.253+0000 7f5d39600640 1 -- 172.21.15.106:0/2009178376 >> 172.21.15.106:0/2009178376 conn(0x7f5d34067750 msgr2=0x7f5d340696f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:19.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.253+0000 7f5d39600640 1 -- 172.21.15.106:0/2009178376 shutdown_connections 2024-08-17T02:28:19.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.253+0000 7f5d39600640 1 -- 172.21.15.106:0/2009178376 wait complete. 2024-08-17T02:28:19.270 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:37.928826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:48.547438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:49.671073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:28:19.271 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:28:19.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.423+0000 7fa84b200640 1 Processor -- start 2024-08-17T02:28:19.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.423+0000 7fa84b200640 1 -- start start 2024-08-17T02:28:19.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.425+0000 7fa84b200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa84c158e50 0x7fa84c0cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.425+0000 7fa84b200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa84c0ce790 0x7fa84c0b3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.425+0000 7fa84b200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa84c0ceeb0 con 0x7fa84c0cc700 2024-08-17T02:28:19.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.425+0000 7fa84b200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa84c0cf190 con 0x7fa84c158e50 2024-08-17T02:28:19.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.425+0000 7fa84b200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c0cf470 con 0x7fa84c0ce790 2024-08-17T02:28:19.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.425+0000 7fa84a800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa84c0ce790 0x7fa84c0b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.425+0000 7fa849e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa84c158e50 0x7fa84c0cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.425+0000 7fa84a800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa84c0ce790 0x7fa84c0b3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:46724/0 (socket says 172.21.15.106:46724) 2024-08-17T02:28:19.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.425+0000 7fa84a800640 1 -- 172.21.15.106:0/2806918699 learned_addr learned my addr 172.21.15.106:0/2806918699 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:19.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.426+0000 7fa849e00640 1 -- 172.21.15.106:0/2806918699 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa84c0ce790 msgr2=0x7fa84c0b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:19.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.426+0000 7fa849e00640 1 --2- 172.21.15.106:0/2806918699 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa84c0ce790 0x7fa84c0b3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.426+0000 7fa849e00640 1 -- 172.21.15.106:0/2806918699 >> v1:172.21.15.171:6789/0 conn(0x7fa84c0cc700 legacy=0x7fa84c0ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.426+0000 7fa849e00640 1 -- 172.21.15.106:0/2806918699 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84c0b2a00 con 0x7fa84c158e50 2024-08-17T02:28:19.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.426+0000 7fa84a800640 1 --2- 172.21.15.106:0/2806918699 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa84c0ce790 0x7fa84c0b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:19.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.427+0000 7fa849e00640 1 --2- 172.21.15.106:0/2806918699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa84c158e50 0x7fa84c0cc1c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa83c009850 tx=0x7fa83c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d411aaced786b6db server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:19.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.427+0000 7fa848a00640 1 -- 172.21.15.106:0/2806918699 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c02ad80 con 0x7fa84c158e50 2024-08-17T02:28:19.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.427+0000 7fa848a00640 1 -- 172.21.15.106:0/2806918699 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83c032440 con 0x7fa84c158e50 2024-08-17T02:28:19.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.427+0000 7fa848a00640 1 -- 172.21.15.106:0/2806918699 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c032820 con 0x7fa84c158e50 2024-08-17T02:28:19.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.428+0000 7fa84b200640 1 -- 172.21.15.106:0/2806918699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa84c158e50 msgr2=0x7fa84c0cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.428+0000 7fa84b200640 1 --2- 172.21.15.106:0/2806918699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa84c158e50 0x7fa84c0cc1c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa83c009850 tx=0x7fa83c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.428+0000 7fa84b200640 1 -- 172.21.15.106:0/2806918699 shutdown_connections 2024-08-17T02:28:19.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.428+0000 7fa84b200640 1 --2- 172.21.15.106:0/2806918699 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa84c0ce790 0x7fa84c0b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.428+0000 7fa84b200640 1 --2- 172.21.15.106:0/2806918699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa84c158e50 0x7fa84c0cc1c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.428+0000 7fa84b200640 1 -- 172.21.15.106:0/2806918699 >> 172.21.15.106:0/2806918699 conn(0x7fa84c098de0 msgr2=0x7fa84c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:19.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.428+0000 7fa84b200640 1 -- 172.21.15.106:0/2806918699 shutdown_connections 2024-08-17T02:28:19.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.428+0000 7fa84b200640 1 -- 172.21.15.106:0/2806918699 wait complete. 2024-08-17T02:28:19.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.429+0000 7fa84b200640 1 Processor -- start 2024-08-17T02:28:19.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.429+0000 7fa84b200640 1 -- start start 2024-08-17T02:28:19.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.430+0000 7fa84b200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa84c0cc700 0x7fa84c15b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.430+0000 7fa84b200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa84c0ce790 0x7fa84c159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.430+0000 7fa84b200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa84c158e50 0x7fa84c15a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.430+0000 7fa84b200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c0c3670 con 0x7fa84c158e50 2024-08-17T02:28:19.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.430+0000 7fa84b200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c09d3d0 con 0x7fa84c0ce790 2024-08-17T02:28:19.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.430+0000 7fa84b200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c15a810 con 0x7fa84c0cc700 2024-08-17T02:28:19.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.430+0000 7fa84a800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa84c158e50 0x7fa84c15a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.430+0000 7fa84a800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa84c158e50 0x7fa84c15a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:40700/0 (socket says 172.21.15.106:40700) 2024-08-17T02:28:19.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.431+0000 7fa84a800640 1 -- 172.21.15.106:0/2957311048 learned_addr learned my addr 172.21.15.106:0/2957311048 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:19.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.431+0000 7fa849e00640 1 --2- 172.21.15.106:0/2957311048 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa84c0cc700 0x7fa84c15b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.431+0000 7fa849400640 1 --2- 172.21.15.106:0/2957311048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa84c0ce790 0x7fa84c159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.431+0000 7fa84a800640 1 -- 172.21.15.106:0/2957311048 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa84c0cc700 msgr2=0x7fa84c15b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.431+0000 7fa84a800640 1 --2- 172.21.15.106:0/2957311048 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa84c0cc700 0x7fa84c15b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.431+0000 7fa84a800640 1 -- 172.21.15.106:0/2957311048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa84c0ce790 msgr2=0x7fa84c159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.431+0000 7fa84a800640 1 --2- 172.21.15.106:0/2957311048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa84c0ce790 0x7fa84c159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.431+0000 7fa84a800640 1 -- 172.21.15.106:0/2957311048 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa844009ae0 con 0x7fa84c158e50 2024-08-17T02:28:19.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.431+0000 7fa84a800640 1 --2- 172.21.15.106:0/2957311048 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa84c158e50 0x7fa84c15a120 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa84400c0c0 tx=0x7fa84400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:19.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.432+0000 7fa841600640 1 -- 172.21.15.106:0/2957311048 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844018070 con 0x7fa84c158e50 2024-08-17T02:28:19.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.432+0000 7fa841600640 1 -- 172.21.15.106:0/2957311048 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84400f040 con 0x7fa84c158e50 2024-08-17T02:28:19.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.432+0000 7fa84b200640 1 -- 172.21.15.106:0/2957311048 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa83c009390 con 0x7fa84c158e50 2024-08-17T02:28:19.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.432+0000 7fa841600640 1 -- 172.21.15.106:0/2957311048 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844009300 con 0x7fa84c158e50 2024-08-17T02:28:19.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.432+0000 7fa84b200640 1 -- 172.21.15.106:0/2957311048 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa84c0c3300 con 0x7fa84c158e50 2024-08-17T02:28:19.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.433+0000 7fa84b200640 1 -- 172.21.15.106:0/2957311048 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa84c0c3820 con 0x7fa84c158e50 2024-08-17T02:28:19.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.434+0000 7fa841600640 1 -- 172.21.15.106:0/2957311048 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa844003020 con 0x7fa84c158e50 2024-08-17T02:28:19.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.434+0000 7fa841600640 1 --2- 172.21.15.106:0/2957311048 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa82c065180 0x7fa82c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.434+0000 7fa841600640 1 -- 172.21.15.106:0/2957311048 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa8440823a0 con 0x7fa84c158e50 2024-08-17T02:28:19.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.435+0000 7fa849e00640 1 --2- 172.21.15.106:0/2957311048 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa82c065180 0x7fa82c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.435+0000 7fa849e00640 1 --2- 172.21.15.106:0/2957311048 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa82c065180 0x7fa82c067630 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa83c034000 tx=0x7fa83c032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:19.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.442+0000 7fa841600640 1 -- 172.21.15.106:0/2957311048 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa84404de40 con 0x7fa84c158e50 2024-08-17T02:28:19.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.620+0000 7fa84b200640 1 -- 172.21.15.106:0/2957311048 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa84c15ad10 con 0x7fa84c158e50 2024-08-17T02:28:19.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.620+0000 7fa841600640 1 -- 172.21.15.106:0/2957311048 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa84c0c3820 con 0x7fa84c158e50 2024-08-17T02:28:19.621 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-08-17T02:28:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.622+0000 7fa84b200640 1 -- 172.21.15.106:0/2957311048 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa82c065180 msgr2=0x7fa82c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.622+0000 7fa84b200640 1 --2- 172.21.15.106:0/2957311048 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa82c065180 0x7fa82c067630 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa83c034000 tx=0x7fa83c032000 comp rx=0 tx=0).stop 2024-08-17T02:28:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.622+0000 7fa84b200640 1 -- 172.21.15.106:0/2957311048 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa84c158e50 msgr2=0x7fa84c15a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.622+0000 7fa84b200640 1 --2- 172.21.15.106:0/2957311048 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa84c158e50 0x7fa84c15a120 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa84400c0c0 tx=0x7fa84400b040 comp rx=0 tx=0).stop 2024-08-17T02:28:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.622+0000 7fa84b200640 1 -- 172.21.15.106:0/2957311048 shutdown_connections 2024-08-17T02:28:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.622+0000 7fa84b200640 1 --2- 172.21.15.106:0/2957311048 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa82c065180 0x7fa82c067630 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.622+0000 7fa84b200640 1 --2- 172.21.15.106:0/2957311048 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa84c158e50 0x7fa84c15a120 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.622+0000 7fa84b200640 1 --2- 172.21.15.106:0/2957311048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa84c0ce790 0x7fa84c159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.622+0000 7fa84b200640 1 --2- 172.21.15.106:0/2957311048 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa84c0cc700 0x7fa84c15b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.622+0000 7fa84b200640 1 -- 172.21.15.106:0/2957311048 >> 172.21.15.106:0/2957311048 conn(0x7fa84c098de0 msgr2=0x7fa84c157390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:19.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.623+0000 7fa84b200640 1 -- 172.21.15.106:0/2957311048 shutdown_connections 2024-08-17T02:28:19.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.623+0000 7fa84b200640 1 -- 172.21.15.106:0/2957311048 wait complete. 2024-08-17T02:28:19.638 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:28:19.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.789+0000 7f41a7000640 1 Processor -- start 2024-08-17T02:28:19.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.789+0000 7f41a7000640 1 -- start start 2024-08-17T02:28:19.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.791+0000 7f41a7000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41a0155a80 0x7f41a006dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.791+0000 7f41a7000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f41a00c92e0 0x7f41a00aea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.791+0000 7f41a7000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a01598f0 con 0x7f41a00c7db0 2024-08-17T02:28:19.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.791+0000 7f41a7000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a0159bd0 con 0x7f41a00c92e0 2024-08-17T02:28:19.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.791+0000 7f41a7000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a0159eb0 con 0x7f41a0155a80 2024-08-17T02:28:19.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.791+0000 7f419f400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f41a00c7db0 0x7f41a00c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39694/0 (socket says 172.21.15.106:39694) 2024-08-17T02:28:19.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.791+0000 7f419f400640 1 -- 172.21.15.106:0/4294223520 learned_addr learned my addr 172.21.15.106:0/4294223520 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:19.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.791+0000 7f419fe00640 1 --2- 172.21.15.106:0/4294223520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41a0155a80 0x7f41a006dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.791+0000 7f41a5000640 1 --2- 172.21.15.106:0/4294223520 >> v2:172.21.15.171:3300/0 conn(0x7f41a00c92e0 0x7f41a00aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.791+0000 7f419ea00640 1 -- 172.21.15.106:0/4294223520 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 149147490 0 0) 0x7f41a01598f0 con 0x7f41a00c7db0 2024-08-17T02:28:19.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.791+0000 7f419ea00640 1 -- 172.21.15.106:0/4294223520 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41840034e0 con 0x7f41a00c7db0 2024-08-17T02:28:19.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.792+0000 7f419fe00640 1 -- 172.21.15.106:0/4294223520 >> v2:172.21.15.171:3300/0 conn(0x7f41a00c92e0 msgr2=0x7f41a00aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:19.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.792+0000 7f419fe00640 1 --2- 172.21.15.106:0/4294223520 >> v2:172.21.15.171:3300/0 conn(0x7f41a00c92e0 0x7f41a00aea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.792+0000 7f419fe00640 1 -- 172.21.15.106:0/4294223520 >> v1:172.21.15.106:6789/0 conn(0x7f41a00c7db0 legacy=0x7f41a00c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.792+0000 7f419ea00640 1 -- 172.21.15.106:0/4294223520 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2304828904 0 0) 0x7f41840034e0 con 0x7f41a00c7db0 2024-08-17T02:28:19.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.792+0000 7f419fe00640 1 -- 172.21.15.106:0/4294223520 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a015a190 con 0x7f41a0155a80 2024-08-17T02:28:19.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.792+0000 7f41a5000640 1 --2- 172.21.15.106:0/4294223520 >> v2:172.21.15.171:3300/0 conn(0x7f41a00c92e0 0x7f41a00aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:19.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.793+0000 7f419fe00640 1 --2- 172.21.15.106:0/4294223520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41a0155a80 0x7f41a006dc00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4190009850 tx=0x7f41900090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4178a99c2bad24d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:19.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.793+0000 7f419ea00640 1 -- 172.21.15.106:0/4294223520 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c001470 con 0x7f41a0155a80 2024-08-17T02:28:19.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.793+0000 7f419ea00640 1 -- 172.21.15.106:0/4294223520 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419002aae0 con 0x7f41a0155a80 2024-08-17T02:28:19.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.793+0000 7f419ea00640 1 -- 172.21.15.106:0/4294223520 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419002ae80 con 0x7f41a0155a80 2024-08-17T02:28:19.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.794+0000 7f41a7000640 1 -- 172.21.15.106:0/4294223520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41a0155a80 msgr2=0x7f41a006dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.794+0000 7f41a7000640 1 --2- 172.21.15.106:0/4294223520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41a0155a80 0x7f41a006dc00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4190009850 tx=0x7f41900090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.794+0000 7f41a7000640 1 -- 172.21.15.106:0/4294223520 shutdown_connections 2024-08-17T02:28:19.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.794+0000 7f41a7000640 1 --2- 172.21.15.106:0/4294223520 >> v2:172.21.15.171:3300/0 conn(0x7f41a00c92e0 0x7f41a00aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.794+0000 7f41a7000640 1 --2- 172.21.15.106:0/4294223520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41a0155a80 0x7f41a006dc00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.794+0000 7f41a7000640 1 -- 172.21.15.106:0/4294223520 >> 172.21.15.106:0/4294223520 conn(0x7f41a0067750 msgr2=0x7f41a00c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:19.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.794+0000 7f41a7000640 1 -- 172.21.15.106:0/4294223520 shutdown_connections 2024-08-17T02:28:19.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.794+0000 7f41a7000640 1 -- 172.21.15.106:0/4294223520 wait complete. 2024-08-17T02:28:19.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.795+0000 7f41a7000640 1 Processor -- start 2024-08-17T02:28:19.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.795+0000 7f41a7000640 1 -- start start 2024-08-17T02:28:19.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.796+0000 7f41a7000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41a00c7db0 0x7f41a0149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.796+0000 7f41a7000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41a00c92e0 0x7f41a0150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.796+0000 7f41a7000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a0155a80 0x7f41a0154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.796+0000 7f41a7000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a01568a0 con 0x7f41a0155a80 2024-08-17T02:28:19.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.796+0000 7f41a7000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a0149bd0 con 0x7f41a00c7db0 2024-08-17T02:28:19.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.796+0000 7f41a7000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a014f7a0 con 0x7f41a00c92e0 2024-08-17T02:28:19.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.797+0000 7f41a5000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a0155a80 0x7f41a0154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.797+0000 7f41a5000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a0155a80 0x7f41a0154420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44646/0 (socket says 172.21.15.106:44646) 2024-08-17T02:28:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.797+0000 7f41a5000640 1 -- 172.21.15.106:0/681621104 learned_addr learned my addr 172.21.15.106:0/681621104 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.797+0000 7f419fe00640 1 --2- 172.21.15.106:0/681621104 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41a00c7db0 0x7f41a0149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.797+0000 7f419f400640 1 --2- 172.21.15.106:0/681621104 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41a00c92e0 0x7f41a0150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.797+0000 7f41a5000640 1 -- 172.21.15.106:0/681621104 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41a00c92e0 msgr2=0x7f41a0150020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.797+0000 7f41a5000640 1 --2- 172.21.15.106:0/681621104 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41a00c92e0 0x7f41a0150020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.797+0000 7f41a5000640 1 -- 172.21.15.106:0/681621104 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41a00c7db0 msgr2=0x7f41a0149690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.797+0000 7f41a5000640 1 --2- 172.21.15.106:0/681621104 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41a00c7db0 0x7f41a0149690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.797+0000 7f41a5000640 1 -- 172.21.15.106:0/681621104 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4198009a20 con 0x7f41a0155a80 2024-08-17T02:28:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.797+0000 7f419f400640 1 --2- 172.21.15.106:0/681621104 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41a00c92e0 0x7f41a0150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.797+0000 7f41a5000640 1 --2- 172.21.15.106:0/681621104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a0155a80 0x7f41a0154420 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4198009f60 tx=0x7f419800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.797+0000 7f4197400640 1 -- 172.21.15.106:0/681621104 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419800ce10 con 0x7f41a0155a80 2024-08-17T02:28:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.797+0000 7f4197400640 1 -- 172.21.15.106:0/681621104 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419800f040 con 0x7f41a0155a80 2024-08-17T02:28:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.798+0000 7f4197400640 1 -- 172.21.15.106:0/681621104 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41980146d0 con 0x7f41a0155a80 2024-08-17T02:28:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.798+0000 7f41a7000640 1 -- 172.21.15.106:0/681621104 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4190009390 con 0x7f41a0155a80 2024-08-17T02:28:19.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.798+0000 7f41a7000640 1 -- 172.21.15.106:0/681621104 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a0156250 con 0x7f41a0155a80 2024-08-17T02:28:19.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.799+0000 7f41a7000640 1 -- 172.21.15.106:0/681621104 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a0156a50 con 0x7f41a0155a80 2024-08-17T02:28:19.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.799+0000 7f4197400640 1 -- 172.21.15.106:0/681621104 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4198003020 con 0x7f41a0155a80 2024-08-17T02:28:19.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.800+0000 7f4197400640 1 --2- 172.21.15.106:0/681621104 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4180065150 0x7f4180067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:19.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.800+0000 7f4197400640 1 -- 172.21.15.106:0/681621104 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4198082fd0 con 0x7f41a0155a80 2024-08-17T02:28:19.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.801+0000 7f419fe00640 1 --2- 172.21.15.106:0/681621104 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4180065150 0x7f4180067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:19.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.801+0000 7f419fe00640 1 --2- 172.21.15.106:0/681621104 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4180065150 0x7f4180067600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4190034000 tx=0x7f4190032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:19.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.804+0000 7f4197400640 1 -- 172.21.15.106:0/681621104 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f41a0156a50 con 0x7f41a0155a80 2024-08-17T02:28:19.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.975+0000 7f41a7000640 1 -- 172.21.15.106:0/681621104 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f41a0071050 con 0x7f41a0155a80 2024-08-17T02:28:19.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.975+0000 7f4197400640 1 -- 172.21.15.106:0/681621104 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4198050ff0 con 0x7f41a0155a80 2024-08-17T02:28:19.976 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-08-17T02:28:19.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.978+0000 7f41a7000640 1 -- 172.21.15.106:0/681621104 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4180065150 msgr2=0x7f4180067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.978+0000 7f41a7000640 1 --2- 172.21.15.106:0/681621104 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4180065150 0x7f4180067600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4190034000 tx=0x7f4190032000 comp rx=0 tx=0).stop 2024-08-17T02:28:19.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.978+0000 7f41a7000640 1 -- 172.21.15.106:0/681621104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a0155a80 msgr2=0x7f41a0154420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:19.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.978+0000 7f41a7000640 1 --2- 172.21.15.106:0/681621104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a0155a80 0x7f41a0154420 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4198009f60 tx=0x7f419800b040 comp rx=0 tx=0).stop 2024-08-17T02:28:19.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.978+0000 7f41a7000640 1 -- 172.21.15.106:0/681621104 shutdown_connections 2024-08-17T02:28:19.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.978+0000 7f41a7000640 1 --2- 172.21.15.106:0/681621104 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4180065150 0x7f4180067600 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.978+0000 7f41a7000640 1 --2- 172.21.15.106:0/681621104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41a0155a80 0x7f41a0154420 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.978+0000 7f41a7000640 1 --2- 172.21.15.106:0/681621104 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f41a00c92e0 0x7f41a0150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.978+0000 7f41a7000640 1 --2- 172.21.15.106:0/681621104 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41a00c7db0 0x7f41a0149690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:19.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.978+0000 7f41a7000640 1 -- 172.21.15.106:0/681621104 >> 172.21.15.106:0/681621104 conn(0x7f41a0067750 msgr2=0x7f41a015f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:19.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.978+0000 7f41a7000640 1 -- 172.21.15.106:0/681621104 shutdown_connections 2024-08-17T02:28:19.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:19.978+0000 7f41a7000640 1 -- 172.21.15.106:0/681621104 wait complete. 2024-08-17T02:28:19.993 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:28:20.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.144+0000 7fcee5800640 1 Processor -- start 2024-08-17T02:28:20.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.144+0000 7fcee5800640 1 -- start start 2024-08-17T02:28:20.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.145+0000 7fcee5800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcee0158a30 0x7fcee00c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.145+0000 7fcee5800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fcee00ce890 0x7fcee00cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.145+0000 7fcee5800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee00c61d0 con 0x7fcee00c4a20 2024-08-17T02:28:20.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.145+0000 7fcee5800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee00c64b0 con 0x7fcee00ce890 2024-08-17T02:28:20.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.145+0000 7fcee5800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee00c6790 con 0x7fcee0158a30 2024-08-17T02:28:20.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.146+0000 7fcedfe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcee0158a30 0x7fcee00c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.146+0000 7fcedfe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcee0158a30 0x7fcee00c58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:60800/0 (socket says 172.21.15.106:60800) 2024-08-17T02:28:20.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.146+0000 7fcedfe00640 1 -- 172.21.15.106:0/3492920475 learned_addr learned my addr 172.21.15.106:0/3492920475 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:20.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.146+0000 7fcee4e00640 1 --2- 172.21.15.106:0/3492920475 >> v2:172.21.15.171:3300/0 conn(0x7fcee00ce890 0x7fcee00cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.146+0000 7fcedfe00640 1 -- 172.21.15.106:0/3492920475 >> v2:172.21.15.171:3300/0 conn(0x7fcee00ce890 msgr2=0x7fcee00cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:20.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.146+0000 7fcedfe00640 1 --2- 172.21.15.106:0/3492920475 >> v2:172.21.15.171:3300/0 conn(0x7fcee00ce890 0x7fcee00cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.146+0000 7fcedfe00640 1 -- 172.21.15.106:0/3492920475 >> v1:172.21.15.171:6789/0 conn(0x7fcee00c4a20 legacy=0x7fcee00ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.146+0000 7fcedfe00640 1 -- 172.21.15.106:0/3492920475 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee00cab70 con 0x7fcee0158a30 2024-08-17T02:28:20.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.146+0000 7fcedf400640 1 -- 172.21.15.106:0/3492920475 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2138703289 0 0) 0x7fcee00c61d0 con 0x7fcee00c4a20 2024-08-17T02:28:20.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.147+0000 7fcedfe00640 1 --2- 172.21.15.106:0/3492920475 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcee0158a30 0x7fcee00c58d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fced0009910 tx=0x7fced00091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f48227a4c7ecb1a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.147+0000 7fcedf400640 1 -- 172.21.15.106:0/3492920475 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced002ae40 con 0x7fcee0158a30 2024-08-17T02:28:20.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.147+0000 7fcedf400640 1 -- 172.21.15.106:0/3492920475 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced0032440 con 0x7fcee0158a30 2024-08-17T02:28:20.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.147+0000 7fcedf400640 1 -- 172.21.15.106:0/3492920475 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced00327e0 con 0x7fcee0158a30 2024-08-17T02:28:20.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.148+0000 7fcee5800640 1 -- 172.21.15.106:0/3492920475 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcee0158a30 msgr2=0x7fcee00c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.148+0000 7fcee5800640 1 --2- 172.21.15.106:0/3492920475 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcee0158a30 0x7fcee00c58d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fced0009910 tx=0x7fced00091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.148+0000 7fcee5800640 1 -- 172.21.15.106:0/3492920475 shutdown_connections 2024-08-17T02:28:20.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.148+0000 7fcee5800640 1 --2- 172.21.15.106:0/3492920475 >> v2:172.21.15.171:3300/0 conn(0x7fcee00ce890 0x7fcee00cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.148+0000 7fcee5800640 1 --2- 172.21.15.106:0/3492920475 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcee0158a30 0x7fcee00c58d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.148+0000 7fcee5800640 1 -- 172.21.15.106:0/3492920475 >> 172.21.15.106:0/3492920475 conn(0x7fcee0098e30 msgr2=0x7fcee006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:20.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.148+0000 7fcee5800640 1 -- 172.21.15.106:0/3492920475 shutdown_connections 2024-08-17T02:28:20.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.148+0000 7fcee5800640 1 -- 172.21.15.106:0/3492920475 wait complete. 2024-08-17T02:28:20.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.149+0000 7fcee5800640 1 Processor -- start 2024-08-17T02:28:20.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.150+0000 7fcee5800640 1 -- start start 2024-08-17T02:28:20.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.150+0000 7fcee5800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcee00c4a20 0x7fcee0168c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.150+0000 7fcee5800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcee00ce890 0x7fcee00c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.150+0000 7fcee5800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcee0158a30 0x7fcee0153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.150+0000 7fcee5800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee01692f0 con 0x7fcee00ce890 2024-08-17T02:28:20.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.150+0000 7fcee5800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee01695d0 con 0x7fcee0158a30 2024-08-17T02:28:20.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.150+0000 7fcee5800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee01698b0 con 0x7fcee00c4a20 2024-08-17T02:28:20.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.151+0000 7fced7400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcee00ce890 0x7fcee00c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.151+0000 7fced7400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcee00ce890 0x7fcee00c8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44660/0 (socket says 172.21.15.106:44660) 2024-08-17T02:28:20.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.151+0000 7fced7400640 1 -- 172.21.15.106:0/3659342175 learned_addr learned my addr 172.21.15.106:0/3659342175 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:20.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.151+0000 7fcedfe00640 1 --2- 172.21.15.106:0/3659342175 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcee00c4a20 0x7fcee0168c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.151+0000 7fcee4e00640 1 --2- 172.21.15.106:0/3659342175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcee0158a30 0x7fcee0153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.151+0000 7fced7400640 1 -- 172.21.15.106:0/3659342175 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcee00c4a20 msgr2=0x7fcee0168c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.151+0000 7fced7400640 1 --2- 172.21.15.106:0/3659342175 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcee00c4a20 0x7fcee0168c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.151+0000 7fced7400640 1 -- 172.21.15.106:0/3659342175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcee0158a30 msgr2=0x7fcee0153ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.151+0000 7fced7400640 1 --2- 172.21.15.106:0/3659342175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcee0158a30 0x7fcee0153ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.151+0000 7fced7400640 1 -- 172.21.15.106:0/3659342175 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced0009450 con 0x7fcee00ce890 2024-08-17T02:28:20.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.151+0000 7fced7400640 1 --2- 172.21.15.106:0/3659342175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcee00ce890 0x7fcee00c8ed0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcec800c5b0 tx=0x7fcec8007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.152+0000 7fced7e00640 1 -- 172.21.15.106:0/3659342175 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec8012630 con 0x7fcee00ce890 2024-08-17T02:28:20.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.152+0000 7fced7e00640 1 -- 172.21.15.106:0/3659342175 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec80127d0 con 0x7fcee00ce890 2024-08-17T02:28:20.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.152+0000 7fced7e00640 1 -- 172.21.15.106:0/3659342175 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec8012b90 con 0x7fcee00ce890 2024-08-17T02:28:20.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.152+0000 7fcee5800640 1 -- 172.21.15.106:0/3659342175 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee0169b90 con 0x7fcee00ce890 2024-08-17T02:28:20.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.152+0000 7fcee5800640 1 -- 172.21.15.106:0/3659342175 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee00c9410 con 0x7fcee00ce890 2024-08-17T02:28:20.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.153+0000 7fcee5800640 1 -- 172.21.15.106:0/3659342175 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee0099a60 con 0x7fcee00ce890 2024-08-17T02:28:20.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.154+0000 7fced7e00640 1 -- 172.21.15.106:0/3659342175 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcec801b400 con 0x7fcee00ce890 2024-08-17T02:28:20.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.155+0000 7fced7e00640 1 --2- 172.21.15.106:0/3659342175 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcebc065150 0x7fcebc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.155+0000 7fced7e00640 1 -- 172.21.15.106:0/3659342175 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcec8081fc0 con 0x7fcee00ce890 2024-08-17T02:28:20.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.155+0000 7fcedfe00640 1 --2- 172.21.15.106:0/3659342175 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcebc065150 0x7fcebc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.155+0000 7fcedfe00640 1 --2- 172.21.15.106:0/3659342175 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcebc065150 0x7fcebc067600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fced0034000 tx=0x7fced0032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.158+0000 7fced7e00640 1 -- 172.21.15.106:0/3659342175 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcec8050090 con 0x7fcee00ce890 2024-08-17T02:28:20.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.334+0000 7fcee5800640 1 -- 172.21.15.106:0/3659342175 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcee0071050 con 0x7fcee00ce890 2024-08-17T02:28:20.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.334+0000 7fced7e00640 1 -- 172.21.15.106:0/3659342175 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcec80536b0 con 0x7fcee00ce890 2024-08-17T02:28:20.335 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-08-17T02:28:20.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.337+0000 7fcee5800640 1 -- 172.21.15.106:0/3659342175 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcebc065150 msgr2=0x7fcebc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.337+0000 7fcee5800640 1 --2- 172.21.15.106:0/3659342175 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcebc065150 0x7fcebc067600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fced0034000 tx=0x7fced0032000 comp rx=0 tx=0).stop 2024-08-17T02:28:20.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.337+0000 7fcee5800640 1 -- 172.21.15.106:0/3659342175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcee00ce890 msgr2=0x7fcee00c8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.337+0000 7fcee5800640 1 --2- 172.21.15.106:0/3659342175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcee00ce890 0x7fcee00c8ed0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcec800c5b0 tx=0x7fcec8007d60 comp rx=0 tx=0).stop 2024-08-17T02:28:20.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.337+0000 7fcee5800640 1 -- 172.21.15.106:0/3659342175 shutdown_connections 2024-08-17T02:28:20.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.337+0000 7fcee5800640 1 --2- 172.21.15.106:0/3659342175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcee0158a30 0x7fcee0153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.337+0000 7fcee5800640 1 --2- 172.21.15.106:0/3659342175 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcebc065150 0x7fcebc067600 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.337+0000 7fcee5800640 1 --2- 172.21.15.106:0/3659342175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcee00ce890 0x7fcee00c8ed0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.337+0000 7fcee5800640 1 --2- 172.21.15.106:0/3659342175 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcee00c4a20 0x7fcee0168c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.337+0000 7fcee5800640 1 -- 172.21.15.106:0/3659342175 >> 172.21.15.106:0/3659342175 conn(0x7fcee0098e30 msgr2=0x7fcee00cded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:20.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.337+0000 7fcee5800640 1 -- 172.21.15.106:0/3659342175 shutdown_connections 2024-08-17T02:28:20.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.337+0000 7fcee5800640 1 -- 172.21.15.106:0/3659342175 wait complete. 2024-08-17T02:28:20.352 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:20.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.498+0000 7f9be2600640 1 Processor -- start 2024-08-17T02:28:20.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.499+0000 7f9be2600640 1 -- start start 2024-08-17T02:28:20.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.500+0000 7f9be2600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bdc156ad0 0x7f9bdc0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.500+0000 7f9be2600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bdc0caaf0 con 0x7f9bdc156ea0 2024-08-17T02:28:20.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.500+0000 7f9be2600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bdc0cad90 con 0x7f9bdc06dc80 2024-08-17T02:28:20.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.500+0000 7f9be2600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc0ca900 con 0x7f9bdc156ad0 2024-08-17T02:28:20.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.500+0000 7f9bdbe00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f9bdc156ea0 0x7f9bdc06d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39708/0 (socket says 172.21.15.106:39708) 2024-08-17T02:28:20.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.500+0000 7f9bdbe00640 1 -- 172.21.15.106:0/240018736 learned_addr learned my addr 172.21.15.106:0/240018736 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:20.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.500+0000 7f9be1200640 1 --2- 172.21.15.106:0/240018736 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bdc156ad0 0x7f9bdc0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.501+0000 7f9bdb400640 1 -- 172.21.15.106:0/240018736 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562837787 0 0) 0x7f9bdc0caaf0 con 0x7f9bdc156ea0 2024-08-17T02:28:20.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.501+0000 7f9bdb400640 1 -- 172.21.15.106:0/240018736 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bc40034e0 con 0x7f9bdc156ea0 2024-08-17T02:28:20.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.501+0000 7f9bdb400640 1 -- 172.21.15.106:0/240018736 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2403628237 0 0) 0x7f9bc40034e0 con 0x7f9bdc156ea0 2024-08-17T02:28:20.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.501+0000 7f9bdb400640 1 -- 172.21.15.106:0/240018736 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bdc156ad0 msgr2=0x7f9bdc0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:20.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.501+0000 7f9bdb400640 1 --2- 172.21.15.106:0/240018736 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bdc156ad0 0x7f9bdc0cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.501+0000 7f9bdb400640 1 -- 172.21.15.106:0/240018736 >> v1:172.21.15.171:6789/0 conn(0x7f9bdc06dc80 legacy=0x7f9bdc1577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.501+0000 7f9bdb400640 1 -- 172.21.15.106:0/240018736 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bdc0cb070 con 0x7f9bdc156ea0 2024-08-17T02:28:20.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.501+0000 7f9bdb400640 1 -- 172.21.15.106:0/240018736 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7f9bc8001470 con 0x7f9bdc156ea0 2024-08-17T02:28:20.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.501+0000 7f9bdb400640 1 -- 172.21.15.106:0/240018736 >> v1:172.21.15.106:6789/0 conn(0x7f9bdc156ea0 legacy=0x7f9bdc06d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.501+0000 7f9bdb400640 1 --2- 172.21.15.106:0/240018736 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bdc156ad0 0x7f9bc4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.501+0000 7f9bdb400640 1 --2- 172.21.15.106:0/240018736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bc4003f40 0x7f9bc4004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.501+0000 7f9bdb400640 1 --2- 172.21.15.106:0/240018736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bc4004cc0 0x7f9bc4005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.501+0000 7f9bdb400640 1 -- 172.21.15.106:0/240018736 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc400ba80 con 0x7f9bc4004cc0 2024-08-17T02:28:20.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.501+0000 7f9bdb400640 1 -- 172.21.15.106:0/240018736 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc400bbf0 con 0x7f9bc4003f40 2024-08-17T02:28:20.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.501+0000 7f9bdb400640 1 -- 172.21.15.106:0/240018736 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc400bdb0 con 0x7f9bdc156ad0 2024-08-17T02:28:20.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.501+0000 7f9be1c00640 1 --2- 172.21.15.106:0/240018736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bc4004cc0 0x7f9bc4005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.501+0000 7f9be1200640 1 --2- 172.21.15.106:0/240018736 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bdc156ad0 0x7f9bc4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.501+0000 7f9bdbe00640 1 --2- 172.21.15.106:0/240018736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bc4003f40 0x7f9bc4004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.502+0000 7f9be1c00640 1 -- 172.21.15.106:0/240018736 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bdc156ad0 msgr2=0x7f9bc4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:20.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.502+0000 7f9be1c00640 1 --2- 172.21.15.106:0/240018736 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bdc156ad0 0x7f9bc4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.502+0000 7f9be1c00640 1 -- 172.21.15.106:0/240018736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bc4003f40 msgr2=0x7f9bc4004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:20.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.502+0000 7f9be1c00640 1 --2- 172.21.15.106:0/240018736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bc4003f40 0x7f9bc4004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.502+0000 7f9be1c00640 1 -- 172.21.15.106:0/240018736 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc40034e0 con 0x7f9bc4004cc0 2024-08-17T02:28:20.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.503+0000 7f9be1c00640 1 --2- 172.21.15.106:0/240018736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bc4004cc0 0x7f9bc4005130 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9bd40020d0 tx=0x7f9bd4007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754e311eebbed088 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.503+0000 7f9bdb400640 1 -- 172.21.15.106:0/240018736 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd4031440 con 0x7f9bc4004cc0 2024-08-17T02:28:20.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.503+0000 7f9bdb400640 1 -- 172.21.15.106:0/240018736 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd402d050 con 0x7f9bc4004cc0 2024-08-17T02:28:20.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.503+0000 7f9bdb400640 1 -- 172.21.15.106:0/240018736 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd4031850 con 0x7f9bc4004cc0 2024-08-17T02:28:20.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.503+0000 7f9be2600640 1 -- 172.21.15.106:0/240018736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bc4004cc0 msgr2=0x7f9bc4005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.503+0000 7f9be2600640 1 --2- 172.21.15.106:0/240018736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bc4004cc0 0x7f9bc4005130 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9bd40020d0 tx=0x7f9bd4007f90 comp rx=0 tx=0).stop 2024-08-17T02:28:20.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.503+0000 7f9be1c00640 1 -- 172.21.15.106:0/240018736 reap_dead start 2024-08-17T02:28:20.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.503+0000 7f9be2600640 1 -- 172.21.15.106:0/240018736 shutdown_connections 2024-08-17T02:28:20.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.503+0000 7f9be2600640 1 -- 172.21.15.106:0/240018736 >> 172.21.15.106:0/240018736 conn(0x7f9bdc067750 msgr2=0x7f9bdc0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:20.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.504+0000 7f9be2600640 1 -- 172.21.15.106:0/240018736 shutdown_connections 2024-08-17T02:28:20.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.504+0000 7f9be2600640 1 -- 172.21.15.106:0/240018736 wait complete. 2024-08-17T02:28:20.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.505+0000 7f9be2600640 1 Processor -- start 2024-08-17T02:28:20.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.505+0000 7f9be2600640 1 -- start start 2024-08-17T02:28:20.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.506+0000 7f9be2600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bc4004cc0 0x7f9bdc14b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.506+0000 7f9be2600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bdc166830 0x7f9bdc151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.506+0000 7f9be2600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bdc14fbf0 0x7f9bdc0c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.506+0000 7f9be2600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc0c09a0 con 0x7f9bc4004cc0 2024-08-17T02:28:20.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.506+0000 7f9be2600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc14bc00 con 0x7f9bdc14fbf0 2024-08-17T02:28:20.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.506+0000 7f9be2600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc152860 con 0x7f9bdc166830 2024-08-17T02:28:20.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.506+0000 7f9be1200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bc4004cc0 0x7f9bdc14b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.506+0000 7f9be1200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bc4004cc0 0x7f9bdc14b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44672/0 (socket says 172.21.15.106:44672) 2024-08-17T02:28:20.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.506+0000 7f9be1200640 1 -- 172.21.15.106:0/3419909155 learned_addr learned my addr 172.21.15.106:0/3419909155 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:20.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.506+0000 7f9be1200640 1 -- 172.21.15.106:0/3419909155 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bdc166830 msgr2=0x7f9bdc151f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.506+0000 7f9be1200640 1 --2- 172.21.15.106:0/3419909155 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bdc166830 0x7f9bdc151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.506+0000 7f9be1200640 1 -- 172.21.15.106:0/3419909155 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bdc14fbf0 msgr2=0x7f9bdc0c1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.506+0000 7f9be1200640 1 --2- 172.21.15.106:0/3419909155 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bdc14fbf0 0x7f9bdc0c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.506+0000 7f9be1200640 1 -- 172.21.15.106:0/3419909155 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bdc152b40 con 0x7f9bc4004cc0 2024-08-17T02:28:20.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.507+0000 7f9be1200640 1 --2- 172.21.15.106:0/3419909155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bc4004cc0 0x7f9bdc14b6c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0011b40 tx=0x7f9bd00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.507+0000 7f9bcfe00640 1 -- 172.21.15.106:0/3419909155 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd000fb00 con 0x7f9bc4004cc0 2024-08-17T02:28:20.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.507+0000 7f9bcfe00640 1 -- 172.21.15.106:0/3419909155 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd000fc60 con 0x7f9bc4004cc0 2024-08-17T02:28:20.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.507+0000 7f9bcfe00640 1 -- 172.21.15.106:0/3419909155 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0014440 con 0x7f9bc4004cc0 2024-08-17T02:28:20.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.507+0000 7f9be2600640 1 -- 172.21.15.106:0/3419909155 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bdc152e20 con 0x7f9bc4004cc0 2024-08-17T02:28:20.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.507+0000 7f9be2600640 1 -- 172.21.15.106:0/3419909155 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bdc1524c0 con 0x7f9bc4004cc0 2024-08-17T02:28:20.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.508+0000 7f9be2600640 1 -- 172.21.15.106:0/3419909155 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bdc071050 con 0x7f9bc4004cc0 2024-08-17T02:28:20.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.509+0000 7f9bcfe00640 1 -- 172.21.15.106:0/3419909155 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9bd00147f0 con 0x7f9bc4004cc0 2024-08-17T02:28:20.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.510+0000 7f9bcfe00640 1 --2- 172.21.15.106:0/3419909155 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9bbc065150 0x7f9bbc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.510+0000 7f9bcfe00640 1 -- 172.21.15.106:0/3419909155 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9bd0018030 con 0x7f9bc4004cc0 2024-08-17T02:28:20.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.510+0000 7f9bdbe00640 1 --2- 172.21.15.106:0/3419909155 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9bbc065150 0x7f9bbc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.511+0000 7f9bdbe00640 1 --2- 172.21.15.106:0/3419909155 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9bbc065150 0x7f9bbc067600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc167b20 tx=0x7f9bc8001500 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.514+0000 7f9bcfe00640 1 -- 172.21.15.106:0/3419909155 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9bd0086030 con 0x7f9bc4004cc0 2024-08-17T02:28:20.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.686+0000 7f9be2600640 1 -- 172.21.15.106:0/3419909155 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9bdc06f480 con 0x7f9bc4004cc0 2024-08-17T02:28:20.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.687+0000 7f9bcfe00640 1 -- 172.21.15.106:0/3419909155 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f9bd0022020 con 0x7f9bc4004cc0 2024-08-17T02:28:20.688 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:20.688 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:27:52.284039+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:48.547438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:49.671073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:20.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.689+0000 7f9be2600640 1 -- 172.21.15.106:0/3419909155 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9bbc065150 msgr2=0x7f9bbc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.689+0000 7f9be2600640 1 --2- 172.21.15.106:0/3419909155 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9bbc065150 0x7f9bbc067600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc167b20 tx=0x7f9bc8001500 comp rx=0 tx=0).stop 2024-08-17T02:28:20.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.689+0000 7f9be2600640 1 -- 172.21.15.106:0/3419909155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bc4004cc0 msgr2=0x7f9bdc14b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.689+0000 7f9be2600640 1 --2- 172.21.15.106:0/3419909155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bc4004cc0 0x7f9bdc14b6c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0011b40 tx=0x7f9bd00090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.689+0000 7f9be2600640 1 -- 172.21.15.106:0/3419909155 shutdown_connections 2024-08-17T02:28:20.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.689+0000 7f9be2600640 1 --2- 172.21.15.106:0/3419909155 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bdc14fbf0 0x7f9bdc0c1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.689+0000 7f9be2600640 1 --2- 172.21.15.106:0/3419909155 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bdc166830 0x7f9bdc151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.689+0000 7f9be2600640 1 --2- 172.21.15.106:0/3419909155 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9bbc065150 0x7f9bbc067600 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.689+0000 7f9be2600640 1 --2- 172.21.15.106:0/3419909155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bc4004cc0 0x7f9bdc14b6c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.689+0000 7f9be2600640 1 -- 172.21.15.106:0/3419909155 >> 172.21.15.106:0/3419909155 conn(0x7f9bdc067750 msgr2=0x7f9bdc155430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:20.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.690+0000 7f9be2600640 1 -- 172.21.15.106:0/3419909155 shutdown_connections 2024-08-17T02:28:20.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.690+0000 7f9be2600640 1 -- 172.21.15.106:0/3419909155 wait complete. 2024-08-17T02:28:20.705 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:37.928826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:48.547438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:49.671073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:28:20.705 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:28:20.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.855+0000 7f28bda00640 1 Processor -- start 2024-08-17T02:28:20.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.855+0000 7f28bda00640 1 -- start start 2024-08-17T02:28:20.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.856+0000 7f28bda00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f28b80afd90 0x7f28b80b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.856+0000 7f28bda00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b80ae540 con 0x7f28b8159610 2024-08-17T02:28:20.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.856+0000 7f28bda00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b80ad930 con 0x7f28b80accf0 2024-08-17T02:28:20.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.856+0000 7f28bda00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b80adc10 con 0x7f28b80afd90 2024-08-17T02:28:20.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.857+0000 7f28b6000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f28b80afd90 0x7f28b80b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.857+0000 7f28b6000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f28b80afd90 0x7f28b80b1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44674/0 (socket says 172.21.15.106:44674) 2024-08-17T02:28:20.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.857+0000 7f28b6000640 1 -- 172.21.15.106:0/569800430 learned_addr learned my addr 172.21.15.106:0/569800430 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:20.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.857+0000 7f28b7400640 1 --1- 172.21.15.106:0/569800430 >> v1:172.21.15.106:6789/0 conn(0x7f28b8159610 0x7f28b8157690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39710/0 (socket says 172.21.15.106:39710) 2024-08-17T02:28:20.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.857+0000 7f28b6000640 1 -- 172.21.15.106:0/569800430 >> v1:172.21.15.171:6789/0 conn(0x7f28b80accf0 legacy=0x7f28b80af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.857+0000 7f28b6000640 1 -- 172.21.15.106:0/569800430 >> v1:172.21.15.106:6789/0 conn(0x7f28b8159610 legacy=0x7f28b8157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.857+0000 7f28b6000640 1 -- 172.21.15.106:0/569800430 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b80adef0 con 0x7f28b80afd90 2024-08-17T02:28:20.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.858+0000 7f28b6000640 1 --2- 172.21.15.106:0/569800430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28b80afd90 0x7f28b80b1670 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f28a4009910 tx=0x7f28a40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147b93822834803d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.858+0000 7f28b5600640 1 -- 172.21.15.106:0/569800430 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a4032440 con 0x7f28b80afd90 2024-08-17T02:28:20.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.858+0000 7f28b5600640 1 -- 172.21.15.106:0/569800430 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a40325a0 con 0x7f28b80afd90 2024-08-17T02:28:20.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.858+0000 7f28b5600640 1 -- 172.21.15.106:0/569800430 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a4032980 con 0x7f28b80afd90 2024-08-17T02:28:20.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.859+0000 7f28bda00640 1 -- 172.21.15.106:0/569800430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28b80afd90 msgr2=0x7f28b80b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.859+0000 7f28bda00640 1 --2- 172.21.15.106:0/569800430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28b80afd90 0x7f28b80b1670 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f28a4009910 tx=0x7f28a40091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.859+0000 7f28bda00640 1 -- 172.21.15.106:0/569800430 shutdown_connections 2024-08-17T02:28:20.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.859+0000 7f28bda00640 1 --2- 172.21.15.106:0/569800430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28b80afd90 0x7f28b80b1670 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.859+0000 7f28bda00640 1 -- 172.21.15.106:0/569800430 >> 172.21.15.106:0/569800430 conn(0x7f28b8067750 msgr2=0x7f28b80cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:20.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.859+0000 7f28bda00640 1 -- 172.21.15.106:0/569800430 shutdown_connections 2024-08-17T02:28:20.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.859+0000 7f28bda00640 1 -- 172.21.15.106:0/569800430 wait complete. 2024-08-17T02:28:20.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.860+0000 7f28bda00640 1 Processor -- start 2024-08-17T02:28:20.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.861+0000 7f28bda00640 1 -- start start 2024-08-17T02:28:20.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.861+0000 7f28bda00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28b80accf0 0x7f28b8169780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.861+0000 7f28bda00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28b80afd90 0x7f28b80ab850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.861+0000 7f28bda00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28b8159610 0x7f28b8154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.861+0000 7f28bda00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b8169cc0 con 0x7f28b8159610 2024-08-17T02:28:20.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.861+0000 7f28bda00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b80abd90 con 0x7f28b80accf0 2024-08-17T02:28:20.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.861+0000 7f28bda00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b816a760 con 0x7f28b80afd90 2024-08-17T02:28:20.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.862+0000 7f28b7400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28b8159610 0x7f28b8154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.862+0000 7f28b7400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28b8159610 0x7f28b8154f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44684/0 (socket says 172.21.15.106:44684) 2024-08-17T02:28:20.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.862+0000 7f28b7400640 1 -- 172.21.15.106:0/2068856858 learned_addr learned my addr 172.21.15.106:0/2068856858 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:20.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.862+0000 7f28b6a00640 1 --2- 172.21.15.106:0/2068856858 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28b80accf0 0x7f28b8169780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.862+0000 7f28b6000640 1 --2- 172.21.15.106:0/2068856858 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28b80afd90 0x7f28b80ab850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.862+0000 7f28b7400640 1 -- 172.21.15.106:0/2068856858 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28b80afd90 msgr2=0x7f28b80ab850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.862+0000 7f28b7400640 1 --2- 172.21.15.106:0/2068856858 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28b80afd90 0x7f28b80ab850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.862+0000 7f28b7400640 1 -- 172.21.15.106:0/2068856858 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28b80accf0 msgr2=0x7f28b8169780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:20.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.862+0000 7f28b7400640 1 --2- 172.21.15.106:0/2068856858 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28b80accf0 0x7f28b8169780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:20.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.862+0000 7f28b7400640 1 -- 172.21.15.106:0/2068856858 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a4009450 con 0x7f28b8159610 2024-08-17T02:28:20.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.862+0000 7f28b7400640 1 --2- 172.21.15.106:0/2068856858 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28b8159610 0x7f28b8154f80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f28b000c870 tx=0x7f28b00015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.863+0000 7f28ae000640 1 -- 172.21.15.106:0/2068856858 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b000ce60 con 0x7f28b8159610 2024-08-17T02:28:20.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.863+0000 7f28ae000640 1 -- 172.21.15.106:0/2068856858 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b0005d60 con 0x7f28b8159610 2024-08-17T02:28:20.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.863+0000 7f28ae000640 1 -- 172.21.15.106:0/2068856858 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b000a810 con 0x7f28b8159610 2024-08-17T02:28:20.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.863+0000 7f28bda00640 1 -- 172.21.15.106:0/2068856858 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b814e0c0 con 0x7f28b8159610 2024-08-17T02:28:20.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.863+0000 7f28bda00640 1 -- 172.21.15.106:0/2068856858 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b816a1a0 con 0x7f28b8159610 2024-08-17T02:28:20.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.864+0000 7f28bda00640 1 -- 172.21.15.106:0/2068856858 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b814e250 con 0x7f28b8159610 2024-08-17T02:28:20.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.865+0000 7f28ae000640 1 -- 172.21.15.106:0/2068856858 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f28b000abc0 con 0x7f28b8159610 2024-08-17T02:28:20.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.865+0000 7f28ae000640 1 --2- 172.21.15.106:0/2068856858 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2898065150 0x7f2898067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:20.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.865+0000 7f28ae000640 1 -- 172.21.15.106:0/2068856858 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f28b0081fe0 con 0x7f28b8159610 2024-08-17T02:28:20.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.866+0000 7f28b6a00640 1 --2- 172.21.15.106:0/2068856858 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2898065150 0x7f2898067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:20.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.866+0000 7f28b6a00640 1 --2- 172.21.15.106:0/2068856858 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2898065150 0x7f2898067600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f28a8007fd0 tx=0x7f28a8007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:20.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:20.869+0000 7f28ae000640 1 -- 172.21.15.106:0/2068856858 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f28b0050130 con 0x7f28b8159610 2024-08-17T02:28:21.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.041+0000 7f28bda00640 1 -- 172.21.15.106:0/2068856858 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28b8064db0 con 0x7f28b8159610 2024-08-17T02:28:21.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.041+0000 7f28ae000640 1 -- 172.21.15.106:0/2068856858 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f28b0053750 con 0x7f28b8159610 2024-08-17T02:28:21.042 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-08-17T02:28:21.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.043+0000 7f28bda00640 1 -- 172.21.15.106:0/2068856858 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2898065150 msgr2=0x7f2898067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.043+0000 7f28bda00640 1 --2- 172.21.15.106:0/2068856858 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2898065150 0x7f2898067600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f28a8007fd0 tx=0x7f28a8007e30 comp rx=0 tx=0).stop 2024-08-17T02:28:21.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.043+0000 7f28bda00640 1 -- 172.21.15.106:0/2068856858 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28b8159610 msgr2=0x7f28b8154f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.043+0000 7f28bda00640 1 --2- 172.21.15.106:0/2068856858 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28b8159610 0x7f28b8154f80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f28b000c870 tx=0x7f28b00015f0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.044+0000 7f28bda00640 1 -- 172.21.15.106:0/2068856858 shutdown_connections 2024-08-17T02:28:21.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.044+0000 7f28bda00640 1 --2- 172.21.15.106:0/2068856858 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2898065150 0x7f2898067600 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.044+0000 7f28bda00640 1 --2- 172.21.15.106:0/2068856858 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28b8159610 0x7f28b8154f80 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.044+0000 7f28bda00640 1 --2- 172.21.15.106:0/2068856858 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f28b80afd90 0x7f28b80ab850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.044+0000 7f28bda00640 1 --2- 172.21.15.106:0/2068856858 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28b80accf0 0x7f28b8169780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.044+0000 7f28bda00640 1 -- 172.21.15.106:0/2068856858 >> 172.21.15.106:0/2068856858 conn(0x7f28b8067750 msgr2=0x7f28b80af3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:21.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.044+0000 7f28bda00640 1 -- 172.21.15.106:0/2068856858 shutdown_connections 2024-08-17T02:28:21.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.044+0000 7f28bda00640 1 -- 172.21.15.106:0/2068856858 wait complete. 2024-08-17T02:28:21.059 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:28:21.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.208+0000 7f12f6000640 1 Processor -- start 2024-08-17T02:28:21.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.208+0000 7f12f6000640 1 -- start start 2024-08-17T02:28:21.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.209+0000 7f12f6000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f12f0155a80 0x7f12f006dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.209+0000 7f12f6000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12f00c7db0 0x7f12f00c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.209+0000 7f12f6000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f12f0155e50 0x7f12f00c9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.209+0000 7f12f6000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f01598f0 con 0x7f12f0155a80 2024-08-17T02:28:21.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.209+0000 7f12f6000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f0159bd0 con 0x7f12f0155e50 2024-08-17T02:28:21.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.209+0000 7f12f6000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f0159eb0 con 0x7f12f00c7db0 2024-08-17T02:28:21.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.209+0000 7f12ef400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f12f0155a80 0x7f12f006dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.209+0000 7f12ef400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f12f0155a80 0x7f12f006dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44700/0 (socket says 172.21.15.106:44700) 2024-08-17T02:28:21.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.209+0000 7f12ef400640 1 -- 172.21.15.106:0/2238305764 learned_addr learned my addr 172.21.15.106:0/2238305764 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:21.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.210+0000 7f12efe00640 1 --2- 172.21.15.106:0/2238305764 >> v2:172.21.15.171:3300/0 conn(0x7f12f0155e50 0x7f12f00c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.210+0000 7f12e6a00640 1 --2- 172.21.15.106:0/2238305764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12f00c7db0 0x7f12f00c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.210+0000 7f12ef400640 1 -- 172.21.15.106:0/2238305764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12f00c7db0 msgr2=0x7f12f00c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:21.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.210+0000 7f12ef400640 1 --2- 172.21.15.106:0/2238305764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12f00c7db0 0x7f12f00c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.210+0000 7f12ef400640 1 -- 172.21.15.106:0/2238305764 >> v2:172.21.15.171:3300/0 conn(0x7f12f0155e50 msgr2=0x7f12f00c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:21.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.210+0000 7f12ef400640 1 --2- 172.21.15.106:0/2238305764 >> v2:172.21.15.171:3300/0 conn(0x7f12f0155e50 0x7f12f00c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.210+0000 7f12ef400640 1 -- 172.21.15.106:0/2238305764 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f015a190 con 0x7f12f0155a80 2024-08-17T02:28:21.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.210+0000 7f12efe00640 1 --2- 172.21.15.106:0/2238305764 >> v2:172.21.15.171:3300/0 conn(0x7f12f0155e50 0x7f12f00c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:21.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.211+0000 7f12ef400640 1 --2- 172.21.15.106:0/2238305764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12f0155a80 0x7f12f006dc00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f12f0070b00 tx=0x7f12e00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ec5aead6dbefb9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.211+0000 7f12eea00640 1 -- 172.21.15.106:0/2238305764 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e002add0 con 0x7f12f0155a80 2024-08-17T02:28:21.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.211+0000 7f12eea00640 1 -- 172.21.15.106:0/2238305764 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e0032440 con 0x7f12f0155a80 2024-08-17T02:28:21.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.211+0000 7f12eea00640 1 -- 172.21.15.106:0/2238305764 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e0032820 con 0x7f12f0155a80 2024-08-17T02:28:21.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.211+0000 7f12f6000640 1 -- 172.21.15.106:0/2238305764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12f0155a80 msgr2=0x7f12f006dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.211+0000 7f12f6000640 1 --2- 172.21.15.106:0/2238305764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12f0155a80 0x7f12f006dc00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f12f0070b00 tx=0x7f12e00091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.212+0000 7f12f6000640 1 -- 172.21.15.106:0/2238305764 shutdown_connections 2024-08-17T02:28:21.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.212+0000 7f12f6000640 1 --2- 172.21.15.106:0/2238305764 >> v2:172.21.15.171:3300/0 conn(0x7f12f0155e50 0x7f12f00c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.212+0000 7f12f6000640 1 --2- 172.21.15.106:0/2238305764 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12f00c7db0 0x7f12f00c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.212+0000 7f12f6000640 1 --2- 172.21.15.106:0/2238305764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12f0155a80 0x7f12f006dc00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.212+0000 7f12f6000640 1 -- 172.21.15.106:0/2238305764 >> 172.21.15.106:0/2238305764 conn(0x7f12f0067750 msgr2=0x7f12f00c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:21.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.212+0000 7f12f6000640 1 -- 172.21.15.106:0/2238305764 shutdown_connections 2024-08-17T02:28:21.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.212+0000 7f12f6000640 1 -- 172.21.15.106:0/2238305764 wait complete. 2024-08-17T02:28:21.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.213+0000 7f12f6000640 1 Processor -- start 2024-08-17T02:28:21.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.213+0000 7f12f6000640 1 -- start start 2024-08-17T02:28:21.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.214+0000 7f12f6000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12f00c7db0 0x7f12f00aa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.214+0000 7f12f6000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12f0155a80 0x7f12f01699e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.214+0000 7f12f6000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12f0155e50 0x7f12f01473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.214+0000 7f12f6000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f0169550 con 0x7f12f0155a80 2024-08-17T02:28:21.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.214+0000 7f12f6000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f0154e40 con 0x7f12f0155e50 2024-08-17T02:28:21.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.214+0000 7f12f6000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f0159170 con 0x7f12f00c7db0 2024-08-17T02:28:21.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.214+0000 7f12e6a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12f0155a80 0x7f12f01699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.215+0000 7f12e6a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12f0155a80 0x7f12f01699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44714/0 (socket says 172.21.15.106:44714) 2024-08-17T02:28:21.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.215+0000 7f12e6a00640 1 -- 172.21.15.106:0/906596264 learned_addr learned my addr 172.21.15.106:0/906596264 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:21.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.215+0000 7f12ef400640 1 --2- 172.21.15.106:0/906596264 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12f00c7db0 0x7f12f00aa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.215+0000 7f12efe00640 1 --2- 172.21.15.106:0/906596264 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12f0155e50 0x7f12f01473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.215+0000 7f12e6a00640 1 -- 172.21.15.106:0/906596264 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12f00c7db0 msgr2=0x7f12f00aa2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.215+0000 7f12e6a00640 1 --2- 172.21.15.106:0/906596264 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12f00c7db0 0x7f12f00aa2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.215+0000 7f12e6a00640 1 -- 172.21.15.106:0/906596264 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12f0155e50 msgr2=0x7f12f01473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.215+0000 7f12e6a00640 1 --2- 172.21.15.106:0/906596264 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12f0155e50 0x7f12f01473b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.215+0000 7f12e6a00640 1 -- 172.21.15.106:0/906596264 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e0009450 con 0x7f12f0155a80 2024-08-17T02:28:21.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.215+0000 7f12e6a00640 1 --2- 172.21.15.106:0/906596264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12f0155a80 0x7f12f01699e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f12d800d8c0 tx=0x7f12d8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.215+0000 7f12e7400640 1 -- 172.21.15.106:0/906596264 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d800de50 con 0x7f12f0155a80 2024-08-17T02:28:21.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.215+0000 7f12e7400640 1 -- 172.21.15.106:0/906596264 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d800b8d0 con 0x7f12f0155a80 2024-08-17T02:28:21.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.215+0000 7f12e7400640 1 -- 172.21.15.106:0/906596264 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d800bc70 con 0x7f12f0155a80 2024-08-17T02:28:21.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.215+0000 7f12f6000640 1 -- 172.21.15.106:0/906596264 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f0154b60 con 0x7f12f0155a80 2024-08-17T02:28:21.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.216+0000 7f12f6000640 1 -- 172.21.15.106:0/906596264 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f0154810 con 0x7f12f0155a80 2024-08-17T02:28:21.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.217+0000 7f12f6000640 1 -- 172.21.15.106:0/906596264 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f0169700 con 0x7f12f0155a80 2024-08-17T02:28:21.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.217+0000 7f12e7400640 1 -- 172.21.15.106:0/906596264 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f12d8014640 con 0x7f12f0155a80 2024-08-17T02:28:21.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.218+0000 7f12e7400640 1 --2- 172.21.15.106:0/906596264 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f12cc065150 0x7f12cc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.218+0000 7f12e7400640 1 -- 172.21.15.106:0/906596264 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f12d8082960 con 0x7f12f0155a80 2024-08-17T02:28:21.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.218+0000 7f12ef400640 1 --2- 172.21.15.106:0/906596264 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f12cc065150 0x7f12cc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.219+0000 7f12ef400640 1 --2- 172.21.15.106:0/906596264 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f12cc065150 0x7f12cc067600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f12e0034000 tx=0x7f12e0032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.222+0000 7f12e7400640 1 -- 172.21.15.106:0/906596264 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f12f0169700 con 0x7f12f0155a80 2024-08-17T02:28:21.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.395+0000 7f12f6000640 1 -- 172.21.15.106:0/906596264 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f12f0169700 con 0x7f12f0155a80 2024-08-17T02:28:21.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.395+0000 7f12e7400640 1 -- 172.21.15.106:0/906596264 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f12f0169700 con 0x7f12f0155a80 2024-08-17T02:28:21.396 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-08-17T02:28:21.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.397+0000 7f12f6000640 1 -- 172.21.15.106:0/906596264 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f12cc065150 msgr2=0x7f12cc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.397+0000 7f12f6000640 1 --2- 172.21.15.106:0/906596264 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f12cc065150 0x7f12cc067600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f12e0034000 tx=0x7f12e0032000 comp rx=0 tx=0).stop 2024-08-17T02:28:21.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.397+0000 7f12f6000640 1 -- 172.21.15.106:0/906596264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12f0155a80 msgr2=0x7f12f01699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.397+0000 7f12f6000640 1 --2- 172.21.15.106:0/906596264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12f0155a80 0x7f12f01699e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f12d800d8c0 tx=0x7f12d8008040 comp rx=0 tx=0).stop 2024-08-17T02:28:21.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.398+0000 7f12f6000640 1 -- 172.21.15.106:0/906596264 shutdown_connections 2024-08-17T02:28:21.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.398+0000 7f12f6000640 1 --2- 172.21.15.106:0/906596264 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f12f0155e50 0x7f12f01473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.398+0000 7f12f6000640 1 --2- 172.21.15.106:0/906596264 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f12cc065150 0x7f12cc067600 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.398+0000 7f12f6000640 1 --2- 172.21.15.106:0/906596264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12f0155a80 0x7f12f01699e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.398+0000 7f12f6000640 1 --2- 172.21.15.106:0/906596264 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f12f00c7db0 0x7f12f00aa2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.398+0000 7f12f6000640 1 -- 172.21.15.106:0/906596264 >> 172.21.15.106:0/906596264 conn(0x7f12f0067750 msgr2=0x7f12f00afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:21.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.398+0000 7f12f6000640 1 -- 172.21.15.106:0/906596264 shutdown_connections 2024-08-17T02:28:21.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.398+0000 7f12f6000640 1 -- 172.21.15.106:0/906596264 wait complete. 2024-08-17T02:28:21.413 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:28:21.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.563+0000 7f9e29000640 1 Processor -- start 2024-08-17T02:28:21.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.563+0000 7f9e29000640 1 -- start start 2024-08-17T02:28:21.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.564+0000 7f9e29000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9e24155a80 0x7f9e2406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.564+0000 7f9e29000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9e240c7db0 0x7f9e240c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.564+0000 7f9e29000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e241598f0 con 0x7f9e24155e50 2024-08-17T02:28:21.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.564+0000 7f9e29000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e24159bd0 con 0x7f9e240c7db0 2024-08-17T02:28:21.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.564+0000 7f9e29000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e24159eb0 con 0x7f9e24155a80 2024-08-17T02:28:21.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.564+0000 7f9e21400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9e240c7db0 0x7f9e240c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.564+0000 7f9e21400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9e240c7db0 0x7f9e240c8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44722/0 (socket says 172.21.15.106:44722) 2024-08-17T02:28:21.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.564+0000 7f9e21400640 1 -- 172.21.15.106:0/870189425 learned_addr learned my addr 172.21.15.106:0/870189425 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:21.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.564+0000 7f9e21e00640 1 --2- 172.21.15.106:0/870189425 >> v2:172.21.15.171:3300/0 conn(0x7f9e24155a80 0x7f9e2406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.565+0000 7f9e21400640 1 -- 172.21.15.106:0/870189425 >> v2:172.21.15.171:3300/0 conn(0x7f9e24155a80 msgr2=0x7f9e2406dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:21.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.565+0000 7f9e21400640 1 --2- 172.21.15.106:0/870189425 >> v2:172.21.15.171:3300/0 conn(0x7f9e24155a80 0x7f9e2406dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.565+0000 7f9e21400640 1 -- 172.21.15.106:0/870189425 >> v1:172.21.15.171:6789/0 conn(0x7f9e24155e50 legacy=0x7f9e2406c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.565+0000 7f9e21400640 1 -- 172.21.15.106:0/870189425 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2415a190 con 0x7f9e240c7db0 2024-08-17T02:28:21.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.565+0000 7f9e21e00640 1 --2- 172.21.15.106:0/870189425 >> v2:172.21.15.171:3300/0 conn(0x7f9e24155a80 0x7f9e2406dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:21.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.566+0000 7f9e21400640 1 --2- 172.21.15.106:0/870189425 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e240c7db0 0x7f9e240c8bd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9e2406efd0 tx=0x7f9e100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f7ba43d7ec9a648 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.566+0000 7f9e20a00640 1 -- 172.21.15.106:0/870189425 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e10032440 con 0x7f9e240c7db0 2024-08-17T02:28:21.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.566+0000 7f9e20a00640 1 -- 172.21.15.106:0/870189425 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e100325a0 con 0x7f9e240c7db0 2024-08-17T02:28:21.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.566+0000 7f9e20a00640 1 -- 172.21.15.106:0/870189425 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e10032980 con 0x7f9e240c7db0 2024-08-17T02:28:21.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.567+0000 7f9e29000640 1 -- 172.21.15.106:0/870189425 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e240c7db0 msgr2=0x7f9e240c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.567+0000 7f9e29000640 1 --2- 172.21.15.106:0/870189425 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e240c7db0 0x7f9e240c8bd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9e2406efd0 tx=0x7f9e100091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.567+0000 7f9e29000640 1 -- 172.21.15.106:0/870189425 shutdown_connections 2024-08-17T02:28:21.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.567+0000 7f9e29000640 1 --2- 172.21.15.106:0/870189425 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e240c7db0 0x7f9e240c8bd0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.567+0000 7f9e29000640 1 --2- 172.21.15.106:0/870189425 >> v2:172.21.15.171:3300/0 conn(0x7f9e24155a80 0x7f9e2406dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.567+0000 7f9e29000640 1 -- 172.21.15.106:0/870189425 >> 172.21.15.106:0/870189425 conn(0x7f9e24067750 msgr2=0x7f9e240c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:21.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.567+0000 7f9e29000640 1 -- 172.21.15.106:0/870189425 shutdown_connections 2024-08-17T02:28:21.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.567+0000 7f9e29000640 1 -- 172.21.15.106:0/870189425 wait complete. 2024-08-17T02:28:21.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.568+0000 7f9e29000640 1 Processor -- start 2024-08-17T02:28:21.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.568+0000 7f9e29000640 1 -- start start 2024-08-17T02:28:21.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.569+0000 7f9e29000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e240c7db0 0x7f9e240ad750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.569+0000 7f9e29000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e24155a80 0x7f9e2414cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.569+0000 7f9e29000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e24155e50 0x7f9e24149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.569+0000 7f9e29000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2414d280 con 0x7f9e24155a80 2024-08-17T02:28:21.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.569+0000 7f9e29000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e24149cd0 con 0x7f9e24155e50 2024-08-17T02:28:21.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.569+0000 7f9e29000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e24156c30 con 0x7f9e240c7db0 2024-08-17T02:28:21.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.569+0000 7f9e21400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e24155a80 0x7f9e2414cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.569+0000 7f9e21400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e24155a80 0x7f9e2414cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44732/0 (socket says 172.21.15.106:44732) 2024-08-17T02:28:21.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.569+0000 7f9e21400640 1 -- 172.21.15.106:0/722896807 learned_addr learned my addr 172.21.15.106:0/722896807 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:21.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.570+0000 7f9e21e00640 1 --2- 172.21.15.106:0/722896807 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e240c7db0 0x7f9e240ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.570+0000 7f9e22800640 1 --2- 172.21.15.106:0/722896807 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e24155e50 0x7f9e24149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.570+0000 7f9e21400640 1 -- 172.21.15.106:0/722896807 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e240c7db0 msgr2=0x7f9e240ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.570+0000 7f9e21400640 1 --2- 172.21.15.106:0/722896807 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e240c7db0 0x7f9e240ad750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.570+0000 7f9e21400640 1 -- 172.21.15.106:0/722896807 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e24155e50 msgr2=0x7f9e24149790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.570+0000 7f9e21400640 1 --2- 172.21.15.106:0/722896807 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e24155e50 0x7f9e24149790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.570+0000 7f9e21400640 1 -- 172.21.15.106:0/722896807 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e10009450 con 0x7f9e24155a80 2024-08-17T02:28:21.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.570+0000 7f9e21400640 1 --2- 172.21.15.106:0/722896807 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e24155a80 0x7f9e2414cd40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9e10009210 tx=0x7f9e10032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.570+0000 7f9e19600640 1 -- 172.21.15.106:0/722896807 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e10000d10 con 0x7f9e24155a80 2024-08-17T02:28:21.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.570+0000 7f9e19600640 1 -- 172.21.15.106:0/722896807 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e10031a60 con 0x7f9e24155a80 2024-08-17T02:28:21.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.570+0000 7f9e19600640 1 -- 172.21.15.106:0/722896807 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e10031e20 con 0x7f9e24155a80 2024-08-17T02:28:21.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.570+0000 7f9e29000640 1 -- 172.21.15.106:0/722896807 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e24156370 con 0x7f9e24155a80 2024-08-17T02:28:21.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.571+0000 7f9e29000640 1 -- 172.21.15.106:0/722896807 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e241568c0 con 0x7f9e24155a80 2024-08-17T02:28:21.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.571+0000 7f9e29000640 1 -- 172.21.15.106:0/722896807 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e24156de0 con 0x7f9e24155a80 2024-08-17T02:28:21.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.572+0000 7f9e19600640 1 -- 172.21.15.106:0/722896807 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9e10039040 con 0x7f9e24155a80 2024-08-17T02:28:21.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.573+0000 7f9e19600640 1 --2- 172.21.15.106:0/722896807 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9e04065150 0x7f9e04067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.573+0000 7f9e19600640 1 -- 172.21.15.106:0/722896807 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9e100a2020 con 0x7f9e24155a80 2024-08-17T02:28:21.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.573+0000 7f9e21e00640 1 --2- 172.21.15.106:0/722896807 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9e04065150 0x7f9e04067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.574+0000 7f9e21e00640 1 --2- 172.21.15.106:0/722896807 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9e04065150 0x7f9e04067600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9e24157bb0 tx=0x7f9e14008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.577+0000 7f9e19600640 1 -- 172.21.15.106:0/722896807 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9e24156de0 con 0x7f9e24155a80 2024-08-17T02:28:21.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.747+0000 7f9e29000640 1 -- 172.21.15.106:0/722896807 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9e24156da0 con 0x7f9e24155a80 2024-08-17T02:28:21.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.747+0000 7f9e19600640 1 -- 172.21.15.106:0/722896807 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9e10037020 con 0x7f9e24155a80 2024-08-17T02:28:21.748 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-08-17T02:28:21.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.749+0000 7f9e29000640 1 -- 172.21.15.106:0/722896807 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9e04065150 msgr2=0x7f9e04067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.749+0000 7f9e29000640 1 --2- 172.21.15.106:0/722896807 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9e04065150 0x7f9e04067600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9e24157bb0 tx=0x7f9e14008040 comp rx=0 tx=0).stop 2024-08-17T02:28:21.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.749+0000 7f9e29000640 1 -- 172.21.15.106:0/722896807 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e24155a80 msgr2=0x7f9e2414cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.749+0000 7f9e29000640 1 --2- 172.21.15.106:0/722896807 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e24155a80 0x7f9e2414cd40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9e10009210 tx=0x7f9e10032000 comp rx=0 tx=0).stop 2024-08-17T02:28:21.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.749+0000 7f9e29000640 1 -- 172.21.15.106:0/722896807 shutdown_connections 2024-08-17T02:28:21.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.749+0000 7f9e29000640 1 --2- 172.21.15.106:0/722896807 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9e24155e50 0x7f9e24149790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.749+0000 7f9e29000640 1 --2- 172.21.15.106:0/722896807 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9e04065150 0x7f9e04067600 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.749+0000 7f9e29000640 1 --2- 172.21.15.106:0/722896807 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e24155a80 0x7f9e2414cd40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.749+0000 7f9e29000640 1 --2- 172.21.15.106:0/722896807 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9e240c7db0 0x7f9e240ad750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.749+0000 7f9e29000640 1 -- 172.21.15.106:0/722896807 >> 172.21.15.106:0/722896807 conn(0x7f9e24067750 msgr2=0x7f9e24150d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:21.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.749+0000 7f9e29000640 1 -- 172.21.15.106:0/722896807 shutdown_connections 2024-08-17T02:28:21.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.749+0000 7f9e29000640 1 -- 172.21.15.106:0/722896807 wait complete. 2024-08-17T02:28:21.834 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2024-08-17T02:28:21.835 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:28:21.835 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:21.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.982+0000 7fa663400640 1 Processor -- start 2024-08-17T02:28:21.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.982+0000 7fa663400640 1 -- start start 2024-08-17T02:28:21.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.983+0000 7fa663400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa65c1401b0 0x7fa65c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.983+0000 7fa663400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa65c0b1440 0x7fa65c0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.983+0000 7fa663400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa65c0caa80 con 0x7fa65c140580 2024-08-17T02:28:21.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.983+0000 7fa663400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa65c0cb450 con 0x7fa65c1401b0 2024-08-17T02:28:21.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.983+0000 7fa663400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c0c9e70 con 0x7fa65c0b1440 2024-08-17T02:28:21.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.983+0000 7fa660a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa65c1401b0 0x7fa65c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.983+0000 7fa660a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa65c1401b0 0x7fa65c0caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44744/0 (socket says 172.21.15.106:44744) 2024-08-17T02:28:21.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.983+0000 7fa660a00640 1 -- 172.21.15.106:0/87047266 learned_addr learned my addr 172.21.15.106:0/87047266 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:21.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.983+0000 7fa65be00640 1 --1- 172.21.15.106:0/87047266 >> v1:172.21.15.106:6789/0 conn(0x7fa65c140580 0x7fa65c0b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39724/0 (socket says 172.21.15.106:39724) 2024-08-17T02:28:21.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.983+0000 7fa661400640 1 --2- 172.21.15.106:0/87047266 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa65c0b1440 0x7fa65c0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.984+0000 7fa660a00640 1 -- 172.21.15.106:0/87047266 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa65c0b1440 msgr2=0x7fa65c0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:21.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.984+0000 7fa660a00640 1 --2- 172.21.15.106:0/87047266 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa65c0b1440 0x7fa65c0c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.984+0000 7fa660a00640 1 -- 172.21.15.106:0/87047266 >> v1:172.21.15.106:6789/0 conn(0x7fa65c140580 legacy=0x7fa65c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.984+0000 7fa660a00640 1 -- 172.21.15.106:0/87047266 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c0ca150 con 0x7fa65c1401b0 2024-08-17T02:28:21.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.985+0000 7fa660a00640 1 --2- 172.21.15.106:0/87047266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa65c1401b0 0x7fa65c0caf10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa650009910 tx=0x7fa6500091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=425f9f0a1e076192 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.985+0000 7fa65b400640 1 -- 172.21.15.106:0/87047266 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65002add0 con 0x7fa65c1401b0 2024-08-17T02:28:21.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.985+0000 7fa65b400640 1 -- 172.21.15.106:0/87047266 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa650032440 con 0x7fa65c1401b0 2024-08-17T02:28:21.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.985+0000 7fa65b400640 1 -- 172.21.15.106:0/87047266 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa650032820 con 0x7fa65c1401b0 2024-08-17T02:28:21.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.986+0000 7fa663400640 1 -- 172.21.15.106:0/87047266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa65c1401b0 msgr2=0x7fa65c0caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.986+0000 7fa663400640 1 --2- 172.21.15.106:0/87047266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa65c1401b0 0x7fa65c0caf10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa650009910 tx=0x7fa6500091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.986+0000 7fa663400640 1 -- 172.21.15.106:0/87047266 shutdown_connections 2024-08-17T02:28:21.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.986+0000 7fa663400640 1 --2- 172.21.15.106:0/87047266 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa65c0b1440 0x7fa65c0c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.986+0000 7fa663400640 1 --2- 172.21.15.106:0/87047266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa65c1401b0 0x7fa65c0caf10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.986+0000 7fa663400640 1 -- 172.21.15.106:0/87047266 >> 172.21.15.106:0/87047266 conn(0x7fa65c0cb9b0 msgr2=0x7fa65c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:21.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.986+0000 7fa663400640 1 -- 172.21.15.106:0/87047266 shutdown_connections 2024-08-17T02:28:21.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.986+0000 7fa663400640 1 -- 172.21.15.106:0/87047266 wait complete. 2024-08-17T02:28:21.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.987+0000 7fa663400640 1 Processor -- start 2024-08-17T02:28:21.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.987+0000 7fa663400640 1 -- start start 2024-08-17T02:28:21.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.988+0000 7fa663400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa65c0b1440 0x7fa65c0afb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.988+0000 7fa663400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa65c1401b0 0x7fa65c133210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.988+0000 7fa663400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa65c140580 0x7fa65c0ab7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.988+0000 7fa663400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c168c40 con 0x7fa65c140580 2024-08-17T02:28:21.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.988+0000 7fa663400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c0b0170 con 0x7fa65c0b1440 2024-08-17T02:28:21.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.988+0000 7fa663400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c0b0450 con 0x7fa65c1401b0 2024-08-17T02:28:21.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.988+0000 7fa661400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa65c140580 0x7fa65c0ab7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.988+0000 7fa661400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa65c140580 0x7fa65c0ab7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44758/0 (socket says 172.21.15.106:44758) 2024-08-17T02:28:21.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.988+0000 7fa661400640 1 -- 172.21.15.106:0/1919103608 learned_addr learned my addr 172.21.15.106:0/1919103608 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:21.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.989+0000 7fa65be00640 1 --2- 172.21.15.106:0/1919103608 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa65c1401b0 0x7fa65c133210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.989+0000 7fa660a00640 1 --2- 172.21.15.106:0/1919103608 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa65c0b1440 0x7fa65c0afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.989+0000 7fa661400640 1 -- 172.21.15.106:0/1919103608 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa65c1401b0 msgr2=0x7fa65c133210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.989+0000 7fa661400640 1 --2- 172.21.15.106:0/1919103608 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa65c1401b0 0x7fa65c133210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.989+0000 7fa661400640 1 -- 172.21.15.106:0/1919103608 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa65c0b1440 msgr2=0x7fa65c0afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:21.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.989+0000 7fa661400640 1 --2- 172.21.15.106:0/1919103608 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa65c0b1440 0x7fa65c0afb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:21.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.989+0000 7fa661400640 1 -- 172.21.15.106:0/1919103608 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa650009450 con 0x7fa65c140580 2024-08-17T02:28:21.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.989+0000 7fa660a00640 1 --2- 172.21.15.106:0/1919103608 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa65c0b1440 0x7fa65c0afb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:21.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.989+0000 7fa661400640 1 --2- 172.21.15.106:0/1919103608 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa65c140580 0x7fa65c0ab7e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa654009ef0 tx=0x7fa65400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.989+0000 7fa64fe00640 1 -- 172.21.15.106:0/1919103608 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65400ce10 con 0x7fa65c140580 2024-08-17T02:28:21.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.989+0000 7fa64fe00640 1 -- 172.21.15.106:0/1919103608 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65400f040 con 0x7fa65c140580 2024-08-17T02:28:21.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.989+0000 7fa64fe00640 1 -- 172.21.15.106:0/1919103608 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6540146d0 con 0x7fa65c140580 2024-08-17T02:28:21.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.989+0000 7fa663400640 1 -- 172.21.15.106:0/1919103608 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa65c0b0730 con 0x7fa65c140580 2024-08-17T02:28:21.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.990+0000 7fa663400640 1 -- 172.21.15.106:0/1919103608 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa65c133750 con 0x7fa65c140580 2024-08-17T02:28:21.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.991+0000 7fa663400640 1 -- 172.21.15.106:0/1919103608 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa65c168db0 con 0x7fa65c140580 2024-08-17T02:28:21.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.991+0000 7fa64fe00640 1 -- 172.21.15.106:0/1919103608 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa654014a80 con 0x7fa65c140580 2024-08-17T02:28:21.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.992+0000 7fa64fe00640 1 --2- 172.21.15.106:0/1919103608 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa63c065150 0x7fa63c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:21.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.992+0000 7fa64fe00640 1 -- 172.21.15.106:0/1919103608 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa654083300 con 0x7fa65c140580 2024-08-17T02:28:21.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.992+0000 7fa660a00640 1 --2- 172.21.15.106:0/1919103608 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa63c065150 0x7fa63c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:21.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.993+0000 7fa660a00640 1 --2- 172.21.15.106:0/1919103608 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa63c065150 0x7fa63c067600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa650034000 tx=0x7fa650032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:21.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:21.997+0000 7fa64fe00640 1 -- 172.21.15.106:0/1919103608 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa65c168db0 con 0x7fa65c140580 2024-08-17T02:28:22.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.168+0000 7fa663400640 1 -- 172.21.15.106:0/1919103608 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa65c168d80 con 0x7fa65c140580 2024-08-17T02:28:22.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.169+0000 7fa64fe00640 1 -- 172.21.15.106:0/1919103608 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fa654054f10 con 0x7fa65c140580 2024-08-17T02:28:22.169 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:22.170 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:27:52.284039+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:48.547438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:49.671073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:22.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.171+0000 7fa663400640 1 -- 172.21.15.106:0/1919103608 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa63c065150 msgr2=0x7fa63c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.171+0000 7fa663400640 1 --2- 172.21.15.106:0/1919103608 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa63c065150 0x7fa63c067600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa650034000 tx=0x7fa650032000 comp rx=0 tx=0).stop 2024-08-17T02:28:22.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.171+0000 7fa663400640 1 -- 172.21.15.106:0/1919103608 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa65c140580 msgr2=0x7fa65c0ab7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.171+0000 7fa663400640 1 --2- 172.21.15.106:0/1919103608 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa65c140580 0x7fa65c0ab7e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa654009ef0 tx=0x7fa65400b040 comp rx=0 tx=0).stop 2024-08-17T02:28:22.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.171+0000 7fa663400640 1 -- 172.21.15.106:0/1919103608 shutdown_connections 2024-08-17T02:28:22.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.171+0000 7fa663400640 1 --2- 172.21.15.106:0/1919103608 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa63c065150 0x7fa63c067600 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.171+0000 7fa663400640 1 --2- 172.21.15.106:0/1919103608 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa65c140580 0x7fa65c0ab7e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.171+0000 7fa663400640 1 --2- 172.21.15.106:0/1919103608 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa65c1401b0 0x7fa65c133210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.171+0000 7fa663400640 1 --2- 172.21.15.106:0/1919103608 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa65c0b1440 0x7fa65c0afb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.171+0000 7fa663400640 1 -- 172.21.15.106:0/1919103608 >> 172.21.15.106:0/1919103608 conn(0x7fa65c0cb9b0 msgr2=0x7fa65c06cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:22.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.171+0000 7fa663400640 1 -- 172.21.15.106:0/1919103608 shutdown_connections 2024-08-17T02:28:22.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.171+0000 7fa663400640 1 -- 172.21.15.106:0/1919103608 wait complete. 2024-08-17T02:28:22.186 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:37.928826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:48.547438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:49.671073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:28:22.187 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:28:22.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.337+0000 7fc732c00640 1 Processor -- start 2024-08-17T02:28:22.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.337+0000 7fc732c00640 1 -- start start 2024-08-17T02:28:22.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.338+0000 7fc732c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc72c0adec0 0x7fc72c15adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.338+0000 7fc732c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc72c157070 con 0x7fc72c0b0a80 2024-08-17T02:28:22.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.338+0000 7fc732c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc72c15b410 con 0x7fc72c157e10 2024-08-17T02:28:22.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.338+0000 7fc732c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc72c157330 con 0x7fc72c0adec0 2024-08-17T02:28:22.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.338+0000 7fc730c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc72c0adec0 0x7fc72c15adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.338+0000 7fc72be00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc72c0b0a80 0x7fc72c0ad7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39726/0 (socket says 172.21.15.106:39726) 2024-08-17T02:28:22.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.338+0000 7fc72be00640 1 -- 172.21.15.106:0/757365711 learned_addr learned my addr 172.21.15.106:0/757365711 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:22.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.338+0000 7fc730c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc72c0adec0 0x7fc72c15adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44772/0 (socket says 172.21.15.106:44772) 2024-08-17T02:28:22.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.339+0000 7fc730c00640 1 -- 172.21.15.106:0/757365711 >> v1:172.21.15.171:6789/0 conn(0x7fc72c157e10 legacy=0x7fc72c15a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:22.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.339+0000 7fc730c00640 1 -- 172.21.15.106:0/757365711 >> v1:172.21.15.106:6789/0 conn(0x7fc72c0b0a80 legacy=0x7fc72c0ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.339+0000 7fc72aa00640 1 -- 172.21.15.106:0/757365711 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842271744 0 0) 0x7fc72c157070 con 0x7fc72c0b0a80 2024-08-17T02:28:22.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.339+0000 7fc730c00640 1 -- 172.21.15.106:0/757365711 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72c157610 con 0x7fc72c0adec0 2024-08-17T02:28:22.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.340+0000 7fc730c00640 1 --2- 172.21.15.106:0/757365711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc72c0adec0 0x7fc72c15adf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc724009e60 tx=0x7fc724009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb015920bf02738d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.340+0000 7fc72aa00640 1 -- 172.21.15.106:0/757365711 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc724007550 con 0x7fc72c0adec0 2024-08-17T02:28:22.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.340+0000 7fc72aa00640 1 -- 172.21.15.106:0/757365711 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72402d050 con 0x7fc72c0adec0 2024-08-17T02:28:22.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.340+0000 7fc72aa00640 1 -- 172.21.15.106:0/757365711 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7240078e0 con 0x7fc72c0adec0 2024-08-17T02:28:22.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.341+0000 7fc732c00640 1 -- 172.21.15.106:0/757365711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc72c0adec0 msgr2=0x7fc72c15adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.341+0000 7fc732c00640 1 --2- 172.21.15.106:0/757365711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc72c0adec0 0x7fc72c15adf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc724009e60 tx=0x7fc724009780 comp rx=0 tx=0).stop 2024-08-17T02:28:22.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.341+0000 7fc732c00640 1 -- 172.21.15.106:0/757365711 shutdown_connections 2024-08-17T02:28:22.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.341+0000 7fc732c00640 1 --2- 172.21.15.106:0/757365711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc72c0adec0 0x7fc72c15adf0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.341+0000 7fc732c00640 1 -- 172.21.15.106:0/757365711 >> 172.21.15.106:0/757365711 conn(0x7fc72c067750 msgr2=0x7fc72c0cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:22.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.341+0000 7fc732c00640 1 -- 172.21.15.106:0/757365711 shutdown_connections 2024-08-17T02:28:22.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.341+0000 7fc732c00640 1 -- 172.21.15.106:0/757365711 wait complete. 2024-08-17T02:28:22.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.342+0000 7fc732c00640 1 Processor -- start 2024-08-17T02:28:22.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.342+0000 7fc732c00640 1 -- start start 2024-08-17T02:28:22.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.343+0000 7fc732c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc72c0adec0 0x7fc72c14aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.343+0000 7fc732c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc72c0b0a80 0x7fc72c14edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.343+0000 7fc732c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc72c157e10 0x7fc72c14f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.343+0000 7fc732c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c14c0e0 con 0x7fc72c0b0a80 2024-08-17T02:28:22.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.343+0000 7fc732c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c14b0e0 con 0x7fc72c0adec0 2024-08-17T02:28:22.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.343+0000 7fc732c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c14b4d0 con 0x7fc72c157e10 2024-08-17T02:28:22.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.343+0000 7fc72b400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc72c0b0a80 0x7fc72c14edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.343+0000 7fc72b400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc72c0b0a80 0x7fc72c14edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44788/0 (socket says 172.21.15.106:44788) 2024-08-17T02:28:22.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.343+0000 7fc72b400640 1 -- 172.21.15.106:0/1062228883 learned_addr learned my addr 172.21.15.106:0/1062228883 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:22.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.344+0000 7fc72be00640 1 --2- 172.21.15.106:0/1062228883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc72c0adec0 0x7fc72c14aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.344+0000 7fc730c00640 1 --2- 172.21.15.106:0/1062228883 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc72c157e10 0x7fc72c14f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.344+0000 7fc72b400640 1 -- 172.21.15.106:0/1062228883 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc72c157e10 msgr2=0x7fc72c14f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.344+0000 7fc72b400640 1 --2- 172.21.15.106:0/1062228883 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc72c157e10 0x7fc72c14f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.344+0000 7fc72b400640 1 -- 172.21.15.106:0/1062228883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc72c0adec0 msgr2=0x7fc72c14aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.344+0000 7fc72b400640 1 --2- 172.21.15.106:0/1062228883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc72c0adec0 0x7fc72c14aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.344+0000 7fc72b400640 1 -- 172.21.15.106:0/1062228883 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc724009a20 con 0x7fc72c0b0a80 2024-08-17T02:28:22.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.344+0000 7fc72b400640 1 --2- 172.21.15.106:0/1062228883 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc72c0b0a80 0x7fc72c14edd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc71800c5e0 tx=0x7fc718007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.344+0000 7fc723400640 1 -- 172.21.15.106:0/1062228883 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc718012630 con 0x7fc72c0b0a80 2024-08-17T02:28:22.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.344+0000 7fc723400640 1 -- 172.21.15.106:0/1062228883 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7180127b0 con 0x7fc72c0b0a80 2024-08-17T02:28:22.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.344+0000 7fc723400640 1 -- 172.21.15.106:0/1062228883 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc718012bb0 con 0x7fc72c0b0a80 2024-08-17T02:28:22.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.344+0000 7fc732c00640 1 -- 172.21.15.106:0/1062228883 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc72c14b7b0 con 0x7fc72c0b0a80 2024-08-17T02:28:22.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.345+0000 7fc732c00640 1 -- 172.21.15.106:0/1062228883 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc72c14bd70 con 0x7fc72c0b0a80 2024-08-17T02:28:22.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.346+0000 7fc732c00640 1 -- 172.21.15.106:0/1062228883 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc72c14c290 con 0x7fc72c0b0a80 2024-08-17T02:28:22.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.346+0000 7fc723400640 1 -- 172.21.15.106:0/1062228883 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc71801b400 con 0x7fc72c0b0a80 2024-08-17T02:28:22.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.347+0000 7fc723400640 1 --2- 172.21.15.106:0/1062228883 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc70c065150 0x7fc70c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.347+0000 7fc723400640 1 -- 172.21.15.106:0/1062228883 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc7180826f0 con 0x7fc72c0b0a80 2024-08-17T02:28:22.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.347+0000 7fc72be00640 1 --2- 172.21.15.106:0/1062228883 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc70c065150 0x7fc70c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.348+0000 7fc72be00640 1 --2- 172.21.15.106:0/1062228883 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc70c065150 0x7fc70c067600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc71c0011e0 tx=0x7fc71c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.351+0000 7fc723400640 1 -- 172.21.15.106:0/1062228883 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc72c14c290 con 0x7fc72c0b0a80 2024-08-17T02:28:22.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.523+0000 7fc732c00640 1 -- 172.21.15.106:0/1062228883 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc72c064db0 con 0x7fc72c0b0a80 2024-08-17T02:28:22.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.524+0000 7fc723400640 1 -- 172.21.15.106:0/1062228883 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc7180160a0 con 0x7fc72c0b0a80 2024-08-17T02:28:22.524 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-08-17T02:28:22.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.525+0000 7fc732c00640 1 -- 172.21.15.106:0/1062228883 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc70c065150 msgr2=0x7fc70c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.525+0000 7fc732c00640 1 --2- 172.21.15.106:0/1062228883 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc70c065150 0x7fc70c067600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc71c0011e0 tx=0x7fc71c009040 comp rx=0 tx=0).stop 2024-08-17T02:28:22.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.525+0000 7fc732c00640 1 -- 172.21.15.106:0/1062228883 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc72c0b0a80 msgr2=0x7fc72c14edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.525+0000 7fc732c00640 1 --2- 172.21.15.106:0/1062228883 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc72c0b0a80 0x7fc72c14edd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc71800c5e0 tx=0x7fc718007ed0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.526+0000 7fc732c00640 1 -- 172.21.15.106:0/1062228883 shutdown_connections 2024-08-17T02:28:22.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.526+0000 7fc732c00640 1 --2- 172.21.15.106:0/1062228883 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc72c157e10 0x7fc72c14f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.526+0000 7fc732c00640 1 --2- 172.21.15.106:0/1062228883 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc70c065150 0x7fc70c067600 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.526+0000 7fc732c00640 1 --2- 172.21.15.106:0/1062228883 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc72c0b0a80 0x7fc72c14edd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.526+0000 7fc732c00640 1 --2- 172.21.15.106:0/1062228883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc72c0adec0 0x7fc72c14aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.526+0000 7fc732c00640 1 -- 172.21.15.106:0/1062228883 >> 172.21.15.106:0/1062228883 conn(0x7fc72c067750 msgr2=0x7fc72c0cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:22.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.526+0000 7fc732c00640 1 -- 172.21.15.106:0/1062228883 shutdown_connections 2024-08-17T02:28:22.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.526+0000 7fc732c00640 1 -- 172.21.15.106:0/1062228883 wait complete. 2024-08-17T02:28:22.541 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:28:22.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.692+0000 7fda62400640 1 Processor -- start 2024-08-17T02:28:22.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.692+0000 7fda62400640 1 -- start start 2024-08-17T02:28:22.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.693+0000 7fda62400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fda5c066cd0 0x7fda5c06d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.693+0000 7fda62400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fda5c15c760 0x7fda5c15cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.693+0000 7fda62400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5c15d0c0 con 0x7fda5c0cb9f0 2024-08-17T02:28:22.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.693+0000 7fda62400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda5c1536c0 con 0x7fda5c15c760 2024-08-17T02:28:22.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.693+0000 7fda62400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda5c06d720 con 0x7fda5c066cd0 2024-08-17T02:28:22.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.693+0000 7fda61a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fda5c15c760 0x7fda5c15cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.693+0000 7fda61a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fda5c15c760 0x7fda5c15cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44792/0 (socket says 172.21.15.106:44792) 2024-08-17T02:28:22.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.693+0000 7fda61a00640 1 -- 172.21.15.106:0/2541738402 learned_addr learned my addr 172.21.15.106:0/2541738402 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:22.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.693+0000 7fda61000640 1 --1- 172.21.15.106:0/2541738402 >> v1:172.21.15.106:6789/0 conn(0x7fda5c0cb9f0 0x7fda5c0abde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39734/0 (socket says 172.21.15.106:39734) 2024-08-17T02:28:22.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.693+0000 7fda53e00640 1 --2- 172.21.15.106:0/2541738402 >> v2:172.21.15.171:3300/0 conn(0x7fda5c066cd0 0x7fda5c06d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.694+0000 7fda61a00640 1 -- 172.21.15.106:0/2541738402 >> v2:172.21.15.171:3300/0 conn(0x7fda5c066cd0 msgr2=0x7fda5c06d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:22.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.694+0000 7fda61a00640 1 --2- 172.21.15.106:0/2541738402 >> v2:172.21.15.171:3300/0 conn(0x7fda5c066cd0 0x7fda5c06d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.694+0000 7fda61a00640 1 -- 172.21.15.106:0/2541738402 >> v1:172.21.15.106:6789/0 conn(0x7fda5c0cb9f0 legacy=0x7fda5c0abde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.694+0000 7fda61a00640 1 -- 172.21.15.106:0/2541738402 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c06da00 con 0x7fda5c15c760 2024-08-17T02:28:22.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.694+0000 7fda53e00640 1 --2- 172.21.15.106:0/2541738402 >> v2:172.21.15.171:3300/0 conn(0x7fda5c066cd0 0x7fda5c06d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:22.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.695+0000 7fda61a00640 1 --2- 172.21.15.106:0/2541738402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda5c15c760 0x7fda5c15cb80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fda5c0688a0 tx=0x7fda54009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b64102bff358b3e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.695+0000 7fda5be00640 1 -- 172.21.15.106:0/2541738402 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda54007400 con 0x7fda5c15c760 2024-08-17T02:28:22.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.695+0000 7fda5be00640 1 -- 172.21.15.106:0/2541738402 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda54007560 con 0x7fda5c15c760 2024-08-17T02:28:22.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.695+0000 7fda5be00640 1 -- 172.21.15.106:0/2541738402 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda54007940 con 0x7fda5c15c760 2024-08-17T02:28:22.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.696+0000 7fda62400640 1 -- 172.21.15.106:0/2541738402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda5c15c760 msgr2=0x7fda5c15cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.696+0000 7fda62400640 1 --2- 172.21.15.106:0/2541738402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda5c15c760 0x7fda5c15cb80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fda5c0688a0 tx=0x7fda54009840 comp rx=0 tx=0).stop 2024-08-17T02:28:22.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.696+0000 7fda62400640 1 -- 172.21.15.106:0/2541738402 shutdown_connections 2024-08-17T02:28:22.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.696+0000 7fda62400640 1 --2- 172.21.15.106:0/2541738402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda5c15c760 0x7fda5c15cb80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.696+0000 7fda62400640 1 --2- 172.21.15.106:0/2541738402 >> v2:172.21.15.171:3300/0 conn(0x7fda5c066cd0 0x7fda5c06d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.696+0000 7fda62400640 1 -- 172.21.15.106:0/2541738402 >> 172.21.15.106:0/2541738402 conn(0x7fda5c0cca90 msgr2=0x7fda5c0a8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:22.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.696+0000 7fda62400640 1 -- 172.21.15.106:0/2541738402 shutdown_connections 2024-08-17T02:28:22.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.696+0000 7fda62400640 1 -- 172.21.15.106:0/2541738402 wait complete. 2024-08-17T02:28:22.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.697+0000 7fda62400640 1 Processor -- start 2024-08-17T02:28:22.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.697+0000 7fda62400640 1 -- start start 2024-08-17T02:28:22.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.698+0000 7fda62400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda5c066cd0 0x7fda5c147b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.698+0000 7fda62400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda5c0cb9f0 0x7fda5c096c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.698+0000 7fda62400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fda5c15c760 0x7fda5c0a9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.698+0000 7fda62400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c1480c0 con 0x7fda5c066cd0 2024-08-17T02:28:22.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.698+0000 7fda62400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c0976d0 con 0x7fda5c0cb9f0 2024-08-17T02:28:22.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.698+0000 7fda62400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c0979b0 con 0x7fda5c15c760 2024-08-17T02:28:22.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.698+0000 7fda61000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda5c066cd0 0x7fda5c147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.698+0000 7fda61000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda5c066cd0 0x7fda5c147b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44796/0 (socket says 172.21.15.106:44796) 2024-08-17T02:28:22.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.698+0000 7fda61000640 1 -- 172.21.15.106:0/1337121386 learned_addr learned my addr 172.21.15.106:0/1337121386 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:22.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.699+0000 7fda61a00640 1 --2- 172.21.15.106:0/1337121386 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fda5c15c760 0x7fda5c0a9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.699+0000 7fda53e00640 1 --2- 172.21.15.106:0/1337121386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda5c0cb9f0 0x7fda5c096c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.699+0000 7fda61000640 1 -- 172.21.15.106:0/1337121386 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fda5c15c760 msgr2=0x7fda5c0a9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.699+0000 7fda61000640 1 --2- 172.21.15.106:0/1337121386 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fda5c15c760 0x7fda5c0a9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.699+0000 7fda61000640 1 -- 172.21.15.106:0/1337121386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda5c0cb9f0 msgr2=0x7fda5c096c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.699+0000 7fda61000640 1 --2- 172.21.15.106:0/1337121386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda5c0cb9f0 0x7fda5c096c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.699+0000 7fda61000640 1 -- 172.21.15.106:0/1337121386 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda54009ae0 con 0x7fda5c066cd0 2024-08-17T02:28:22.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.699+0000 7fda53e00640 1 --2- 172.21.15.106:0/1337121386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda5c0cb9f0 0x7fda5c096c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:22.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.699+0000 7fda61000640 1 --2- 172.21.15.106:0/1337121386 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda5c066cd0 0x7fda5c147b80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00c4e0 tx=0x7fda4c007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.699+0000 7fda58c00640 1 -- 172.21.15.106:0/1337121386 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c0072e0 con 0x7fda5c066cd0 2024-08-17T02:28:22.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.699+0000 7fda58c00640 1 -- 172.21.15.106:0/1337121386 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4c007460 con 0x7fda5c066cd0 2024-08-17T02:28:22.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.699+0000 7fda62400640 1 -- 172.21.15.106:0/1337121386 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5c097c90 con 0x7fda5c066cd0 2024-08-17T02:28:22.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.699+0000 7fda58c00640 1 -- 172.21.15.106:0/1337121386 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c0047a0 con 0x7fda5c066cd0 2024-08-17T02:28:22.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.699+0000 7fda62400640 1 -- 172.21.15.106:0/1337121386 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5c0af130 con 0x7fda5c066cd0 2024-08-17T02:28:22.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.700+0000 7fda62400640 1 -- 172.21.15.106:0/1337121386 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda5c071050 con 0x7fda5c066cd0 2024-08-17T02:28:22.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.701+0000 7fda58c00640 1 -- 172.21.15.106:0/1337121386 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fda4c004bf0 con 0x7fda5c066cd0 2024-08-17T02:28:22.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.702+0000 7fda58c00640 1 --2- 172.21.15.106:0/1337121386 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fda38065180 0x7fda38067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.702+0000 7fda58c00640 1 -- 172.21.15.106:0/1337121386 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fda4c081da0 con 0x7fda5c066cd0 2024-08-17T02:28:22.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.702+0000 7fda53e00640 1 --2- 172.21.15.106:0/1337121386 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fda38065180 0x7fda38067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.703+0000 7fda53e00640 1 --2- 172.21.15.106:0/1337121386 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fda38065180 0x7fda38067630 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fda44006fd0 tx=0x7fda44008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.706+0000 7fda58c00640 1 -- 172.21.15.106:0/1337121386 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fda4c04fdc0 con 0x7fda5c066cd0 2024-08-17T02:28:22.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.875+0000 7fda62400640 1 -- 172.21.15.106:0/1337121386 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fda5c0b0610 con 0x7fda5c066cd0 2024-08-17T02:28:22.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.875+0000 7fda58c00640 1 -- 172.21.15.106:0/1337121386 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fda4c0533e0 con 0x7fda5c066cd0 2024-08-17T02:28:22.876 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-08-17T02:28:22.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.877+0000 7fda62400640 1 -- 172.21.15.106:0/1337121386 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fda38065180 msgr2=0x7fda38067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.877+0000 7fda62400640 1 --2- 172.21.15.106:0/1337121386 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fda38065180 0x7fda38067630 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fda44006fd0 tx=0x7fda44008040 comp rx=0 tx=0).stop 2024-08-17T02:28:22.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.877+0000 7fda62400640 1 -- 172.21.15.106:0/1337121386 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda5c066cd0 msgr2=0x7fda5c147b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.877+0000 7fda62400640 1 --2- 172.21.15.106:0/1337121386 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda5c066cd0 0x7fda5c147b80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00c4e0 tx=0x7fda4c007ee0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.878+0000 7fda62400640 1 -- 172.21.15.106:0/1337121386 shutdown_connections 2024-08-17T02:28:22.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.878+0000 7fda62400640 1 --2- 172.21.15.106:0/1337121386 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fda5c15c760 0x7fda5c0a9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.878+0000 7fda62400640 1 --2- 172.21.15.106:0/1337121386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fda5c0cb9f0 0x7fda5c096c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.878+0000 7fda62400640 1 --2- 172.21.15.106:0/1337121386 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fda38065180 0x7fda38067630 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.878+0000 7fda62400640 1 --2- 172.21.15.106:0/1337121386 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda5c066cd0 0x7fda5c147b80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.878+0000 7fda62400640 1 -- 172.21.15.106:0/1337121386 >> 172.21.15.106:0/1337121386 conn(0x7fda5c0cca90 msgr2=0x7fda5c152b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:22.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.878+0000 7fda62400640 1 -- 172.21.15.106:0/1337121386 shutdown_connections 2024-08-17T02:28:22.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:22.878+0000 7fda62400640 1 -- 172.21.15.106:0/1337121386 wait complete. 2024-08-17T02:28:22.893 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:28:23.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.043+0000 7f69c9200640 1 Processor -- start 2024-08-17T02:28:23.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.043+0000 7f69c9200640 1 -- start start 2024-08-17T02:28:23.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.044+0000 7f69c9200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69c4155a80 0x7f69c406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.044+0000 7f69c9200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f69c40c92e0 0x7f69c40aea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.044+0000 7f69c9200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69c41598f0 con 0x7f69c40c7db0 2024-08-17T02:28:23.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.044+0000 7f69c9200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69c4159bd0 con 0x7f69c40c92e0 2024-08-17T02:28:23.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.044+0000 7f69c9200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c4159eb0 con 0x7f69c4155a80 2024-08-17T02:28:23.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.045+0000 7f69c2800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f69c40c92e0 0x7f69c40aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.045+0000 7f69c2800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f69c40c92e0 0x7f69c40aea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44802/0 (socket says 172.21.15.106:44802) 2024-08-17T02:28:23.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.045+0000 7f69c2800640 1 -- 172.21.15.106:0/2080407762 learned_addr learned my addr 172.21.15.106:0/2080407762 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:23.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.045+0000 7f69c1e00640 1 --2- 172.21.15.106:0/2080407762 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69c4155a80 0x7f69c406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.045+0000 7f69c2800640 1 -- 172.21.15.106:0/2080407762 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69c4155a80 msgr2=0x7f69c406dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:23.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.045+0000 7f69c2800640 1 --2- 172.21.15.106:0/2080407762 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69c4155a80 0x7f69c406dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.045+0000 7f69c2800640 1 -- 172.21.15.106:0/2080407762 >> v1:172.21.15.171:6789/0 conn(0x7f69c40c7db0 legacy=0x7f69c40c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.045+0000 7f69c2800640 1 -- 172.21.15.106:0/2080407762 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c415a190 con 0x7f69c40c92e0 2024-08-17T02:28:23.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.046+0000 7f69c2800640 1 --2- 172.21.15.106:0/2080407762 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69c40c92e0 0x7f69c40aea40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f69bc009f20 tx=0x7f69bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77fff51eaa6d7b4c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.046+0000 7f69c1400640 1 -- 172.21.15.106:0/2080407762 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc030420 con 0x7f69c40c92e0 2024-08-17T02:28:23.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.047+0000 7f69c1400640 1 -- 172.21.15.106:0/2080407762 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69bc030580 con 0x7f69c40c92e0 2024-08-17T02:28:23.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.047+0000 7f69c1400640 1 -- 172.21.15.106:0/2080407762 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc030960 con 0x7f69c40c92e0 2024-08-17T02:28:23.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.047+0000 7f69c9200640 1 -- 172.21.15.106:0/2080407762 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69c40c92e0 msgr2=0x7f69c40aea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.047+0000 7f69c9200640 1 --2- 172.21.15.106:0/2080407762 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69c40c92e0 0x7f69c40aea40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f69bc009f20 tx=0x7f69bc009840 comp rx=0 tx=0).stop 2024-08-17T02:28:23.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.047+0000 7f69c9200640 1 -- 172.21.15.106:0/2080407762 shutdown_connections 2024-08-17T02:28:23.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.047+0000 7f69c9200640 1 --2- 172.21.15.106:0/2080407762 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69c40c92e0 0x7f69c40aea40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.047+0000 7f69c9200640 1 --2- 172.21.15.106:0/2080407762 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69c4155a80 0x7f69c406dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.047+0000 7f69c9200640 1 -- 172.21.15.106:0/2080407762 >> 172.21.15.106:0/2080407762 conn(0x7f69c4067750 msgr2=0x7f69c40c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.047+0000 7f69c9200640 1 -- 172.21.15.106:0/2080407762 shutdown_connections 2024-08-17T02:28:23.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.047+0000 7f69c9200640 1 -- 172.21.15.106:0/2080407762 wait complete. 2024-08-17T02:28:23.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.049+0000 7f69c9200640 1 Processor -- start 2024-08-17T02:28:23.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.049+0000 7f69c9200640 1 -- start start 2024-08-17T02:28:23.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.049+0000 7f69c9200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69c40c7db0 0x7f69c416a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.049+0000 7f69c9200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69c40c92e0 0x7f69c416bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.049+0000 7f69c9200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69c4155a80 0x7f69c4150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.050+0000 7f69c9200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c4150160 con 0x7f69c40c92e0 2024-08-17T02:28:23.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.050+0000 7f69c9200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c4153b00 con 0x7f69c40c7db0 2024-08-17T02:28:23.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.050+0000 7f69c9200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c41531d0 con 0x7f69c4155a80 2024-08-17T02:28:23.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.050+0000 7f69bbe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69c40c92e0 0x7f69c416bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.050+0000 7f69bbe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69c40c92e0 0x7f69c416bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44808/0 (socket says 172.21.15.106:44808) 2024-08-17T02:28:23.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.050+0000 7f69bbe00640 1 -- 172.21.15.106:0/77829191 learned_addr learned my addr 172.21.15.106:0/77829191 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:23.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.050+0000 7f69c2800640 1 --2- 172.21.15.106:0/77829191 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69c4155a80 0x7f69c4150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.050+0000 7f69c1e00640 1 --2- 172.21.15.106:0/77829191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69c40c7db0 0x7f69c416a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.050+0000 7f69bbe00640 1 -- 172.21.15.106:0/77829191 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69c4155a80 msgr2=0x7f69c4150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.050+0000 7f69bbe00640 1 --2- 172.21.15.106:0/77829191 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69c4155a80 0x7f69c4150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.050+0000 7f69bbe00640 1 -- 172.21.15.106:0/77829191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69c40c7db0 msgr2=0x7f69c416a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.050+0000 7f69bbe00640 1 --2- 172.21.15.106:0/77829191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69c40c7db0 0x7f69c416a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.050+0000 7f69bbe00640 1 -- 172.21.15.106:0/77829191 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69bc009ae0 con 0x7f69c40c92e0 2024-08-17T02:28:23.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.051+0000 7f69bbe00640 1 --2- 172.21.15.106:0/77829191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69c40c92e0 0x7f69c416bea0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f69ac00c590 tx=0x7f69ac007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.051+0000 7f69b9600640 1 -- 172.21.15.106:0/77829191 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac012630 con 0x7f69c40c92e0 2024-08-17T02:28:23.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.051+0000 7f69b9600640 1 -- 172.21.15.106:0/77829191 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ac0127b0 con 0x7f69c40c92e0 2024-08-17T02:28:23.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.051+0000 7f69b9600640 1 -- 172.21.15.106:0/77829191 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac012b70 con 0x7f69c40c92e0 2024-08-17T02:28:23.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.051+0000 7f69c9200640 1 -- 172.21.15.106:0/77829191 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69c41534b0 con 0x7f69c40c92e0 2024-08-17T02:28:23.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.051+0000 7f69c9200640 1 -- 172.21.15.106:0/77829191 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c4151030 con 0x7f69c40c92e0 2024-08-17T02:28:23.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.052+0000 7f69c9200640 1 -- 172.21.15.106:0/77829191 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c4153c90 con 0x7f69c40c92e0 2024-08-17T02:28:23.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.053+0000 7f69b9600640 1 -- 172.21.15.106:0/77829191 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f69ac01b400 con 0x7f69c40c92e0 2024-08-17T02:28:23.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.053+0000 7f69b9600640 1 --2- 172.21.15.106:0/77829191 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f69a0065150 0x7f69a0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.053+0000 7f69b9600640 1 -- 172.21.15.106:0/77829191 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f69ac081ee0 con 0x7f69c40c92e0 2024-08-17T02:28:23.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.054+0000 7f69c1e00640 1 --2- 172.21.15.106:0/77829191 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f69a0065150 0x7f69a0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.054+0000 7f69c1e00640 1 --2- 172.21.15.106:0/77829191 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f69a0065150 0x7f69a0067600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009c80 tx=0x7f69b40090f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.057+0000 7f69b9600640 1 -- 172.21.15.106:0/77829191 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f69ac04ffb0 con 0x7f69c40c92e0 2024-08-17T02:28:23.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.228+0000 7f69c9200640 1 -- 172.21.15.106:0/77829191 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f69c4071050 con 0x7f69c40c92e0 2024-08-17T02:28:23.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.228+0000 7f69b9600640 1 -- 172.21.15.106:0/77829191 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f69ac0535d0 con 0x7f69c40c92e0 2024-08-17T02:28:23.229 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-08-17T02:28:23.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.230+0000 7f69c9200640 1 -- 172.21.15.106:0/77829191 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f69a0065150 msgr2=0x7f69a0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.230+0000 7f69c9200640 1 --2- 172.21.15.106:0/77829191 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f69a0065150 0x7f69a0067600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009c80 tx=0x7f69b40090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.230+0000 7f69c9200640 1 -- 172.21.15.106:0/77829191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69c40c92e0 msgr2=0x7f69c416bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.230+0000 7f69c9200640 1 --2- 172.21.15.106:0/77829191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69c40c92e0 0x7f69c416bea0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f69ac00c590 tx=0x7f69ac007ef0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.230+0000 7f69c9200640 1 -- 172.21.15.106:0/77829191 shutdown_connections 2024-08-17T02:28:23.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.230+0000 7f69c9200640 1 --2- 172.21.15.106:0/77829191 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f69c4155a80 0x7f69c4150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.230+0000 7f69c9200640 1 --2- 172.21.15.106:0/77829191 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f69a0065150 0x7f69a0067600 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.230+0000 7f69c9200640 1 --2- 172.21.15.106:0/77829191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69c40c92e0 0x7f69c416bea0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.230+0000 7f69c9200640 1 --2- 172.21.15.106:0/77829191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69c40c7db0 0x7f69c416a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.230+0000 7f69c9200640 1 -- 172.21.15.106:0/77829191 >> 172.21.15.106:0/77829191 conn(0x7f69c4067750 msgr2=0x7f69c414dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.231+0000 7f69c9200640 1 -- 172.21.15.106:0/77829191 shutdown_connections 2024-08-17T02:28:23.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.231+0000 7f69c9200640 1 -- 172.21.15.106:0/77829191 wait complete. 2024-08-17T02:28:23.246 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:28:23.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.394+0000 7fd500e00640 1 Processor -- start 2024-08-17T02:28:23.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.394+0000 7fd500e00640 1 -- start start 2024-08-17T02:28:23.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.396+0000 7fd500e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd4fc140580 0x7fd4fc0c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.396+0000 7fd500e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4fc0caa80 con 0x7fd4fc0b1440 2024-08-17T02:28:23.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.396+0000 7fd500e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4fc0c9e70 con 0x7fd4fc1401b0 2024-08-17T02:28:23.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.396+0000 7fd500e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4fc0c9c90 con 0x7fd4fc140580 2024-08-17T02:28:23.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.396+0000 7fd4f9400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd4fc0b1440 0x7fd4fc0c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39740/0 (socket says 172.21.15.106:39740) 2024-08-17T02:28:23.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.396+0000 7fd4f9400640 1 -- 172.21.15.106:0/2047115394 learned_addr learned my addr 172.21.15.106:0/2047115394 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:23.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.396+0000 7fd4fa800640 1 --2- 172.21.15.106:0/2047115394 >> v2:172.21.15.171:3300/0 conn(0x7fd4fc140580 0x7fd4fc0c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.396+0000 7fd4f8a00640 1 -- 172.21.15.106:0/2047115394 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219448095 0 0) 0x7fd4fc0caa80 con 0x7fd4fc0b1440 2024-08-17T02:28:23.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.396+0000 7fd4f8a00640 1 -- 172.21.15.106:0/2047115394 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4e00034e0 con 0x7fd4fc0b1440 2024-08-17T02:28:23.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.396+0000 7fd4f8a00640 1 -- 172.21.15.106:0/2047115394 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970854264 0 0) 0x7fd4fc0c9e70 con 0x7fd4fc1401b0 2024-08-17T02:28:23.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.397+0000 7fd4f8a00640 1 -- 172.21.15.106:0/2047115394 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4fc0caa80 con 0x7fd4fc1401b0 2024-08-17T02:28:23.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.397+0000 7fd4fa800640 1 -- 172.21.15.106:0/2047115394 >> v1:172.21.15.171:6789/0 conn(0x7fd4fc1401b0 legacy=0x7fd4fc0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.397+0000 7fd4fa800640 1 -- 172.21.15.106:0/2047115394 >> v1:172.21.15.106:6789/0 conn(0x7fd4fc0b1440 legacy=0x7fd4fc0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.397+0000 7fd4fa800640 1 -- 172.21.15.106:0/2047115394 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4fc0ca150 con 0x7fd4fc140580 2024-08-17T02:28:23.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.398+0000 7fd4fa800640 1 --2- 172.21.15.106:0/2047115394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4fc140580 0x7fd4fc0c9750 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4009e60 tx=0x7fd4f4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41de39c6c1ce910a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.398+0000 7fd4f8a00640 1 -- 172.21.15.106:0/2047115394 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4007550 con 0x7fd4fc140580 2024-08-17T02:28:23.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.398+0000 7fd4f8a00640 1 -- 172.21.15.106:0/2047115394 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f402d050 con 0x7fd4fc140580 2024-08-17T02:28:23.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.398+0000 7fd4f8a00640 1 -- 172.21.15.106:0/2047115394 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f40078c0 con 0x7fd4fc140580 2024-08-17T02:28:23.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.398+0000 7fd500e00640 1 -- 172.21.15.106:0/2047115394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4fc140580 msgr2=0x7fd4fc0c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.398+0000 7fd500e00640 1 --2- 172.21.15.106:0/2047115394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4fc140580 0x7fd4fc0c9750 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4009e60 tx=0x7fd4f4009780 comp rx=0 tx=0).stop 2024-08-17T02:28:23.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.399+0000 7fd500e00640 1 -- 172.21.15.106:0/2047115394 shutdown_connections 2024-08-17T02:28:23.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.399+0000 7fd500e00640 1 --2- 172.21.15.106:0/2047115394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4fc140580 0x7fd4fc0c9750 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.399+0000 7fd500e00640 1 -- 172.21.15.106:0/2047115394 >> 172.21.15.106:0/2047115394 conn(0x7fd4fc0cb9b0 msgr2=0x7fd4fc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.399+0000 7fd500e00640 1 -- 172.21.15.106:0/2047115394 shutdown_connections 2024-08-17T02:28:23.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.399+0000 7fd500e00640 1 -- 172.21.15.106:0/2047115394 wait complete. 2024-08-17T02:28:23.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.400+0000 7fd500e00640 1 Processor -- start 2024-08-17T02:28:23.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.400+0000 7fd500e00640 1 -- start start 2024-08-17T02:28:23.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.401+0000 7fd500e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4fc0b1440 0x7fd4fc13f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.401+0000 7fd500e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4fc1401b0 0x7fd4fc0aa310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.401+0000 7fd500e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4fc140580 0x7fd4fc0aa850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.401+0000 7fd500e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc168e00 con 0x7fd4fc0b1440 2024-08-17T02:28:23.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.401+0000 7fd500e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc0aaf20 con 0x7fd4fc1401b0 2024-08-17T02:28:23.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.401+0000 7fd500e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc0c6ad0 con 0x7fd4fc140580 2024-08-17T02:28:23.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.401+0000 7fd4f9e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4fc0b1440 0x7fd4fc13f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.401+0000 7fd4f9e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4fc0b1440 0x7fd4fc13f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44822/0 (socket says 172.21.15.106:44822) 2024-08-17T02:28:23.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.401+0000 7fd4f9e00640 1 -- 172.21.15.106:0/2883150882 learned_addr learned my addr 172.21.15.106:0/2883150882 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:23.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.401+0000 7fd4f9e00640 1 -- 172.21.15.106:0/2883150882 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4fc140580 msgr2=0x7fd4fc0aa850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.401+0000 7fd4f9e00640 1 --2- 172.21.15.106:0/2883150882 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4fc140580 0x7fd4fc0aa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.401+0000 7fd4f9e00640 1 -- 172.21.15.106:0/2883150882 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4fc1401b0 msgr2=0x7fd4fc0aa310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.401+0000 7fd4f9e00640 1 --2- 172.21.15.106:0/2883150882 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4fc1401b0 0x7fd4fc0aa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.401+0000 7fd4f9e00640 1 -- 172.21.15.106:0/2883150882 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f4009a20 con 0x7fd4fc0b1440 2024-08-17T02:28:23.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.402+0000 7fd4f9e00640 1 --2- 172.21.15.106:0/2883150882 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4fc0b1440 0x7fd4fc13f1a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec002ee0 tx=0x7fd4ec007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.402+0000 7fd4f1600640 1 -- 172.21.15.106:0/2883150882 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec011590 con 0x7fd4fc0b1440 2024-08-17T02:28:23.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.402+0000 7fd4f1600640 1 -- 172.21.15.106:0/2883150882 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ec011710 con 0x7fd4fc0b1440 2024-08-17T02:28:23.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.402+0000 7fd4f1600640 1 -- 172.21.15.106:0/2883150882 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec011ad0 con 0x7fd4fc0b1440 2024-08-17T02:28:23.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.402+0000 7fd500e00640 1 -- 172.21.15.106:0/2883150882 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4fc0c6db0 con 0x7fd4fc0b1440 2024-08-17T02:28:23.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.402+0000 7fd500e00640 1 -- 172.21.15.106:0/2883150882 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4fc0ab200 con 0x7fd4fc0b1440 2024-08-17T02:28:23.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.403+0000 7fd500e00640 1 -- 172.21.15.106:0/2883150882 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4fc0c72b0 con 0x7fd4fc0b1440 2024-08-17T02:28:23.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.404+0000 7fd4f1600640 1 -- 172.21.15.106:0/2883150882 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd4ec01c460 con 0x7fd4fc0b1440 2024-08-17T02:28:23.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.405+0000 7fd4f1600640 1 --2- 172.21.15.106:0/2883150882 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd4dc065150 0x7fd4dc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.405+0000 7fd4f1600640 1 -- 172.21.15.106:0/2883150882 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd4ec082180 con 0x7fd4fc0b1440 2024-08-17T02:28:23.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.405+0000 7fd4f9400640 1 --2- 172.21.15.106:0/2883150882 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd4dc065150 0x7fd4dc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.406+0000 7fd4f9400640 1 --2- 172.21.15.106:0/2883150882 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd4dc065150 0x7fd4dc067600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8005840 tx=0x7fd4e8007940 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.409+0000 7fd4f1600640 1 -- 172.21.15.106:0/2883150882 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd4ec050240 con 0x7fd4fc0b1440 2024-08-17T02:28:23.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:23.647+0000 7fd500e00640 1 -- 172.21.15.106:0/2883150882 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7fd4fc064db0 con 0x7fd4fc0b1440 2024-08-17T02:28:24.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.419+0000 7fd4f1600640 1 -- 172.21.15.106:0/2883150882 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v58) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd4fc064db0 con 0x7fd4fc0b1440 2024-08-17T02:28:24.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.422+0000 7fd500e00640 1 -- 172.21.15.106:0/2883150882 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd4dc065150 msgr2=0x7fd4dc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.422+0000 7fd500e00640 1 --2- 172.21.15.106:0/2883150882 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd4dc065150 0x7fd4dc067600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8005840 tx=0x7fd4e8007940 comp rx=0 tx=0).stop 2024-08-17T02:28:24.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.422+0000 7fd500e00640 1 -- 172.21.15.106:0/2883150882 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4fc0b1440 msgr2=0x7fd4fc13f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.422+0000 7fd500e00640 1 --2- 172.21.15.106:0/2883150882 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4fc0b1440 0x7fd4fc13f1a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec002ee0 tx=0x7fd4ec007d30 comp rx=0 tx=0).stop 2024-08-17T02:28:24.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.422+0000 7fd500e00640 1 -- 172.21.15.106:0/2883150882 shutdown_connections 2024-08-17T02:28:24.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.422+0000 7fd500e00640 1 --2- 172.21.15.106:0/2883150882 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4fc140580 0x7fd4fc0aa850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.422+0000 7fd500e00640 1 --2- 172.21.15.106:0/2883150882 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4fc1401b0 0x7fd4fc0aa310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.422+0000 7fd500e00640 1 --2- 172.21.15.106:0/2883150882 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd4dc065150 0x7fd4dc067600 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.422+0000 7fd500e00640 1 --2- 172.21.15.106:0/2883150882 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4fc0b1440 0x7fd4fc13f1a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.422+0000 7fd500e00640 1 -- 172.21.15.106:0/2883150882 >> 172.21.15.106:0/2883150882 conn(0x7fd4fc0cb9b0 msgr2=0x7fd4fc069640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.422+0000 7fd500e00640 1 -- 172.21.15.106:0/2883150882 shutdown_connections 2024-08-17T02:28:24.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.422+0000 7fd500e00640 1 -- 172.21.15.106:0/2883150882 wait complete. 2024-08-17T02:28:24.438 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:28:24.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.590+0000 7facb7c00640 1 Processor -- start 2024-08-17T02:28:24.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.590+0000 7facb7c00640 1 -- start start 2024-08-17T02:28:24.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.591+0000 7facb7c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7facb0155a80 0x7facb006dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.591+0000 7facb7c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7facb00c92e0 0x7facb00aea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.591+0000 7facb7c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb01598f0 con 0x7facb00c7db0 2024-08-17T02:28:24.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.591+0000 7facb7c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb0159bd0 con 0x7facb00c92e0 2024-08-17T02:28:24.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.591+0000 7facb7c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb0159eb0 con 0x7facb0155a80 2024-08-17T02:28:24.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.591+0000 7facb5c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7facb00c92e0 0x7facb00aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.591+0000 7facb5c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7facb00c92e0 0x7facb00aea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44826/0 (socket says 172.21.15.106:44826) 2024-08-17T02:28:24.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.591+0000 7facb5c00640 1 -- 172.21.15.106:0/3399944123 learned_addr learned my addr 172.21.15.106:0/3399944123 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:24.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.591+0000 7faca7e00640 1 --1- 172.21.15.106:0/3399944123 >> v1:172.21.15.106:6789/0 conn(0x7facb00c7db0 0x7facb00c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39742/0 (socket says 172.21.15.106:39742) 2024-08-17T02:28:24.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.592+0000 7facb5200640 1 --2- 172.21.15.106:0/3399944123 >> v2:172.21.15.171:3300/0 conn(0x7facb0155a80 0x7facb006dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.592+0000 7facb5c00640 1 -- 172.21.15.106:0/3399944123 >> v2:172.21.15.171:3300/0 conn(0x7facb0155a80 msgr2=0x7facb006dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:24.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.592+0000 7facb5c00640 1 --2- 172.21.15.106:0/3399944123 >> v2:172.21.15.171:3300/0 conn(0x7facb0155a80 0x7facb006dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.592+0000 7facb5c00640 1 -- 172.21.15.106:0/3399944123 >> v1:172.21.15.106:6789/0 conn(0x7facb00c7db0 legacy=0x7facb00c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.592+0000 7facb5c00640 1 -- 172.21.15.106:0/3399944123 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb015a190 con 0x7facb00c92e0 2024-08-17T02:28:24.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.593+0000 7facb5c00640 1 --2- 172.21.15.106:0/3399944123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facb00c92e0 0x7facb00aea40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7facb006efd0 tx=0x7faca8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe3e230d49fde1f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.593+0000 7facafe00640 1 -- 172.21.15.106:0/3399944123 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca8032480 con 0x7facb00c92e0 2024-08-17T02:28:24.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.593+0000 7facafe00640 1 -- 172.21.15.106:0/3399944123 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca80325e0 con 0x7facb00c92e0 2024-08-17T02:28:24.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.593+0000 7facafe00640 1 -- 172.21.15.106:0/3399944123 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca80329c0 con 0x7facb00c92e0 2024-08-17T02:28:24.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.593+0000 7facb7c00640 1 -- 172.21.15.106:0/3399944123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facb00c92e0 msgr2=0x7facb00aea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.593+0000 7facb7c00640 1 --2- 172.21.15.106:0/3399944123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facb00c92e0 0x7facb00aea40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7facb006efd0 tx=0x7faca8009840 comp rx=0 tx=0).stop 2024-08-17T02:28:24.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.594+0000 7facb7c00640 1 -- 172.21.15.106:0/3399944123 shutdown_connections 2024-08-17T02:28:24.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.594+0000 7facb7c00640 1 --2- 172.21.15.106:0/3399944123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facb00c92e0 0x7facb00aea40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.594+0000 7facb7c00640 1 --2- 172.21.15.106:0/3399944123 >> v2:172.21.15.171:3300/0 conn(0x7facb0155a80 0x7facb006dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.594+0000 7facb7c00640 1 -- 172.21.15.106:0/3399944123 >> 172.21.15.106:0/3399944123 conn(0x7facb0067750 msgr2=0x7facb00c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.594+0000 7facb7c00640 1 -- 172.21.15.106:0/3399944123 shutdown_connections 2024-08-17T02:28:24.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.594+0000 7facb7c00640 1 -- 172.21.15.106:0/3399944123 wait complete. 2024-08-17T02:28:24.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.595+0000 7facb7c00640 1 Processor -- start 2024-08-17T02:28:24.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.595+0000 7facb7c00640 1 -- start start 2024-08-17T02:28:24.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.596+0000 7facb7c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facb00c7db0 0x7facb0151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.596+0000 7facb7c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facb00c92e0 0x7facb013a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.596+0000 7facb7c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7facb0155a80 0x7facb014f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.596+0000 7facb7c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb01563f0 con 0x7facb00c7db0 2024-08-17T02:28:24.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.596+0000 7facb7c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb014efa0 con 0x7facb00c92e0 2024-08-17T02:28:24.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.596+0000 7facb7c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb0158390 con 0x7facb0155a80 2024-08-17T02:28:24.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.596+0000 7facb5200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facb00c7db0 0x7facb0151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.596+0000 7facb5200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facb00c7db0 0x7facb0151270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44842/0 (socket says 172.21.15.106:44842) 2024-08-17T02:28:24.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.596+0000 7facb5200640 1 -- 172.21.15.106:0/510475586 learned_addr learned my addr 172.21.15.106:0/510475586 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:24.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.596+0000 7facb5c00640 1 --2- 172.21.15.106:0/510475586 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7facb0155a80 0x7facb014f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.596+0000 7faca7e00640 1 --2- 172.21.15.106:0/510475586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facb00c92e0 0x7facb013a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.597+0000 7facb5200640 1 -- 172.21.15.106:0/510475586 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7facb0155a80 msgr2=0x7facb014f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.597+0000 7facb5200640 1 --2- 172.21.15.106:0/510475586 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7facb0155a80 0x7facb014f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.597+0000 7facb5200640 1 -- 172.21.15.106:0/510475586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facb00c92e0 msgr2=0x7facb013a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.597+0000 7facb5200640 1 --2- 172.21.15.106:0/510475586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facb00c92e0 0x7facb013a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.597+0000 7facb5200640 1 -- 172.21.15.106:0/510475586 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca8009ae0 con 0x7facb00c7db0 2024-08-17T02:28:24.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.597+0000 7facb5200640 1 --2- 172.21.15.106:0/510475586 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facb00c7db0 0x7facb0151270 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faca000d890 tx=0x7faca0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.597+0000 7facacc00640 1 -- 172.21.15.106:0/510475586 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca000de20 con 0x7facb00c7db0 2024-08-17T02:28:24.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.597+0000 7facacc00640 1 -- 172.21.15.106:0/510475586 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca00098b0 con 0x7facb00c7db0 2024-08-17T02:28:24.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.597+0000 7facacc00640 1 -- 172.21.15.106:0/510475586 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca0009c50 con 0x7facb00c7db0 2024-08-17T02:28:24.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.597+0000 7facb7c00640 1 -- 172.21.15.106:0/510475586 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb0158610 con 0x7facb00c7db0 2024-08-17T02:28:24.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.597+0000 7facb7c00640 1 -- 172.21.15.106:0/510475586 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb014e9e0 con 0x7facb00c7db0 2024-08-17T02:28:24.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.598+0000 7facb7c00640 1 -- 172.21.15.106:0/510475586 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb0071050 con 0x7facb00c7db0 2024-08-17T02:28:24.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.599+0000 7facacc00640 1 -- 172.21.15.106:0/510475586 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7faca0014620 con 0x7facb00c7db0 2024-08-17T02:28:24.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.600+0000 7facacc00640 1 --2- 172.21.15.106:0/510475586 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fac8c065150 0x7fac8c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.600+0000 7facacc00640 1 -- 172.21.15.106:0/510475586 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faca0082d30 con 0x7facb00c7db0 2024-08-17T02:28:24.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.600+0000 7faca7e00640 1 --2- 172.21.15.106:0/510475586 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fac8c065150 0x7fac8c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.601+0000 7faca7e00640 1 --2- 172.21.15.106:0/510475586 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fac8c065150 0x7fac8c067600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7facb0167f80 tx=0x7fac98007ce0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.604+0000 7facacc00640 1 -- 172.21.15.106:0/510475586 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7faca0050d50 con 0x7facb00c7db0 2024-08-17T02:28:24.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.778+0000 7facb7c00640 1 -- 172.21.15.106:0/510475586 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7facb006aa10 con 0x7facb00c7db0 2024-08-17T02:28:24.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.782+0000 7facacc00640 1 -- 172.21.15.106:0/510475586 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7faca0009db0 con 0x7facb00c7db0 2024-08-17T02:28:24.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.784+0000 7facb7c00640 1 -- 172.21.15.106:0/510475586 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fac8c065150 msgr2=0x7fac8c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.784+0000 7facb7c00640 1 --2- 172.21.15.106:0/510475586 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fac8c065150 0x7fac8c067600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7facb0167f80 tx=0x7fac98007ce0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.784+0000 7facb7c00640 1 -- 172.21.15.106:0/510475586 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facb00c7db0 msgr2=0x7facb0151270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.784+0000 7facb7c00640 1 --2- 172.21.15.106:0/510475586 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facb00c7db0 0x7facb0151270 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faca000d890 tx=0x7faca0008040 comp rx=0 tx=0).stop 2024-08-17T02:28:24.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.784+0000 7facb7c00640 1 -- 172.21.15.106:0/510475586 shutdown_connections 2024-08-17T02:28:24.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.784+0000 7facb7c00640 1 --2- 172.21.15.106:0/510475586 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7facb0155a80 0x7facb014f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.784+0000 7facb7c00640 1 --2- 172.21.15.106:0/510475586 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7facb00c92e0 0x7facb013a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.784+0000 7facb7c00640 1 --2- 172.21.15.106:0/510475586 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fac8c065150 0x7fac8c067600 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.784+0000 7facb7c00640 1 --2- 172.21.15.106:0/510475586 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facb00c7db0 0x7facb0151270 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.784+0000 7facb7c00640 1 -- 172.21.15.106:0/510475586 >> 172.21.15.106:0/510475586 conn(0x7facb0067750 msgr2=0x7facb00c9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.784+0000 7facb7c00640 1 -- 172.21.15.106:0/510475586 shutdown_connections 2024-08-17T02:28:24.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:24.784+0000 7facb7c00640 1 -- 172.21.15.106:0/510475586 wait complete. 2024-08-17T02:28:24.799 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:28:24.800 DEBUG:teuthology.orchestra.run.smithi106:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:28:24.892 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:28:24.990 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:28:24.991 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:28:24.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:28:24.991 DEBUG:teuthology.orchestra.run.smithi106:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-08-17T02:28:25.051 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2024-08-17T02:28:25.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:25.051 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:28:25.094 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:28:25.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:28:25.095 DEBUG:teuthology.orchestra.run.smithi171:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-08-17T02:28:25.160 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-08-17T02:28:25.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:25.160 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:28:25.211 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-08-17T02:28:25.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:28:25.211 DEBUG:teuthology.orchestra.run.smithi106:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-08-17T02:28:25.271 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2024-08-17T02:28:25.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:25.271 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-17T02:28:25.307 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-08-17T02:28:25.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:28:25.307 DEBUG:teuthology.orchestra.run.smithi171:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-08-17T02:28:25.367 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-08-17T02:28:25.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:25.368 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-17T02:28:25.404 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-17T02:28:25.405 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:25.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.552+0000 7f1e3b200640 1 Processor -- start 2024-08-17T02:28:25.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.552+0000 7f1e3b200640 1 -- start start 2024-08-17T02:28:25.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.553+0000 7f1e3b200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1e3c155900 0x7f1e3c155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.553+0000 7f1e3b200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1e3c158b30 0x7f1e3c0ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.553+0000 7f1e3b200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3c157690 con 0x7f1e3c0b0270 2024-08-17T02:28:25.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.553+0000 7f1e3b200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e3c156a80 con 0x7f1e3c155900 2024-08-17T02:28:25.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.553+0000 7f1e3b200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c156d60 con 0x7f1e3c158b30 2024-08-17T02:28:25.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.553+0000 7f1e39e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1e3c155900 0x7f1e3c155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.553+0000 7f1e31400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1e3c0b0270 0x7f1e3c156210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39748/0 (socket says 172.21.15.106:39748) 2024-08-17T02:28:25.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.553+0000 7f1e31400640 1 -- 172.21.15.106:0/584701227 learned_addr learned my addr 172.21.15.106:0/584701227 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:25.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.553+0000 7f1e3a800640 1 --2- 172.21.15.106:0/584701227 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1e3c158b30 0x7f1e3c0ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.554+0000 7f1e39e00640 1 -- 172.21.15.106:0/584701227 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1e3c158b30 msgr2=0x7f1e3c0ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:25.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.554+0000 7f1e39e00640 1 --2- 172.21.15.106:0/584701227 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1e3c158b30 0x7f1e3c0ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.554+0000 7f1e39e00640 1 -- 172.21.15.106:0/584701227 >> v1:172.21.15.106:6789/0 conn(0x7f1e3c0b0270 legacy=0x7f1e3c156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.554+0000 7f1e39e00640 1 -- 172.21.15.106:0/584701227 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3c157040 con 0x7f1e3c155900 2024-08-17T02:28:25.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.555+0000 7f1e39e00640 1 --2- 172.21.15.106:0/584701227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e3c155900 0x7f1e3c155cd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c009e60 tx=0x7f1e2c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389536b4b622335 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.555+0000 7f1e39400640 1 -- 172.21.15.106:0/584701227 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c007550 con 0x7f1e3c155900 2024-08-17T02:28:25.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.555+0000 7f1e39400640 1 -- 172.21.15.106:0/584701227 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2c02d050 con 0x7f1e3c155900 2024-08-17T02:28:25.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.555+0000 7f1e39400640 1 -- 172.21.15.106:0/584701227 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c007920 con 0x7f1e3c155900 2024-08-17T02:28:25.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.555+0000 7f1e3b200640 1 -- 172.21.15.106:0/584701227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e3c155900 msgr2=0x7f1e3c155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.555+0000 7f1e3b200640 1 --2- 172.21.15.106:0/584701227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e3c155900 0x7f1e3c155cd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c009e60 tx=0x7f1e2c009780 comp rx=0 tx=0).stop 2024-08-17T02:28:25.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.555+0000 7f1e3b200640 1 -- 172.21.15.106:0/584701227 shutdown_connections 2024-08-17T02:28:25.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.555+0000 7f1e3b200640 1 --2- 172.21.15.106:0/584701227 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1e3c158b30 0x7f1e3c0ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.555+0000 7f1e3b200640 1 --2- 172.21.15.106:0/584701227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e3c155900 0x7f1e3c155cd0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.556+0000 7f1e3b200640 1 -- 172.21.15.106:0/584701227 >> 172.21.15.106:0/584701227 conn(0x7f1e3c067750 msgr2=0x7f1e3c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:25.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.556+0000 7f1e3b200640 1 -- 172.21.15.106:0/584701227 shutdown_connections 2024-08-17T02:28:25.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.556+0000 7f1e3b200640 1 -- 172.21.15.106:0/584701227 wait complete. 2024-08-17T02:28:25.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.557+0000 7f1e3b200640 1 Processor -- start 2024-08-17T02:28:25.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.557+0000 7f1e3b200640 1 -- start start 2024-08-17T02:28:25.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.558+0000 7f1e3b200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1e3c0b0270 0x7f1e3c16bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.558+0000 7f1e3b200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1e3c155900 0x7f1e3c0c0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.558+0000 7f1e3b200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e3c158b30 0x7f1e3c168c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.558+0000 7f1e3b200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c16c040 con 0x7f1e3c158b30 2024-08-17T02:28:25.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.558+0000 7f1e3b200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c153520 con 0x7f1e3c0b0270 2024-08-17T02:28:25.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.558+0000 7f1e3b200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3c0c1870 con 0x7f1e3c155900 2024-08-17T02:28:25.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.558+0000 7f1e3a800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e3c158b30 0x7f1e3c168c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.558+0000 7f1e3a800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e3c158b30 0x7f1e3c168c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44862/0 (socket says 172.21.15.106:44862) 2024-08-17T02:28:25.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.558+0000 7f1e3a800640 1 -- 172.21.15.106:0/3610105629 learned_addr learned my addr 172.21.15.106:0/3610105629 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:25.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.558+0000 7f1e39e00640 1 --2- 172.21.15.106:0/3610105629 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1e3c0b0270 0x7f1e3c16bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.558+0000 7f1e31400640 1 --2- 172.21.15.106:0/3610105629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1e3c155900 0x7f1e3c0c0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.559+0000 7f1e3a800640 1 -- 172.21.15.106:0/3610105629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1e3c155900 msgr2=0x7f1e3c0c0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.559+0000 7f1e3a800640 1 --2- 172.21.15.106:0/3610105629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1e3c155900 0x7f1e3c0c0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.559+0000 7f1e3a800640 1 -- 172.21.15.106:0/3610105629 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1e3c0b0270 msgr2=0x7f1e3c16bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.559+0000 7f1e3a800640 1 --2- 172.21.15.106:0/3610105629 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1e3c0b0270 0x7f1e3c16bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.559+0000 7f1e3a800640 1 -- 172.21.15.106:0/3610105629 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2c009a20 con 0x7f1e3c158b30 2024-08-17T02:28:25.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.559+0000 7f1e3a800640 1 --2- 172.21.15.106:0/3610105629 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e3c158b30 0x7f1e3c168c20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1e3400e900 tx=0x7f1e340090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.559+0000 7f1e32000640 1 -- 172.21.15.106:0/3610105629 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3400c730 con 0x7f1e3c158b30 2024-08-17T02:28:25.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.559+0000 7f1e32000640 1 -- 172.21.15.106:0/3610105629 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3400c8b0 con 0x7f1e3c158b30 2024-08-17T02:28:25.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.559+0000 7f1e32000640 1 -- 172.21.15.106:0/3610105629 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3400cc70 con 0x7f1e3c158b30 2024-08-17T02:28:25.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.559+0000 7f1e3b200640 1 -- 172.21.15.106:0/3610105629 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3c152ed0 con 0x7f1e3c158b30 2024-08-17T02:28:25.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.559+0000 7f1e3b200640 1 -- 172.21.15.106:0/3610105629 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3c0c1530 con 0x7f1e3c158b30 2024-08-17T02:28:25.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.560+0000 7f1e3b200640 1 -- 172.21.15.106:0/3610105629 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e3c1536d0 con 0x7f1e3c158b30 2024-08-17T02:28:25.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.561+0000 7f1e32000640 1 -- 172.21.15.106:0/3610105629 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1e34013680 con 0x7f1e3c158b30 2024-08-17T02:28:25.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.562+0000 7f1e32000640 1 --2- 172.21.15.106:0/3610105629 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1e18065150 0x7f1e18067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.562+0000 7f1e32000640 1 -- 172.21.15.106:0/3610105629 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1e34082550 con 0x7f1e3c158b30 2024-08-17T02:28:25.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.563+0000 7f1e39e00640 1 --2- 172.21.15.106:0/3610105629 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1e18065150 0x7f1e18067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.563+0000 7f1e39e00640 1 --2- 172.21.15.106:0/3610105629 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1e18065150 0x7f1e18067600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c034000 tx=0x7f1e2c037000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.566+0000 7f1e32000640 1 -- 172.21.15.106:0/3610105629 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1e34050620 con 0x7f1e3c158b30 2024-08-17T02:28:25.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.771+0000 7f1e3b200640 1 -- 172.21.15.106:0/3610105629 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e3c071050 con 0x7f1e3c158b30 2024-08-17T02:28:25.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.772+0000 7f1e32000640 1 -- 172.21.15.106:0/3610105629 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f1e34053c40 con 0x7f1e3c158b30 2024-08-17T02:28:25.773 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:25.773 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1696744783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1696744783},{"type":"v1","addr":"172.21.15.106:6837","nonce":1696744783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/966571689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":966571689},{"type":"v1","addr":"172.21.15.171:6833","nonce":966571689}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/3205379168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3205379168},{"type":"v1","addr":"172.21.15.106:6836","nonce":3205379168}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:50.683483+0000","modified":"2024-08-17T02:27:54.296580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6835/3901195482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3901195482},{"type":"v1","addr":"172.21.15.171:6835","nonce":3901195482}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:28:25.773 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 8 2024-08-17T02:28:25.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.774+0000 7f1e3b200640 1 -- 172.21.15.106:0/3610105629 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1e18065150 msgr2=0x7f1e18067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.774+0000 7f1e3b200640 1 --2- 172.21.15.106:0/3610105629 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1e18065150 0x7f1e18067600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c034000 tx=0x7f1e2c037000 comp rx=0 tx=0).stop 2024-08-17T02:28:25.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.774+0000 7f1e3b200640 1 -- 172.21.15.106:0/3610105629 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e3c158b30 msgr2=0x7f1e3c168c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.774+0000 7f1e3b200640 1 --2- 172.21.15.106:0/3610105629 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e3c158b30 0x7f1e3c168c20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1e3400e900 tx=0x7f1e340090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.774+0000 7f1e3b200640 1 -- 172.21.15.106:0/3610105629 shutdown_connections 2024-08-17T02:28:25.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.774+0000 7f1e3b200640 1 --2- 172.21.15.106:0/3610105629 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1e18065150 0x7f1e18067600 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.774+0000 7f1e3b200640 1 --2- 172.21.15.106:0/3610105629 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e3c158b30 0x7f1e3c168c20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.774+0000 7f1e3b200640 1 --2- 172.21.15.106:0/3610105629 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1e3c155900 0x7f1e3c0c0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.774+0000 7f1e3b200640 1 --2- 172.21.15.106:0/3610105629 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1e3c0b0270 0x7f1e3c16bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.774+0000 7f1e3b200640 1 -- 172.21.15.106:0/3610105629 >> 172.21.15.106:0/3610105629 conn(0x7f1e3c067750 msgr2=0x7f1e3c068540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:25.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.774+0000 7f1e3b200640 1 -- 172.21.15.106:0/3610105629 shutdown_connections 2024-08-17T02:28:25.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.774+0000 7f1e3b200640 1 -- 172.21.15.106:0/3610105629 wait complete. 2024-08-17T02:28:25.790 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:25.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.938+0000 7f01e4c00640 1 Processor -- start 2024-08-17T02:28:25.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.938+0000 7f01e4c00640 1 -- start start 2024-08-17T02:28:25.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.939+0000 7f01e4c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f01e006df00 0x7f01e00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.939+0000 7f01e4c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f01e0155df0 0x7f01e00ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.939+0000 7f01e4c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e0156670 con 0x7f01e0155a20 2024-08-17T02:28:25.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.939+0000 7f01e4c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01e00b0350 con 0x7f01e006df00 2024-08-17T02:28:25.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.939+0000 7f01e4c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01e006e5e0 con 0x7f01e0155df0 2024-08-17T02:28:25.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.939+0000 7f01d5400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f01e006df00 0x7f01e00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.939+0000 7f01dde00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f01e0155a20 0x7f01e006d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39752/0 (socket says 172.21.15.106:39752) 2024-08-17T02:28:25.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.939+0000 7f01dde00640 1 -- 172.21.15.106:0/2436770244 learned_addr learned my addr 172.21.15.106:0/2436770244 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:25.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.939+0000 7f01de800640 1 --2- 172.21.15.106:0/2436770244 >> v2:172.21.15.171:3300/0 conn(0x7f01e0155df0 0x7f01e00ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.940+0000 7f01d5400640 1 -- 172.21.15.106:0/2436770244 >> v2:172.21.15.171:3300/0 conn(0x7f01e0155df0 msgr2=0x7f01e00ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:25.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.940+0000 7f01d5400640 1 --2- 172.21.15.106:0/2436770244 >> v2:172.21.15.171:3300/0 conn(0x7f01e0155df0 0x7f01e00ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.940+0000 7f01d5400640 1 -- 172.21.15.106:0/2436770244 >> v1:172.21.15.106:6789/0 conn(0x7f01e0155a20 legacy=0x7f01e006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.940+0000 7f01d5400640 1 -- 172.21.15.106:0/2436770244 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e006e8c0 con 0x7f01e006df00 2024-08-17T02:28:25.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.940+0000 7f01dd400640 1 -- 172.21.15.106:0/2436770244 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 655730081 0 0) 0x7f01e0156670 con 0x7f01e0155a20 2024-08-17T02:28:25.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.941+0000 7f01d5400640 1 --2- 172.21.15.106:0/2436770244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01e006df00 0x7f01e00adf10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f01e00b0710 tx=0x7f01c80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b4f028b1363713 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.941+0000 7f01dd400640 1 -- 172.21.15.106:0/2436770244 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c802ad20 con 0x7f01e006df00 2024-08-17T02:28:25.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.941+0000 7f01dd400640 1 -- 172.21.15.106:0/2436770244 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c802ae80 con 0x7f01e006df00 2024-08-17T02:28:25.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.941+0000 7f01dd400640 1 -- 172.21.15.106:0/2436770244 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c8032670 con 0x7f01e006df00 2024-08-17T02:28:25.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.942+0000 7f01e4c00640 1 -- 172.21.15.106:0/2436770244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01e006df00 msgr2=0x7f01e00adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.942+0000 7f01e4c00640 1 --2- 172.21.15.106:0/2436770244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01e006df00 0x7f01e00adf10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f01e00b0710 tx=0x7f01c80090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.942+0000 7f01e4c00640 1 -- 172.21.15.106:0/2436770244 shutdown_connections 2024-08-17T02:28:25.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.942+0000 7f01e4c00640 1 --2- 172.21.15.106:0/2436770244 >> v2:172.21.15.171:3300/0 conn(0x7f01e0155df0 0x7f01e00ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.942+0000 7f01e4c00640 1 --2- 172.21.15.106:0/2436770244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01e006df00 0x7f01e00adf10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.942+0000 7f01e4c00640 1 -- 172.21.15.106:0/2436770244 >> 172.21.15.106:0/2436770244 conn(0x7f01e00cb9b0 msgr2=0x7f01e00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:25.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.942+0000 7f01e4c00640 1 -- 172.21.15.106:0/2436770244 shutdown_connections 2024-08-17T02:28:25.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.942+0000 7f01e4c00640 1 -- 172.21.15.106:0/2436770244 wait complete. 2024-08-17T02:28:25.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.943+0000 7f01e4c00640 1 Processor -- start 2024-08-17T02:28:25.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.943+0000 7f01e4c00640 1 -- start start 2024-08-17T02:28:25.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.944+0000 7f01e4c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01e006df00 0x7f01e01511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.944+0000 7f01e4c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01e0155a20 0x7f01e01688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.944+0000 7f01e4c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f01e0155df0 0x7f01e0157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.944+0000 7f01e4c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e014fdc0 con 0x7f01e0155a20 2024-08-17T02:28:25.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.944+0000 7f01e4c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e00aa860 con 0x7f01e006df00 2024-08-17T02:28:25.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.944+0000 7f01e4c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e00a9c50 con 0x7f01e0155df0 2024-08-17T02:28:25.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.944+0000 7f01d5400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01e0155a20 0x7f01e01688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.944+0000 7f01d5400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01e0155a20 0x7f01e01688d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44884/0 (socket says 172.21.15.106:44884) 2024-08-17T02:28:25.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.944+0000 7f01d5400640 1 -- 172.21.15.106:0/4292411589 learned_addr learned my addr 172.21.15.106:0/4292411589 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:25.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.945+0000 7f01dde00640 1 --2- 172.21.15.106:0/4292411589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01e006df00 0x7f01e01511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.945+0000 7f01de800640 1 --2- 172.21.15.106:0/4292411589 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f01e0155df0 0x7f01e0157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.945+0000 7f01d5400640 1 -- 172.21.15.106:0/4292411589 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f01e0155df0 msgr2=0x7f01e0157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.945+0000 7f01d5400640 1 --2- 172.21.15.106:0/4292411589 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f01e0155df0 0x7f01e0157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.945+0000 7f01d5400640 1 -- 172.21.15.106:0/4292411589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01e006df00 msgr2=0x7f01e01511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.945+0000 7f01d5400640 1 --2- 172.21.15.106:0/4292411589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01e006df00 0x7f01e01511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.945+0000 7f01d5400640 1 -- 172.21.15.106:0/4292411589 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c8009390 con 0x7f01e0155a20 2024-08-17T02:28:25.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.945+0000 7f01d5400640 1 --2- 172.21.15.106:0/4292411589 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01e0155a20 0x7f01e01688d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009360 tx=0x7f01c8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.945+0000 7f01d6000640 1 -- 172.21.15.106:0/4292411589 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c803b6e0 con 0x7f01e0155a20 2024-08-17T02:28:25.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.946+0000 7f01d6000640 1 -- 172.21.15.106:0/4292411589 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c803b840 con 0x7f01e0155a20 2024-08-17T02:28:25.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.946+0000 7f01d6000640 1 -- 172.21.15.106:0/4292411589 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c803bbc0 con 0x7f01e0155a20 2024-08-17T02:28:25.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.946+0000 7f01e4c00640 1 -- 172.21.15.106:0/4292411589 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e00a9f30 con 0x7f01e0155a20 2024-08-17T02:28:25.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.946+0000 7f01e4c00640 1 -- 172.21.15.106:0/4292411589 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e00aa4f0 con 0x7f01e0155a20 2024-08-17T02:28:25.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.947+0000 7f01e4c00640 1 -- 172.21.15.106:0/4292411589 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01e0149eb0 con 0x7f01e0155a20 2024-08-17T02:28:25.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.947+0000 7f01d6000640 1 -- 172.21.15.106:0/4292411589 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f01c8043030 con 0x7f01e0155a20 2024-08-17T02:28:25.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.948+0000 7f01d6000640 1 --2- 172.21.15.106:0/4292411589 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f01bc065150 0x7f01bc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.948+0000 7f01d6000640 1 -- 172.21.15.106:0/4292411589 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f01c8041070 con 0x7f01e0155a20 2024-08-17T02:28:25.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.948+0000 7f01dde00640 1 --2- 172.21.15.106:0/4292411589 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f01bc065150 0x7f01bc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.949+0000 7f01dde00640 1 --2- 172.21.15.106:0/4292411589 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f01bc065150 0x7f01bc067600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f01d00011e0 tx=0x7f01d0007ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:25.952+0000 7f01d6000640 1 -- 172.21.15.106:0/4292411589 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f01e0149eb0 con 0x7f01e0155a20 2024-08-17T02:28:26.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.124+0000 7f01e4c00640 1 -- 172.21.15.106:0/4292411589 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01e0149eb0 con 0x7f01e0155a20 2024-08-17T02:28:26.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.125+0000 7f01d6000640 1 -- 172.21.15.106:0/4292411589 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f01e0149eb0 con 0x7f01e0155a20 2024-08-17T02:28:26.126 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:26.126 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:27:52.284039+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:48.547438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:49.671073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:26.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.127+0000 7f01e4c00640 1 -- 172.21.15.106:0/4292411589 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f01bc065150 msgr2=0x7f01bc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.127+0000 7f01e4c00640 1 --2- 172.21.15.106:0/4292411589 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f01bc065150 0x7f01bc067600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f01d00011e0 tx=0x7f01d0007ca0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.127+0000 7f01e4c00640 1 -- 172.21.15.106:0/4292411589 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01e0155a20 msgr2=0x7f01e01688d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.127+0000 7f01e4c00640 1 --2- 172.21.15.106:0/4292411589 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01e0155a20 0x7f01e01688d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009360 tx=0x7f01c8032000 comp rx=0 tx=0).stop 2024-08-17T02:28:26.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.127+0000 7f01e4c00640 1 -- 172.21.15.106:0/4292411589 shutdown_connections 2024-08-17T02:28:26.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.127+0000 7f01e4c00640 1 --2- 172.21.15.106:0/4292411589 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f01e0155df0 0x7f01e0157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.127+0000 7f01e4c00640 1 --2- 172.21.15.106:0/4292411589 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f01bc065150 0x7f01bc067600 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.127+0000 7f01e4c00640 1 --2- 172.21.15.106:0/4292411589 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01e0155a20 0x7f01e01688d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.127+0000 7f01e4c00640 1 --2- 172.21.15.106:0/4292411589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01e006df00 0x7f01e01511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.127+0000 7f01e4c00640 1 -- 172.21.15.106:0/4292411589 >> 172.21.15.106:0/4292411589 conn(0x7f01e00cb9b0 msgr2=0x7f01e0156de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:26.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.128+0000 7f01e4c00640 1 -- 172.21.15.106:0/4292411589 shutdown_connections 2024-08-17T02:28:26.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.128+0000 7f01e4c00640 1 -- 172.21.15.106:0/4292411589 wait complete. 2024-08-17T02:28:26.143 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:37.928826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:27:48.547438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:27:49.671073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:28:26.143 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:28:26.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.293+0000 7fdab1c00640 1 Processor -- start 2024-08-17T02:28:26.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.294+0000 7fdab1c00640 1 -- start start 2024-08-17T02:28:26.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.295+0000 7fdab1c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaac158d90 0x7fdaac0aac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.295+0000 7fdab1c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdaac0cc2e0 0x7fdaac0aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.295+0000 7fdab1c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaac06dc40 con 0x7fdaac1589c0 2024-08-17T02:28:26.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.295+0000 7fdab1c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaac06d9a0 con 0x7fdaac0cc2e0 2024-08-17T02:28:26.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.295+0000 7fdab1c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac0cc740 con 0x7fdaac158d90 2024-08-17T02:28:26.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.295+0000 7fdaabe00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fdaac1589c0 0x7fdaac0c8260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39766/0 (socket says 172.21.15.106:39766) 2024-08-17T02:28:26.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.295+0000 7fdab1200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdaac0cc2e0 0x7fdaac0aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.295+0000 7fdaabe00640 1 -- 172.21.15.106:0/234609174 learned_addr learned my addr 172.21.15.106:0/234609174 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:26.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.295+0000 7fdaab400640 1 --2- 172.21.15.106:0/234609174 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaac158d90 0x7fdaac0aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.296+0000 7fdab1200640 1 -- 172.21.15.106:0/234609174 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaac158d90 msgr2=0x7fdaac0aac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:26.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.296+0000 7fdab1200640 1 --2- 172.21.15.106:0/234609174 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaac158d90 0x7fdaac0aac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.296+0000 7fdab1200640 1 -- 172.21.15.106:0/234609174 >> v1:172.21.15.106:6789/0 conn(0x7fdaac1589c0 legacy=0x7fdaac0c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.296+0000 7fdab1200640 1 -- 172.21.15.106:0/234609174 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac0aa590 con 0x7fdaac0cc2e0 2024-08-17T02:28:26.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.296+0000 7fdab1200640 1 --2- 172.21.15.106:0/234609174 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaac0cc2e0 0x7fdaac0aeb90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4009e60 tx=0x7fdaa4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f7eed6f0e624f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:26.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.297+0000 7fdaaaa00640 1 -- 172.21.15.106:0/234609174 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4007550 con 0x7fdaac0cc2e0 2024-08-17T02:28:26.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.297+0000 7fdaaaa00640 1 -- 172.21.15.106:0/234609174 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa402d050 con 0x7fdaac0cc2e0 2024-08-17T02:28:26.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.297+0000 7fdaaaa00640 1 -- 172.21.15.106:0/234609174 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4007920 con 0x7fdaac0cc2e0 2024-08-17T02:28:26.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.297+0000 7fdab1c00640 1 -- 172.21.15.106:0/234609174 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaac0cc2e0 msgr2=0x7fdaac0aeb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.297+0000 7fdab1c00640 1 --2- 172.21.15.106:0/234609174 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaac0cc2e0 0x7fdaac0aeb90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4009e60 tx=0x7fdaa4009780 comp rx=0 tx=0).stop 2024-08-17T02:28:26.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.297+0000 7fdab1c00640 1 -- 172.21.15.106:0/234609174 shutdown_connections 2024-08-17T02:28:26.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.297+0000 7fdab1c00640 1 --2- 172.21.15.106:0/234609174 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaac0cc2e0 0x7fdaac0aeb90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.297+0000 7fdab1c00640 1 --2- 172.21.15.106:0/234609174 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaac158d90 0x7fdaac0aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.297+0000 7fdab1c00640 1 -- 172.21.15.106:0/234609174 >> 172.21.15.106:0/234609174 conn(0x7fdaac067750 msgr2=0x7fdaac0cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:26.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.298+0000 7fdab1c00640 1 -- 172.21.15.106:0/234609174 shutdown_connections 2024-08-17T02:28:26.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.298+0000 7fdab1c00640 1 -- 172.21.15.106:0/234609174 wait complete. 2024-08-17T02:28:26.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.299+0000 7fdab1c00640 1 Processor -- start 2024-08-17T02:28:26.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.299+0000 7fdab1c00640 1 -- start start 2024-08-17T02:28:26.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.300+0000 7fdab1c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdaac0cc2e0 0x7fdaac14ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.300+0000 7fdab1c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaac1589c0 0x7fdaac14f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.300+0000 7fdab1c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaac158d90 0x7fdaac069de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.300+0000 7fdab1c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac152ad0 con 0x7fdaac1589c0 2024-08-17T02:28:26.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.300+0000 7fdab1c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac14fc00 con 0x7fdaac0cc2e0 2024-08-17T02:28:26.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.300+0000 7fdab1c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac14fee0 con 0x7fdaac158d90 2024-08-17T02:28:26.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.300+0000 7fdaab400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaac1589c0 0x7fdaac14f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.300+0000 7fdaab400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaac1589c0 0x7fdaac14f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44900/0 (socket says 172.21.15.106:44900) 2024-08-17T02:28:26.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.300+0000 7fdaab400640 1 -- 172.21.15.106:0/3671623056 learned_addr learned my addr 172.21.15.106:0/3671623056 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:26.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.300+0000 7fdab1200640 1 --2- 172.21.15.106:0/3671623056 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaac158d90 0x7fdaac069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.300+0000 7fdaabe00640 1 --2- 172.21.15.106:0/3671623056 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdaac0cc2e0 0x7fdaac14ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.300+0000 7fdaab400640 1 -- 172.21.15.106:0/3671623056 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaac158d90 msgr2=0x7fdaac069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.300+0000 7fdaab400640 1 --2- 172.21.15.106:0/3671623056 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaac158d90 0x7fdaac069de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.300+0000 7fdaab400640 1 -- 172.21.15.106:0/3671623056 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdaac0cc2e0 msgr2=0x7fdaac14ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.300+0000 7fdaab400640 1 --2- 172.21.15.106:0/3671623056 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdaac0cc2e0 0x7fdaac14ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.300+0000 7fdaab400640 1 -- 172.21.15.106:0/3671623056 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa4009a20 con 0x7fdaac1589c0 2024-08-17T02:28:26.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.300+0000 7fdab1200640 1 --2- 172.21.15.106:0/3671623056 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaac158d90 0x7fdaac069de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:26.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.301+0000 7fdaab400640 1 --2- 172.21.15.106:0/3671623056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaac1589c0 0x7fdaac14f3b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fda9800d860 tx=0x7fda98008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:26.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.301+0000 7fdaa3400640 1 -- 172.21.15.106:0/3671623056 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda980096a0 con 0x7fdaac1589c0 2024-08-17T02:28:26.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.301+0000 7fdaa3400640 1 -- 172.21.15.106:0/3671623056 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda98009800 con 0x7fdaac1589c0 2024-08-17T02:28:26.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.301+0000 7fdab1c00640 1 -- 172.21.15.106:0/3671623056 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaac1501c0 con 0x7fdaac1589c0 2024-08-17T02:28:26.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.301+0000 7fdaa3400640 1 -- 172.21.15.106:0/3671623056 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda98009bc0 con 0x7fdaac1589c0 2024-08-17T02:28:26.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.301+0000 7fdab1c00640 1 -- 172.21.15.106:0/3671623056 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaac14f8f0 con 0x7fdaac1589c0 2024-08-17T02:28:26.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.302+0000 7fdab1c00640 1 -- 172.21.15.106:0/3671623056 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaac1585f0 con 0x7fdaac1589c0 2024-08-17T02:28:26.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.303+0000 7fdaa3400640 1 -- 172.21.15.106:0/3671623056 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fda98014410 con 0x7fdaac1589c0 2024-08-17T02:28:26.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.304+0000 7fdaa3400640 1 --2- 172.21.15.106:0/3671623056 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fda8c065180 0x7fda8c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.304+0000 7fdaa3400640 1 -- 172.21.15.106:0/3671623056 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fda98082c80 con 0x7fdaac1589c0 2024-08-17T02:28:26.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.304+0000 7fdaabe00640 1 --2- 172.21.15.106:0/3671623056 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fda8c065180 0x7fda8c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.305+0000 7fdaabe00640 1 --2- 172.21.15.106:0/3671623056 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fda8c065180 0x7fda8c067630 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fda9c007fd0 tx=0x7fda9c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:26.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.308+0000 7fdaa3400640 1 -- 172.21.15.106:0/3671623056 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdaac1585f0 con 0x7fdaac1589c0 2024-08-17T02:28:26.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.480+0000 7fdab1c00640 1 -- 172.21.15.106:0/3671623056 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdaac152ca0 con 0x7fdaac1589c0 2024-08-17T02:28:26.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.481+0000 7fdaa3400640 1 -- 172.21.15.106:0/3671623056 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdaac152ca0 con 0x7fdaac1589c0 2024-08-17T02:28:26.481 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-08-17T02:28:26.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.483+0000 7fdab1c00640 1 -- 172.21.15.106:0/3671623056 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fda8c065180 msgr2=0x7fda8c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.483+0000 7fdab1c00640 1 --2- 172.21.15.106:0/3671623056 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fda8c065180 0x7fda8c067630 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fda9c007fd0 tx=0x7fda9c009040 comp rx=0 tx=0).stop 2024-08-17T02:28:26.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.483+0000 7fdab1c00640 1 -- 172.21.15.106:0/3671623056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaac1589c0 msgr2=0x7fdaac14f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.483+0000 7fdab1c00640 1 --2- 172.21.15.106:0/3671623056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaac1589c0 0x7fdaac14f3b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fda9800d860 tx=0x7fda98008040 comp rx=0 tx=0).stop 2024-08-17T02:28:26.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.483+0000 7fdab1c00640 1 -- 172.21.15.106:0/3671623056 shutdown_connections 2024-08-17T02:28:26.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.483+0000 7fdab1c00640 1 --2- 172.21.15.106:0/3671623056 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdaac158d90 0x7fdaac069de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.483+0000 7fdab1c00640 1 --2- 172.21.15.106:0/3671623056 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fda8c065180 0x7fda8c067630 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.483+0000 7fdab1c00640 1 --2- 172.21.15.106:0/3671623056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdaac1589c0 0x7fdaac14f3b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.483+0000 7fdab1c00640 1 --2- 172.21.15.106:0/3671623056 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdaac0cc2e0 0x7fdaac14ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.483+0000 7fdab1c00640 1 -- 172.21.15.106:0/3671623056 >> 172.21.15.106:0/3671623056 conn(0x7fdaac067750 msgr2=0x7fdaac068bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:26.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.483+0000 7fdab1c00640 1 -- 172.21.15.106:0/3671623056 shutdown_connections 2024-08-17T02:28:26.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.483+0000 7fdab1c00640 1 -- 172.21.15.106:0/3671623056 wait complete. 2024-08-17T02:28:26.498 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:28:26.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.648+0000 7f7de5e00640 1 Processor -- start 2024-08-17T02:28:26.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.648+0000 7f7de5e00640 1 -- start start 2024-08-17T02:28:26.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.649+0000 7f7de5e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7de0158940 0x7f7de015d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.650+0000 7f7de5e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7de00673e0 0x7f7de00b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.650+0000 7f7de5e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de006e660 con 0x7f7de0158d10 2024-08-17T02:28:26.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.650+0000 7f7de5e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de00a9b70 con 0x7f7de00673e0 2024-08-17T02:28:26.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.650+0000 7f7de5e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de006da50 con 0x7f7de0158940 2024-08-17T02:28:26.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.650+0000 7f7de4a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7de0158940 0x7f7de015d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.650+0000 7f7de5400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7de00673e0 0x7f7de00b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.650+0000 7f7ddfe00640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f7de0158d10 0x7f7de0066cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:58968/0 (socket says 172.21.15.106:58968) 2024-08-17T02:28:26.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.650+0000 7f7ddfe00640 1 -- 172.21.15.106:0/4129414951 learned_addr learned my addr 172.21.15.106:0/4129414951 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:26.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.651+0000 7f7ddf400640 1 -- 172.21.15.106:0/4129414951 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997977234 0 0) 0x7f7de006e660 con 0x7f7de0158d10 2024-08-17T02:28:26.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.651+0000 7f7ddf400640 1 -- 172.21.15.106:0/4129414951 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dc40034e0 con 0x7f7de0158d10 2024-08-17T02:28:26.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.651+0000 7f7de5400640 1 -- 172.21.15.106:0/4129414951 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7de0158940 msgr2=0x7f7de015d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:26.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.651+0000 7f7de5400640 1 --2- 172.21.15.106:0/4129414951 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7de0158940 0x7f7de015d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.651+0000 7f7de5400640 1 -- 172.21.15.106:0/4129414951 >> v1:172.21.15.171:6789/0 conn(0x7f7de0158d10 legacy=0x7f7de0066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.651+0000 7f7de5400640 1 -- 172.21.15.106:0/4129414951 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de006dd30 con 0x7f7de00673e0 2024-08-17T02:28:26.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.652+0000 7f7de5400640 1 --2- 172.21.15.106:0/4129414951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7de00673e0 0x7f7de00b0ed0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009850 tx=0x7f7dd80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8391cc3ba3d87b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:26.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.652+0000 7f7ddf400640 1 -- 172.21.15.106:0/4129414951 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd802ad00 con 0x7f7de00673e0 2024-08-17T02:28:26.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.652+0000 7f7ddf400640 1 -- 172.21.15.106:0/4129414951 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd802ae60 con 0x7f7de00673e0 2024-08-17T02:28:26.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.652+0000 7f7ddf400640 1 -- 172.21.15.106:0/4129414951 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8032670 con 0x7f7de00673e0 2024-08-17T02:28:26.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.653+0000 7f7de5e00640 1 -- 172.21.15.106:0/4129414951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7de00673e0 msgr2=0x7f7de00b0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.653+0000 7f7de5e00640 1 --2- 172.21.15.106:0/4129414951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7de00673e0 0x7f7de00b0ed0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009850 tx=0x7f7dd80090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.653+0000 7f7de5e00640 1 -- 172.21.15.106:0/4129414951 shutdown_connections 2024-08-17T02:28:26.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.653+0000 7f7de5e00640 1 --2- 172.21.15.106:0/4129414951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7de00673e0 0x7f7de00b0ed0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.653+0000 7f7de5e00640 1 --2- 172.21.15.106:0/4129414951 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7de0158940 0x7f7de015d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.653+0000 7f7de5e00640 1 -- 172.21.15.106:0/4129414951 >> 172.21.15.106:0/4129414951 conn(0x7f7de0067de0 msgr2=0x7f7de00681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:26.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.653+0000 7f7de5e00640 1 -- 172.21.15.106:0/4129414951 shutdown_connections 2024-08-17T02:28:26.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.653+0000 7f7de5e00640 1 -- 172.21.15.106:0/4129414951 wait complete. 2024-08-17T02:28:26.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.654+0000 7f7de5e00640 1 Processor -- start 2024-08-17T02:28:26.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.654+0000 7f7de5e00640 1 -- start start 2024-08-17T02:28:26.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.655+0000 7f7de5e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7de00673e0 0x7f7de014a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.655+0000 7f7de5e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7de0158940 0x7f7de00c2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.655+0000 7f7de5e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7de0158d10 0x7f7de00c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.655+0000 7f7de5e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de00abb10 con 0x7f7de00673e0 2024-08-17T02:28:26.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.655+0000 7f7de5e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de00c3000 con 0x7f7de0158940 2024-08-17T02:28:26.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.655+0000 7f7de5e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de00c2d20 con 0x7f7de0158d10 2024-08-17T02:28:26.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.655+0000 7f7de4a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7de00673e0 0x7f7de014a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.655+0000 7f7de4a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7de00673e0 0x7f7de014a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44904/0 (socket says 172.21.15.106:44904) 2024-08-17T02:28:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.656+0000 7f7de4a00640 1 -- 172.21.15.106:0/2610661088 learned_addr learned my addr 172.21.15.106:0/2610661088 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.656+0000 7f7ddfe00640 1 --2- 172.21.15.106:0/2610661088 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7de0158940 0x7f7de00c2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.656+0000 7f7de4a00640 1 -- 172.21.15.106:0/2610661088 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7de0158d10 msgr2=0x7f7de00c34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.656+0000 7f7de4a00640 1 --2- 172.21.15.106:0/2610661088 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7de0158d10 0x7f7de00c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.656+0000 7f7de4a00640 1 -- 172.21.15.106:0/2610661088 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7de0158940 msgr2=0x7f7de00c2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.656+0000 7f7de4a00640 1 --2- 172.21.15.106:0/2610661088 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7de0158940 0x7f7de00c2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.656+0000 7f7de4a00640 1 -- 172.21.15.106:0/2610661088 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd8009390 con 0x7f7de00673e0 2024-08-17T02:28:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.656+0000 7f7de4a00640 1 --2- 172.21.15.106:0/2610661088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7de00673e0 0x7f7de014a7f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0009ef0 tx=0x7f7dd000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.656+0000 7f7dd7e00640 1 -- 172.21.15.106:0/2610661088 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd000ce10 con 0x7f7de00673e0 2024-08-17T02:28:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.656+0000 7f7dd7e00640 1 -- 172.21.15.106:0/2610661088 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd000f040 con 0x7f7de00673e0 2024-08-17T02:28:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.656+0000 7f7dd7e00640 1 -- 172.21.15.106:0/2610661088 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd00146b0 con 0x7f7de00673e0 2024-08-17T02:28:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.656+0000 7f7de5e00640 1 -- 172.21.15.106:0/2610661088 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de00ab4c0 con 0x7f7de00673e0 2024-08-17T02:28:26.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.657+0000 7f7de5e00640 1 -- 172.21.15.106:0/2610661088 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de00ad870 con 0x7f7de00673e0 2024-08-17T02:28:26.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.658+0000 7f7de5e00640 1 -- 172.21.15.106:0/2610661088 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de0071050 con 0x7f7de00673e0 2024-08-17T02:28:26.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.658+0000 7f7dd7e00640 1 -- 172.21.15.106:0/2610661088 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7dd0014a20 con 0x7f7de00673e0 2024-08-17T02:28:26.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.659+0000 7f7dd7e00640 1 --2- 172.21.15.106:0/2610661088 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7dc0065180 0x7f7dc0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.659+0000 7f7dd7e00640 1 -- 172.21.15.106:0/2610661088 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7dd0082fe0 con 0x7f7de00673e0 2024-08-17T02:28:26.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.659+0000 7f7ddfe00640 1 --2- 172.21.15.106:0/2610661088 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7dc0065180 0x7f7dc0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.660+0000 7f7ddfe00640 1 --2- 172.21.15.106:0/2610661088 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7dc0065180 0x7f7dc0067630 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc005840 tx=0x7f7dcc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:26.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.663+0000 7f7dd7e00640 1 -- 172.21.15.106:0/2610661088 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7dd0051000 con 0x7f7de00673e0 2024-08-17T02:28:26.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.833+0000 7f7de5e00640 1 -- 172.21.15.106:0/2610661088 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7de0068af0 con 0x7f7de00673e0 2024-08-17T02:28:26.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.834+0000 7f7dd7e00640 1 -- 172.21.15.106:0/2610661088 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7dd0054620 con 0x7f7de00673e0 2024-08-17T02:28:26.834 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-08-17T02:28:26.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.835+0000 7f7de5e00640 1 -- 172.21.15.106:0/2610661088 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7dc0065180 msgr2=0x7f7dc0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.835+0000 7f7de5e00640 1 --2- 172.21.15.106:0/2610661088 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7dc0065180 0x7f7dc0067630 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc005840 tx=0x7f7dcc009040 comp rx=0 tx=0).stop 2024-08-17T02:28:26.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.836+0000 7f7de5e00640 1 -- 172.21.15.106:0/2610661088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7de00673e0 msgr2=0x7f7de014a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.836+0000 7f7de5e00640 1 --2- 172.21.15.106:0/2610661088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7de00673e0 0x7f7de014a7f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0009ef0 tx=0x7f7dd000b040 comp rx=0 tx=0).stop 2024-08-17T02:28:26.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.836+0000 7f7de5e00640 1 -- 172.21.15.106:0/2610661088 shutdown_connections 2024-08-17T02:28:26.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.836+0000 7f7de5e00640 1 --2- 172.21.15.106:0/2610661088 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7de0158d10 0x7f7de00c34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.836+0000 7f7de5e00640 1 --2- 172.21.15.106:0/2610661088 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7de0158940 0x7f7de00c2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.836+0000 7f7de5e00640 1 --2- 172.21.15.106:0/2610661088 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7dc0065180 0x7f7dc0067630 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.836+0000 7f7de5e00640 1 --2- 172.21.15.106:0/2610661088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7de00673e0 0x7f7de014a7f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.836+0000 7f7de5e00640 1 -- 172.21.15.106:0/2610661088 >> 172.21.15.106:0/2610661088 conn(0x7f7de0067de0 msgr2=0x7f7de0155780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:26.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.836+0000 7f7de5e00640 1 -- 172.21.15.106:0/2610661088 shutdown_connections 2024-08-17T02:28:26.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:26.836+0000 7f7de5e00640 1 -- 172.21.15.106:0/2610661088 wait complete. 2024-08-17T02:28:26.851 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:28:27.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.001+0000 7f1095a00640 1 Processor -- start 2024-08-17T02:28:27.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.001+0000 7f1095a00640 1 -- start start 2024-08-17T02:28:27.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.003+0000 7f1095a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1090155a80 0x7f109006dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.003+0000 7f1095a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f10900c7db0 0x7f10900c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.003+0000 7f1095a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10901598f0 con 0x7f1090155e50 2024-08-17T02:28:27.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.003+0000 7f1095a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1090159bd0 con 0x7f10900c7db0 2024-08-17T02:28:27.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.003+0000 7f1095a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1090159eb0 con 0x7f1090155a80 2024-08-17T02:28:27.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.003+0000 7f108f400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1090155e50 0x7f109006c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39772/0 (socket says 172.21.15.106:39772) 2024-08-17T02:28:27.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.003+0000 7f108f400640 1 -- 172.21.15.106:0/3941128298 learned_addr learned my addr 172.21.15.106:0/3941128298 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:27.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.003+0000 7f1086000640 1 --2- 172.21.15.106:0/3941128298 >> v2:172.21.15.171:3300/0 conn(0x7f10900c7db0 0x7f10900c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.003+0000 7f108ea00640 1 --2- 172.21.15.106:0/3941128298 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1090155a80 0x7f109006dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.004+0000 7f108e000640 1 -- 172.21.15.106:0/3941128298 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1417168244 0 0) 0x7f10901598f0 con 0x7f1090155e50 2024-08-17T02:28:27.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.004+0000 7f108e000640 1 -- 172.21.15.106:0/3941128298 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10740034e0 con 0x7f1090155e50 2024-08-17T02:28:27.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.004+0000 7f1086000640 1 -- 172.21.15.106:0/3941128298 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1090155a80 msgr2=0x7f109006dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:27.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.004+0000 7f1086000640 1 --2- 172.21.15.106:0/3941128298 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1090155a80 0x7f109006dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.004+0000 7f1086000640 1 -- 172.21.15.106:0/3941128298 >> v1:172.21.15.106:6789/0 conn(0x7f1090155e50 legacy=0x7f109006c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.004+0000 7f1086000640 1 -- 172.21.15.106:0/3941128298 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109015a190 con 0x7f10900c7db0 2024-08-17T02:28:27.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.004+0000 7f108ea00640 1 --2- 172.21.15.106:0/3941128298 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1090155a80 0x7f109006dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:27.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.005+0000 7f1086000640 1 --2- 172.21.15.106:0/3941128298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f10900c7db0 0x7f10900c8bd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1078009850 tx=0x7f10780090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=514c8c8eac0ee6ae server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:27.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.005+0000 7f108e000640 1 -- 172.21.15.106:0/3941128298 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107802ad80 con 0x7f10900c7db0 2024-08-17T02:28:27.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.005+0000 7f108e000640 1 -- 172.21.15.106:0/3941128298 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1078032440 con 0x7f10900c7db0 2024-08-17T02:28:27.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.005+0000 7f108e000640 1 -- 172.21.15.106:0/3941128298 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1078032820 con 0x7f10900c7db0 2024-08-17T02:28:27.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.006+0000 7f1095a00640 1 -- 172.21.15.106:0/3941128298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f10900c7db0 msgr2=0x7f10900c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.006+0000 7f1095a00640 1 --2- 172.21.15.106:0/3941128298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f10900c7db0 0x7f10900c8bd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1078009850 tx=0x7f10780090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.006+0000 7f1095a00640 1 -- 172.21.15.106:0/3941128298 shutdown_connections 2024-08-17T02:28:27.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.006+0000 7f1095a00640 1 --2- 172.21.15.106:0/3941128298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f10900c7db0 0x7f10900c8bd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.006+0000 7f1095a00640 1 --2- 172.21.15.106:0/3941128298 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1090155a80 0x7f109006dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.006+0000 7f1095a00640 1 -- 172.21.15.106:0/3941128298 >> 172.21.15.106:0/3941128298 conn(0x7f1090067750 msgr2=0x7f10900c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:27.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.006+0000 7f1095a00640 1 -- 172.21.15.106:0/3941128298 shutdown_connections 2024-08-17T02:28:27.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.006+0000 7f1095a00640 1 -- 172.21.15.106:0/3941128298 wait complete. 2024-08-17T02:28:27.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.007+0000 7f1095a00640 1 Processor -- start 2024-08-17T02:28:27.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.007+0000 7f1095a00640 1 -- start start 2024-08-17T02:28:27.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.008+0000 7f1095a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10900c7db0 0x7f1090152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.008+0000 7f1095a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1090155a80 0x7f1090158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.008+0000 7f1095a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1090155e50 0x7f10900a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.008+0000 7f1095a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10901570f0 con 0x7f10900c7db0 2024-08-17T02:28:27.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.008+0000 7f1095a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10901564e0 con 0x7f1090155a80 2024-08-17T02:28:27.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.008+0000 7f1095a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10901567c0 con 0x7f1090155e50 2024-08-17T02:28:27.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.008+0000 7f108ea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10900c7db0 0x7f1090152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.008+0000 7f108ea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10900c7db0 0x7f1090152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44916/0 (socket says 172.21.15.106:44916) 2024-08-17T02:28:27.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.008+0000 7f108ea00640 1 -- 172.21.15.106:0/189350283 learned_addr learned my addr 172.21.15.106:0/189350283 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:27.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.009+0000 7f1086000640 1 --2- 172.21.15.106:0/189350283 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1090155a80 0x7f1090158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.009+0000 7f108f400640 1 --2- 172.21.15.106:0/189350283 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1090155e50 0x7f10900a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.009+0000 7f108ea00640 1 -- 172.21.15.106:0/189350283 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1090155e50 msgr2=0x7f10900a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.009+0000 7f108ea00640 1 --2- 172.21.15.106:0/189350283 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1090155e50 0x7f10900a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.009+0000 7f108ea00640 1 -- 172.21.15.106:0/189350283 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1090155a80 msgr2=0x7f1090158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.009+0000 7f108ea00640 1 --2- 172.21.15.106:0/189350283 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1090155a80 0x7f1090158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.009+0000 7f108ea00640 1 -- 172.21.15.106:0/189350283 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1080009390 con 0x7f10900c7db0 2024-08-17T02:28:27.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.009+0000 7f1086000640 1 --2- 172.21.15.106:0/189350283 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1090155a80 0x7f1090158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:27.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.009+0000 7f108ea00640 1 --2- 172.21.15.106:0/189350283 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10900c7db0 0x7f1090152610 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f108000ec80 tx=0x7f10800090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:27.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.009+0000 7f1086a00640 1 -- 172.21.15.106:0/189350283 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108000eec0 con 0x7f10900c7db0 2024-08-17T02:28:27.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.009+0000 7f1086a00640 1 -- 172.21.15.106:0/189350283 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108000cbc0 con 0x7f10900c7db0 2024-08-17T02:28:27.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.009+0000 7f1086a00640 1 -- 172.21.15.106:0/189350283 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1080013470 con 0x7f10900c7db0 2024-08-17T02:28:27.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.009+0000 7f1095a00640 1 -- 172.21.15.106:0/189350283 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1078009390 con 0x7f10900c7db0 2024-08-17T02:28:27.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.010+0000 7f1095a00640 1 -- 172.21.15.106:0/189350283 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1090156d80 con 0x7f10900c7db0 2024-08-17T02:28:27.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.010+0000 7f1095a00640 1 -- 172.21.15.106:0/189350283 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1090071050 con 0x7f10900c7db0 2024-08-17T02:28:27.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.011+0000 7f1086a00640 1 -- 172.21.15.106:0/189350283 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f10800137e0 con 0x7f10900c7db0 2024-08-17T02:28:27.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.012+0000 7f1086a00640 1 --2- 172.21.15.106:0/189350283 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f106c065150 0x7f106c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.012+0000 7f1086a00640 1 -- 172.21.15.106:0/189350283 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f10800828f0 con 0x7f10900c7db0 2024-08-17T02:28:27.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.012+0000 7f1086000640 1 --2- 172.21.15.106:0/189350283 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f106c065150 0x7f106c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.013+0000 7f1086000640 1 --2- 172.21.15.106:0/189350283 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f106c065150 0x7f106c067600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1078034000 tx=0x7f1078032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:27.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.016+0000 7f1086a00640 1 -- 172.21.15.106:0/189350283 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1080050910 con 0x7f10900c7db0 2024-08-17T02:28:27.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.187+0000 7f1095a00640 1 -- 172.21.15.106:0/189350283 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f109006aa10 con 0x7f10900c7db0 2024-08-17T02:28:27.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.187+0000 7f1086a00640 1 -- 172.21.15.106:0/189350283 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f10800170a0 con 0x7f10900c7db0 2024-08-17T02:28:27.190 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-08-17T02:28:27.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.189+0000 7f1095a00640 1 -- 172.21.15.106:0/189350283 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f106c065150 msgr2=0x7f106c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.189+0000 7f1095a00640 1 --2- 172.21.15.106:0/189350283 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f106c065150 0x7f106c067600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1078034000 tx=0x7f1078032000 comp rx=0 tx=0).stop 2024-08-17T02:28:27.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.189+0000 7f1095a00640 1 -- 172.21.15.106:0/189350283 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10900c7db0 msgr2=0x7f1090152610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.189+0000 7f1095a00640 1 --2- 172.21.15.106:0/189350283 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10900c7db0 0x7f1090152610 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f108000ec80 tx=0x7f10800090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.189+0000 7f1095a00640 1 -- 172.21.15.106:0/189350283 shutdown_connections 2024-08-17T02:28:27.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.189+0000 7f1095a00640 1 --2- 172.21.15.106:0/189350283 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1090155e50 0x7f10900a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.189+0000 7f1095a00640 1 --2- 172.21.15.106:0/189350283 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1090155a80 0x7f1090158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.189+0000 7f1095a00640 1 --2- 172.21.15.106:0/189350283 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f106c065150 0x7f106c067600 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.189+0000 7f1095a00640 1 --2- 172.21.15.106:0/189350283 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10900c7db0 0x7f1090152610 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.189+0000 7f1095a00640 1 -- 172.21.15.106:0/189350283 >> 172.21.15.106:0/189350283 conn(0x7f1090067750 msgr2=0x7f10900ca6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:27.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.189+0000 7f1095a00640 1 -- 172.21.15.106:0/189350283 shutdown_connections 2024-08-17T02:28:27.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.189+0000 7f1095a00640 1 -- 172.21.15.106:0/189350283 wait complete. 2024-08-17T02:28:27.204 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:27.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.351+0000 7fe3d2a00640 1 Processor -- start 2024-08-17T02:28:27.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.351+0000 7fe3d2a00640 1 -- start start 2024-08-17T02:28:27.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.352+0000 7fe3d2a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe3cc06da20 0x7fe3cc06ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.352+0000 7fe3d2a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe3cc0aa7d0 0x7fe3cc158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.352+0000 7fe3d2a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3cc158dd0 0x7fe3cc0ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.352+0000 7fe3d2a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3cc0ac400 con 0x7fe3cc0aa7d0 2024-08-17T02:28:27.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.352+0000 7fe3d2a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3cc0a9a10 con 0x7fe3cc06da20 2024-08-17T02:28:27.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.352+0000 7fe3d2a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc0a9cf0 con 0x7fe3cc158dd0 2024-08-17T02:28:27.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.353+0000 7fe3c3400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe3cc0aa7d0 0x7fe3cc158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.353+0000 7fe3c3400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe3cc0aa7d0 0x7fe3cc158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44922/0 (socket says 172.21.15.106:44922) 2024-08-17T02:28:27.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.353+0000 7fe3c3400640 1 -- 172.21.15.106:0/1886704563 learned_addr learned my addr 172.21.15.106:0/1886704563 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:27.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.353+0000 7fe3d0a00640 1 --2- 172.21.15.106:0/1886704563 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3cc158dd0 0x7fe3cc0ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.353+0000 7fe3cbe00640 1 --2- 172.21.15.106:0/1886704563 >> v2:172.21.15.171:3300/0 conn(0x7fe3cc06da20 0x7fe3cc06ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.353+0000 7fe3c3400640 1 -- 172.21.15.106:0/1886704563 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3cc158dd0 msgr2=0x7fe3cc0ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:27.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.353+0000 7fe3c3400640 1 --2- 172.21.15.106:0/1886704563 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3cc158dd0 0x7fe3cc0ab6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.353+0000 7fe3c3400640 1 -- 172.21.15.106:0/1886704563 >> v2:172.21.15.171:3300/0 conn(0x7fe3cc06da20 msgr2=0x7fe3cc06ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:27.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.353+0000 7fe3c3400640 1 --2- 172.21.15.106:0/1886704563 >> v2:172.21.15.171:3300/0 conn(0x7fe3cc06da20 0x7fe3cc06ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.353+0000 7fe3c3400640 1 -- 172.21.15.106:0/1886704563 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3cc0a9fd0 con 0x7fe3cc0aa7d0 2024-08-17T02:28:27.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.353+0000 7fe3cbe00640 1 --2- 172.21.15.106:0/1886704563 >> v2:172.21.15.171:3300/0 conn(0x7fe3cc06da20 0x7fe3cc06ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:27.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.354+0000 7fe3c3400640 1 --2- 172.21.15.106:0/1886704563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3cc0aa7d0 0x7fe3cc158890 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc068280 tx=0x7fe3b40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce46f951f21cef2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:27.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.354+0000 7fe3cb400640 1 -- 172.21.15.106:0/1886704563 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b402ad40 con 0x7fe3cc0aa7d0 2024-08-17T02:28:27.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.355+0000 7fe3cb400640 1 -- 172.21.15.106:0/1886704563 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b4032440 con 0x7fe3cc0aa7d0 2024-08-17T02:28:27.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.355+0000 7fe3cb400640 1 -- 172.21.15.106:0/1886704563 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b402aea0 con 0x7fe3cc0aa7d0 2024-08-17T02:28:27.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.355+0000 7fe3d2a00640 1 -- 172.21.15.106:0/1886704563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3cc0aa7d0 msgr2=0x7fe3cc158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.355+0000 7fe3d2a00640 1 --2- 172.21.15.106:0/1886704563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3cc0aa7d0 0x7fe3cc158890 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc068280 tx=0x7fe3b40091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.355+0000 7fe3d2a00640 1 -- 172.21.15.106:0/1886704563 shutdown_connections 2024-08-17T02:28:27.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.355+0000 7fe3d2a00640 1 --2- 172.21.15.106:0/1886704563 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3cc158dd0 0x7fe3cc0ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.355+0000 7fe3d2a00640 1 --2- 172.21.15.106:0/1886704563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3cc0aa7d0 0x7fe3cc158890 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.355+0000 7fe3d2a00640 1 --2- 172.21.15.106:0/1886704563 >> v2:172.21.15.171:3300/0 conn(0x7fe3cc06da20 0x7fe3cc06ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.355+0000 7fe3d2a00640 1 -- 172.21.15.106:0/1886704563 >> 172.21.15.106:0/1886704563 conn(0x7fe3cc0cb9b0 msgr2=0x7fe3cc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:27.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.355+0000 7fe3d2a00640 1 -- 172.21.15.106:0/1886704563 shutdown_connections 2024-08-17T02:28:27.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.355+0000 7fe3d2a00640 1 -- 172.21.15.106:0/1886704563 wait complete. 2024-08-17T02:28:27.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.356+0000 7fe3d2a00640 1 Processor -- start 2024-08-17T02:28:27.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.357+0000 7fe3d2a00640 1 -- start start 2024-08-17T02:28:27.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.357+0000 7fe3d2a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3cc06da20 0x7fe3cc15a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.357+0000 7fe3d2a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3cc0aa7d0 0x7fe3cc15b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.357+0000 7fe3d2a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3cc158dd0 0x7fe3cc1492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.357+0000 7fe3d2a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc15b7c0 con 0x7fe3cc06da20 2024-08-17T02:28:27.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.357+0000 7fe3d2a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc0aea20 con 0x7fe3cc158dd0 2024-08-17T02:28:27.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.357+0000 7fe3d2a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc15b9f0 con 0x7fe3cc0aa7d0 2024-08-17T02:28:27.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.358+0000 7fe3cbe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3cc06da20 0x7fe3cc15a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.358+0000 7fe3cbe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3cc06da20 0x7fe3cc15a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44924/0 (socket says 172.21.15.106:44924) 2024-08-17T02:28:27.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.358+0000 7fe3cbe00640 1 -- 172.21.15.106:0/3508945026 learned_addr learned my addr 172.21.15.106:0/3508945026 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:27.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.358+0000 7fe3d0a00640 1 --2- 172.21.15.106:0/3508945026 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3cc158dd0 0x7fe3cc1492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.358+0000 7fe3c3400640 1 --2- 172.21.15.106:0/3508945026 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3cc0aa7d0 0x7fe3cc15b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.358+0000 7fe3cbe00640 1 -- 172.21.15.106:0/3508945026 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3cc0aa7d0 msgr2=0x7fe3cc15b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.358+0000 7fe3cbe00640 1 --2- 172.21.15.106:0/3508945026 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3cc0aa7d0 0x7fe3cc15b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.358+0000 7fe3cbe00640 1 -- 172.21.15.106:0/3508945026 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3cc158dd0 msgr2=0x7fe3cc1492d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.358+0000 7fe3cbe00640 1 --2- 172.21.15.106:0/3508945026 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3cc158dd0 0x7fe3cc1492d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.358+0000 7fe3cbe00640 1 -- 172.21.15.106:0/3508945026 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b4009450 con 0x7fe3cc06da20 2024-08-17T02:28:27.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.358+0000 7fe3cbe00640 1 --2- 172.21.15.106:0/3508945026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3cc06da20 0x7fe3cc15a440 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00a400 tx=0x7fe3bc007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:27.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.359+0000 7fe3c3e00640 1 -- 172.21.15.106:0/3508945026 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc00d650 con 0x7fe3cc06da20 2024-08-17T02:28:27.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.359+0000 7fe3c3e00640 1 -- 172.21.15.106:0/3508945026 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc00d7b0 con 0x7fe3cc06da20 2024-08-17T02:28:27.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.359+0000 7fe3c3e00640 1 -- 172.21.15.106:0/3508945026 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc00db50 con 0x7fe3cc06da20 2024-08-17T02:28:27.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.359+0000 7fe3d2a00640 1 -- 172.21.15.106:0/3508945026 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3cc15bcd0 con 0x7fe3cc06da20 2024-08-17T02:28:27.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.359+0000 7fe3d2a00640 1 -- 172.21.15.106:0/3508945026 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3cc0aefa0 con 0x7fe3cc06da20 2024-08-17T02:28:27.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.360+0000 7fe3d2a00640 1 -- 172.21.15.106:0/3508945026 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3cc15be60 con 0x7fe3cc06da20 2024-08-17T02:28:27.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.360+0000 7fe3c3e00640 1 -- 172.21.15.106:0/3508945026 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe3bc015440 con 0x7fe3cc06da20 2024-08-17T02:28:27.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.361+0000 7fe3c3e00640 1 --2- 172.21.15.106:0/3508945026 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe3a8065150 0x7fe3a8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.361+0000 7fe3c3e00640 1 -- 172.21.15.106:0/3508945026 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe3bc082dd0 con 0x7fe3cc06da20 2024-08-17T02:28:27.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.361+0000 7fe3c3400640 1 --2- 172.21.15.106:0/3508945026 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe3a8065150 0x7fe3a8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.362+0000 7fe3c3400640 1 --2- 172.21.15.106:0/3508945026 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe3a8065150 0x7fe3a8067600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4034000 tx=0x7fe3b4032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:27.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.365+0000 7fe3c3e00640 1 -- 172.21.15.106:0/3508945026 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe3bc04ee40 con 0x7fe3cc06da20 2024-08-17T02:28:27.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.573+0000 7fe3d2a00640 1 -- 172.21.15.106:0/3508945026 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3cc064db0 con 0x7fe3cc06da20 2024-08-17T02:28:27.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.574+0000 7fe3c3e00640 1 -- 172.21.15.106:0/3508945026 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7fe3bc01a020 con 0x7fe3cc06da20 2024-08-17T02:28:27.575 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:27.575 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1696744783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1696744783},{"type":"v1","addr":"172.21.15.106:6837","nonce":1696744783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/966571689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":966571689},{"type":"v1","addr":"172.21.15.171:6833","nonce":966571689}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/3205379168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3205379168},{"type":"v1","addr":"172.21.15.106:6836","nonce":3205379168}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:50.683483+0000","modified":"2024-08-17T02:27:54.296580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6835/3901195482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3901195482},{"type":"v1","addr":"172.21.15.171:6835","nonce":3901195482}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:28:27.575 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 8 2024-08-17T02:28:27.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.576+0000 7fe3d2a00640 1 -- 172.21.15.106:0/3508945026 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe3a8065150 msgr2=0x7fe3a8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.576+0000 7fe3d2a00640 1 --2- 172.21.15.106:0/3508945026 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe3a8065150 0x7fe3a8067600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4034000 tx=0x7fe3b4032000 comp rx=0 tx=0).stop 2024-08-17T02:28:27.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.576+0000 7fe3d2a00640 1 -- 172.21.15.106:0/3508945026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3cc06da20 msgr2=0x7fe3cc15a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.576+0000 7fe3d2a00640 1 --2- 172.21.15.106:0/3508945026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3cc06da20 0x7fe3cc15a440 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc00a400 tx=0x7fe3bc007910 comp rx=0 tx=0).stop 2024-08-17T02:28:27.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.576+0000 7fe3d2a00640 1 -- 172.21.15.106:0/3508945026 shutdown_connections 2024-08-17T02:28:27.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.576+0000 7fe3d2a00640 1 --2- 172.21.15.106:0/3508945026 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3cc158dd0 0x7fe3cc1492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.576+0000 7fe3d2a00640 1 --2- 172.21.15.106:0/3508945026 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe3cc0aa7d0 0x7fe3cc15b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.576+0000 7fe3d2a00640 1 --2- 172.21.15.106:0/3508945026 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe3a8065150 0x7fe3a8067600 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.576+0000 7fe3d2a00640 1 --2- 172.21.15.106:0/3508945026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3cc06da20 0x7fe3cc15a440 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.576+0000 7fe3d2a00640 1 -- 172.21.15.106:0/3508945026 >> 172.21.15.106:0/3508945026 conn(0x7fe3cc0cb9b0 msgr2=0x7fe3cc1579a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:27.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.576+0000 7fe3d2a00640 1 -- 172.21.15.106:0/3508945026 shutdown_connections 2024-08-17T02:28:27.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.576+0000 7fe3d2a00640 1 -- 172.21.15.106:0/3508945026 wait complete. 2024-08-17T02:28:27.592 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:27.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.739+0000 7fbd16200640 1 Processor -- start 2024-08-17T02:28:27.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.739+0000 7fbd16200640 1 -- start start 2024-08-17T02:28:27.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.740+0000 7fbd16200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fbd101401b0 0x7fbd100caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.740+0000 7fbd16200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbd10140580 0x7fbd100b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.740+0000 7fbd16200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd100b16d0 con 0x7fbd100b1270 2024-08-17T02:28:27.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.740+0000 7fbd16200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd100cb450 con 0x7fbd101401b0 2024-08-17T02:28:27.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.740+0000 7fbd16200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd100caa80 con 0x7fbd10140580 2024-08-17T02:28:27.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.741+0000 7fbd0ea00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbd10140580 0x7fbd100b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.741+0000 7fbd0fe00640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fbd100b1270 0x7fbd100c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:58974/0 (socket says 172.21.15.106:58974) 2024-08-17T02:28:27.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.741+0000 7fbd0fe00640 1 -- 172.21.15.106:0/2459986987 learned_addr learned my addr 172.21.15.106:0/2459986987 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:27.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.741+0000 7fbd0f400640 1 --2- 172.21.15.106:0/2459986987 >> v2:172.21.15.171:3300/0 conn(0x7fbd101401b0 0x7fbd100caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.741+0000 7fbd0e000640 1 -- 172.21.15.106:0/2459986987 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3771900238 0 0) 0x7fbd08001490 con 0x7fbd100b1270 2024-08-17T02:28:27.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.741+0000 7fbd0e000640 1 -- 172.21.15.106:0/2459986987 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcf40034e0 con 0x7fbd100b1270 2024-08-17T02:28:27.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.742+0000 7fbd0ea00640 1 -- 172.21.15.106:0/2459986987 >> v2:172.21.15.171:3300/0 conn(0x7fbd101401b0 msgr2=0x7fbd100caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.742+0000 7fbd0ea00640 1 --2- 172.21.15.106:0/2459986987 >> v2:172.21.15.171:3300/0 conn(0x7fbd101401b0 0x7fbd100caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.742+0000 7fbd0ea00640 1 -- 172.21.15.106:0/2459986987 >> v1:172.21.15.171:6789/0 conn(0x7fbd100b1270 legacy=0x7fbd100c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.742+0000 7fbd0ea00640 1 -- 172.21.15.106:0/2459986987 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd100c9e70 con 0x7fbd10140580 2024-08-17T02:28:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.742+0000 7fbd0f400640 1 --2- 172.21.15.106:0/2459986987 >> v2:172.21.15.171:3300/0 conn(0x7fbd101401b0 0x7fbd100caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.743+0000 7fbd0ea00640 1 --2- 172.21.15.106:0/2459986987 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbd10140580 0x7fbd100b0d30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc009850 tx=0x7fbcfc0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e4687ae57d2eb3e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.743+0000 7fbd0e000640 1 -- 172.21.15.106:0/2459986987 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc02ad00 con 0x7fbd10140580 2024-08-17T02:28:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.743+0000 7fbd0e000640 1 -- 172.21.15.106:0/2459986987 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcfc02ae60 con 0x7fbd10140580 2024-08-17T02:28:27.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.743+0000 7fbd0e000640 1 -- 172.21.15.106:0/2459986987 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc032670 con 0x7fbd10140580 2024-08-17T02:28:27.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.743+0000 7fbd16200640 1 -- 172.21.15.106:0/2459986987 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbd10140580 msgr2=0x7fbd100b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.743+0000 7fbd16200640 1 --2- 172.21.15.106:0/2459986987 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbd10140580 0x7fbd100b0d30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc009850 tx=0x7fbcfc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.744+0000 7fbd16200640 1 -- 172.21.15.106:0/2459986987 shutdown_connections 2024-08-17T02:28:27.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.744+0000 7fbd16200640 1 --2- 172.21.15.106:0/2459986987 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbd10140580 0x7fbd100b0d30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.744+0000 7fbd16200640 1 --2- 172.21.15.106:0/2459986987 >> v2:172.21.15.171:3300/0 conn(0x7fbd101401b0 0x7fbd100caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.744+0000 7fbd16200640 1 -- 172.21.15.106:0/2459986987 >> 172.21.15.106:0/2459986987 conn(0x7fbd100cb9b0 msgr2=0x7fbd100cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:27.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.744+0000 7fbd16200640 1 -- 172.21.15.106:0/2459986987 shutdown_connections 2024-08-17T02:28:27.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.744+0000 7fbd16200640 1 -- 172.21.15.106:0/2459986987 wait complete. 2024-08-17T02:28:27.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.745+0000 7fbd16200640 1 Processor -- start 2024-08-17T02:28:27.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.745+0000 7fbd16200640 1 -- start start 2024-08-17T02:28:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.746+0000 7fbd16200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd100b1270 0x7fbd10158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.746+0000 7fbd16200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd101401b0 0x7fbd101699c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.746+0000 7fbd16200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbd10140580 0x7fbd100ab430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.746+0000 7fbd16200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd100c1400 con 0x7fbd100b1270 2024-08-17T02:28:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.746+0000 7fbd16200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd10159260 con 0x7fbd101401b0 2024-08-17T02:28:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.746+0000 7fbd16200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd100c3b00 con 0x7fbd10140580 2024-08-17T02:28:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.746+0000 7fbd0f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd100b1270 0x7fbd10158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.746+0000 7fbd0f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd100b1270 0x7fbd10158d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44936/0 (socket says 172.21.15.106:44936) 2024-08-17T02:28:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.746+0000 7fbd0f400640 1 -- 172.21.15.106:0/3523823207 learned_addr learned my addr 172.21.15.106:0/3523823207 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.747+0000 7fbd0ea00640 1 --2- 172.21.15.106:0/3523823207 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd101401b0 0x7fbd101699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.747+0000 7fbd0f400640 1 -- 172.21.15.106:0/3523823207 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbd10140580 msgr2=0x7fbd100ab430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.747+0000 7fbd0f400640 1 --2- 172.21.15.106:0/3523823207 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbd10140580 0x7fbd100ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.747+0000 7fbd0f400640 1 -- 172.21.15.106:0/3523823207 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd101401b0 msgr2=0x7fbd101699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.747+0000 7fbd0f400640 1 --2- 172.21.15.106:0/3523823207 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd101401b0 0x7fbd101699c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.747+0000 7fbd0f400640 1 -- 172.21.15.106:0/3523823207 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd00009390 con 0x7fbd100b1270 2024-08-17T02:28:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.747+0000 7fbd0f400640 1 --2- 172.21.15.106:0/3523823207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd100b1270 0x7fbd10158d20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbd0000eaa0 tx=0x7fbd000090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.747+0000 7fbd06a00640 1 -- 172.21.15.106:0/3523823207 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0000ca10 con 0x7fbd100b1270 2024-08-17T02:28:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.747+0000 7fbd16200640 1 -- 172.21.15.106:0/3523823207 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcfc009390 con 0x7fbd100b1270 2024-08-17T02:28:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.747+0000 7fbd06a00640 1 -- 172.21.15.106:0/3523823207 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0000cb70 con 0x7fbd100b1270 2024-08-17T02:28:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.747+0000 7fbd06a00640 1 -- 172.21.15.106:0/3523823207 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd00013470 con 0x7fbd100b1270 2024-08-17T02:28:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.747+0000 7fbd16200640 1 -- 172.21.15.106:0/3523823207 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd100c3820 con 0x7fbd100b1270 2024-08-17T02:28:27.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.748+0000 7fbd16200640 1 -- 172.21.15.106:0/3523823207 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd10064db0 con 0x7fbd100b1270 2024-08-17T02:28:27.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.749+0000 7fbd06a00640 1 -- 172.21.15.106:0/3523823207 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbd00013820 con 0x7fbd100b1270 2024-08-17T02:28:27.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.750+0000 7fbd06a00640 1 --2- 172.21.15.106:0/3523823207 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fbcf0065150 0x7fbcf0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.750+0000 7fbd06a00640 1 -- 172.21.15.106:0/3523823207 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbd000828a0 con 0x7fbd100b1270 2024-08-17T02:28:27.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.750+0000 7fbd0ea00640 1 --2- 172.21.15.106:0/3523823207 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fbcf0065150 0x7fbcf0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.751+0000 7fbd0ea00640 1 --2- 172.21.15.106:0/3523823207 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fbcf0065150 0x7fbcf0067600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc034000 tx=0x7fbcfc032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:27.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.754+0000 7fbd06a00640 1 -- 172.21.15.106:0/3523823207 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbd000508c0 con 0x7fbd100b1270 2024-08-17T02:28:27.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.927+0000 7fbd16200640 1 -- 172.21.15.106:0/3523823207 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd100caf10 con 0x7fbd100b1270 2024-08-17T02:28:27.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.928+0000 7fbd06a00640 1 -- 172.21.15.106:0/3523823207 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fbd00021090 con 0x7fbd100b1270 2024-08-17T02:28:27.928 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:27.928 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:27:52.284039+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:48.547438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:49.671073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:27.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.930+0000 7fbd16200640 1 -- 172.21.15.106:0/3523823207 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fbcf0065150 msgr2=0x7fbcf0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.930+0000 7fbd16200640 1 --2- 172.21.15.106:0/3523823207 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fbcf0065150 0x7fbcf0067600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc034000 tx=0x7fbcfc032000 comp rx=0 tx=0).stop 2024-08-17T02:28:27.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.930+0000 7fbd16200640 1 -- 172.21.15.106:0/3523823207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd100b1270 msgr2=0x7fbd10158d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.930+0000 7fbd16200640 1 --2- 172.21.15.106:0/3523823207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd100b1270 0x7fbd10158d20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbd0000eaa0 tx=0x7fbd000090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.930+0000 7fbd16200640 1 -- 172.21.15.106:0/3523823207 shutdown_connections 2024-08-17T02:28:27.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.930+0000 7fbd16200640 1 --2- 172.21.15.106:0/3523823207 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbd10140580 0x7fbd100ab430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.930+0000 7fbd16200640 1 --2- 172.21.15.106:0/3523823207 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd101401b0 0x7fbd101699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.930+0000 7fbd16200640 1 --2- 172.21.15.106:0/3523823207 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fbcf0065150 0x7fbcf0067600 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.930+0000 7fbd16200640 1 --2- 172.21.15.106:0/3523823207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd100b1270 0x7fbd10158d20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.930+0000 7fbd16200640 1 -- 172.21.15.106:0/3523823207 >> 172.21.15.106:0/3523823207 conn(0x7fbd100cb9b0 msgr2=0x7fbd1013ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:27.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.930+0000 7fbd16200640 1 -- 172.21.15.106:0/3523823207 shutdown_connections 2024-08-17T02:28:27.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:27.930+0000 7fbd16200640 1 -- 172.21.15.106:0/3523823207 wait complete. 2024-08-17T02:28:27.947 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:28:27.947 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:28.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.094+0000 7fa665800640 1 Processor -- start 2024-08-17T02:28:28.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.095+0000 7fa665800640 1 -- start start 2024-08-17T02:28:28.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.096+0000 7fa665800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa6601401b0 0x7fa6600caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.096+0000 7fa665800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6600caa80 con 0x7fa660140580 2024-08-17T02:28:28.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.096+0000 7fa665800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6600c9e70 con 0x7fa6600b1440 2024-08-17T02:28:28.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.096+0000 7fa665800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6600cb450 con 0x7fa6601401b0 2024-08-17T02:28:28.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.096+0000 7fa65ea00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa6601401b0 0x7fa6600caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:28.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.096+0000 7fa65e000640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa660140580 0x7fa6600b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39776/0 (socket says 172.21.15.106:39776) 2024-08-17T02:28:28.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.096+0000 7fa65e000640 1 -- 172.21.15.106:0/565389424 learned_addr learned my addr 172.21.15.106:0/565389424 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:28.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.096+0000 7fa65ea00640 1 -- 172.21.15.106:0/565389424 >> v1:172.21.15.171:6789/0 conn(0x7fa6600b1440 legacy=0x7fa6600c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:28.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.097+0000 7fa65ea00640 1 -- 172.21.15.106:0/565389424 >> v1:172.21.15.106:6789/0 conn(0x7fa660140580 legacy=0x7fa6600b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.097+0000 7fa65ea00640 1 -- 172.21.15.106:0/565389424 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6600ca150 con 0x7fa6601401b0 2024-08-17T02:28:28.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.097+0000 7fa65d600640 1 -- 172.21.15.106:0/565389424 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836501284 0 0) 0x7fa6600caa80 con 0x7fa660140580 2024-08-17T02:28:28.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.098+0000 7fa65ea00640 1 --2- 172.21.15.106:0/565389424 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6601401b0 0x7fa6600caf10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa650009850 tx=0x7fa6500090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74959770bfbe597f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:28.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.098+0000 7fa65d600640 1 -- 172.21.15.106:0/565389424 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65002ad00 con 0x7fa6601401b0 2024-08-17T02:28:28.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.098+0000 7fa65d600640 1 -- 172.21.15.106:0/565389424 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65002ae60 con 0x7fa6601401b0 2024-08-17T02:28:28.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.098+0000 7fa65d600640 1 -- 172.21.15.106:0/565389424 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa650032670 con 0x7fa6601401b0 2024-08-17T02:28:28.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.098+0000 7fa665800640 1 -- 172.21.15.106:0/565389424 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6601401b0 msgr2=0x7fa6600caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.098+0000 7fa665800640 1 --2- 172.21.15.106:0/565389424 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6601401b0 0x7fa6600caf10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa650009850 tx=0x7fa6500090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.098+0000 7fa665800640 1 -- 172.21.15.106:0/565389424 shutdown_connections 2024-08-17T02:28:28.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.098+0000 7fa665800640 1 --2- 172.21.15.106:0/565389424 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6601401b0 0x7fa6600caf10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.098+0000 7fa665800640 1 -- 172.21.15.106:0/565389424 >> 172.21.15.106:0/565389424 conn(0x7fa6600cb9b0 msgr2=0x7fa6600cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:28.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.099+0000 7fa665800640 1 -- 172.21.15.106:0/565389424 shutdown_connections 2024-08-17T02:28:28.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.099+0000 7fa665800640 1 -- 172.21.15.106:0/565389424 wait complete. 2024-08-17T02:28:28.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.100+0000 7fa665800640 1 Processor -- start 2024-08-17T02:28:28.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.100+0000 7fa665800640 1 -- start start 2024-08-17T02:28:28.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.101+0000 7fa665800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6600b1440 0x7fa66015cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.101+0000 7fa665800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6601401b0 0x7fa6600af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.101+0000 7fa665800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa660140580 0x7fa660156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.101+0000 7fa665800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6600aad10 con 0x7fa6600b1440 2024-08-17T02:28:28.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.101+0000 7fa665800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6600afa20 con 0x7fa6601401b0 2024-08-17T02:28:28.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.101+0000 7fa665800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6600afca0 con 0x7fa660140580 2024-08-17T02:28:28.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.101+0000 7fa65ea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6600b1440 0x7fa66015cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:28.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.101+0000 7fa65ea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6600b1440 0x7fa66015cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44950/0 (socket says 172.21.15.106:44950) 2024-08-17T02:28:28.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.101+0000 7fa65ea00640 1 -- 172.21.15.106:0/711098486 learned_addr learned my addr 172.21.15.106:0/711098486 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:28.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.101+0000 7fa65e000640 1 --2- 172.21.15.106:0/711098486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6601401b0 0x7fa6600af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:28.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.101+0000 7fa65f400640 1 --2- 172.21.15.106:0/711098486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa660140580 0x7fa660156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:28.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.102+0000 7fa65ea00640 1 -- 172.21.15.106:0/711098486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa660140580 msgr2=0x7fa660156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.102+0000 7fa65ea00640 1 --2- 172.21.15.106:0/711098486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa660140580 0x7fa660156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.102+0000 7fa65ea00640 1 -- 172.21.15.106:0/711098486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6601401b0 msgr2=0x7fa6600af4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.102+0000 7fa65ea00640 1 --2- 172.21.15.106:0/711098486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6601401b0 0x7fa6600af4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.102+0000 7fa65ea00640 1 -- 172.21.15.106:0/711098486 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa650009390 con 0x7fa6600b1440 2024-08-17T02:28:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.102+0000 7fa65ea00640 1 --2- 172.21.15.106:0/711098486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6600b1440 0x7fa66015cd70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa6500098b0 tx=0x7fa650032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.102+0000 7fa656000640 1 -- 172.21.15.106:0/711098486 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa650031800 con 0x7fa6600b1440 2024-08-17T02:28:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.102+0000 7fa656000640 1 -- 172.21.15.106:0/711098486 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa650031980 con 0x7fa6600b1440 2024-08-17T02:28:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.102+0000 7fa656000640 1 -- 172.21.15.106:0/711098486 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa650031d40 con 0x7fa6600b1440 2024-08-17T02:28:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.102+0000 7fa665800640 1 -- 172.21.15.106:0/711098486 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6600aff80 con 0x7fa6600b1440 2024-08-17T02:28:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.103+0000 7fa665800640 1 -- 172.21.15.106:0/711098486 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa660156a80 con 0x7fa6600b1440 2024-08-17T02:28:28.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.103+0000 7fa665800640 1 -- 172.21.15.106:0/711098486 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6600aab00 con 0x7fa6600b1440 2024-08-17T02:28:28.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.104+0000 7fa656000640 1 -- 172.21.15.106:0/711098486 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa650044030 con 0x7fa6600b1440 2024-08-17T02:28:28.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.105+0000 7fa656000640 1 --2- 172.21.15.106:0/711098486 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa640065150 0x7fa640067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.105+0000 7fa656000640 1 -- 172.21.15.106:0/711098486 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa650042070 con 0x7fa6600b1440 2024-08-17T02:28:28.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.105+0000 7fa65e000640 1 --2- 172.21.15.106:0/711098486 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa640065150 0x7fa640067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:28.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.106+0000 7fa65e000640 1 --2- 172.21.15.106:0/711098486 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa640065150 0x7fa640067600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa6600c7cd0 tx=0x7fa64c007ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:28.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.109+0000 7fa656000640 1 -- 172.21.15.106:0/711098486 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa6600aab00 con 0x7fa6600b1440 2024-08-17T02:28:28.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.314+0000 7fa665800640 1 -- 172.21.15.106:0/711098486 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6600aab00 con 0x7fa6600b1440 2024-08-17T02:28:28.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.314+0000 7fa656000640 1 -- 172.21.15.106:0/711098486 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7fa6600aab00 con 0x7fa6600b1440 2024-08-17T02:28:28.315 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:28.315 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1696744783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1696744783},{"type":"v1","addr":"172.21.15.106:6837","nonce":1696744783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/966571689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":966571689},{"type":"v1","addr":"172.21.15.171:6833","nonce":966571689}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/3205379168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3205379168},{"type":"v1","addr":"172.21.15.106:6836","nonce":3205379168}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:50.683483+0000","modified":"2024-08-17T02:27:54.296580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6835/3901195482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3901195482},{"type":"v1","addr":"172.21.15.171:6835","nonce":3901195482}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:28:28.316 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 8 2024-08-17T02:28:28.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.316+0000 7fa665800640 1 -- 172.21.15.106:0/711098486 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa640065150 msgr2=0x7fa640067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.316+0000 7fa665800640 1 --2- 172.21.15.106:0/711098486 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa640065150 0x7fa640067600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa6600c7cd0 tx=0x7fa64c007ca0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.316+0000 7fa665800640 1 -- 172.21.15.106:0/711098486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6600b1440 msgr2=0x7fa66015cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.316+0000 7fa665800640 1 --2- 172.21.15.106:0/711098486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6600b1440 0x7fa66015cd70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa6500098b0 tx=0x7fa650032000 comp rx=0 tx=0).stop 2024-08-17T02:28:28.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.316+0000 7fa665800640 1 -- 172.21.15.106:0/711098486 shutdown_connections 2024-08-17T02:28:28.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.316+0000 7fa665800640 1 --2- 172.21.15.106:0/711098486 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa660140580 0x7fa660156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.316+0000 7fa665800640 1 --2- 172.21.15.106:0/711098486 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6601401b0 0x7fa6600af4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.316+0000 7fa665800640 1 --2- 172.21.15.106:0/711098486 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa640065150 0x7fa640067600 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.316+0000 7fa665800640 1 --2- 172.21.15.106:0/711098486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa6600b1440 0x7fa66015cd70 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.316+0000 7fa665800640 1 -- 172.21.15.106:0/711098486 >> 172.21.15.106:0/711098486 conn(0x7fa6600cb9b0 msgr2=0x7fa6600cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:28.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.317+0000 7fa665800640 1 -- 172.21.15.106:0/711098486 shutdown_connections 2024-08-17T02:28:28.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.317+0000 7fa665800640 1 -- 172.21.15.106:0/711098486 wait complete. 2024-08-17T02:28:28.332 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:28.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.480+0000 7fd133e00640 1 Processor -- start 2024-08-17T02:28:28.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.480+0000 7fd133e00640 1 -- start start 2024-08-17T02:28:28.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.481+0000 7fd133e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd12c0b1440 0x7fd12c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.481+0000 7fd133e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd12c140580 0x7fd12c0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.481+0000 7fd133e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd12c0caa80 con 0x7fd12c1401b0 2024-08-17T02:28:28.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.482+0000 7fd133e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd12c0cb450 con 0x7fd12c140580 2024-08-17T02:28:28.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.482+0000 7fd133e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c0c9e70 con 0x7fd12c0b1440 2024-08-17T02:28:28.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.482+0000 7fd130a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd12c0b1440 0x7fd12c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:28.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.482+0000 7fd131e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd12c140580 0x7fd12c0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:28.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.482+0000 7fd130a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd12c0b1440 0x7fd12c0caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:32832/0 (socket says 172.21.15.106:32832) 2024-08-17T02:28:28.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.482+0000 7fd130a00640 1 -- 172.21.15.106:0/2022055301 learned_addr learned my addr 172.21.15.106:0/2022055301 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:28.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.482+0000 7fd131400640 1 --1- 172.21.15.106:0/2022055301 >> v1:172.21.15.171:6789/0 conn(0x7fd12c1401b0 0x7fd12c0b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:58996/0 (socket says 172.21.15.106:58996) 2024-08-17T02:28:28.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.483+0000 7fd130a00640 1 -- 172.21.15.106:0/2022055301 >> v2:172.21.15.171:3300/0 conn(0x7fd12c140580 msgr2=0x7fd12c0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:28.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.483+0000 7fd130a00640 1 --2- 172.21.15.106:0/2022055301 >> v2:172.21.15.171:3300/0 conn(0x7fd12c140580 0x7fd12c0c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.483+0000 7fd130a00640 1 -- 172.21.15.106:0/2022055301 >> v1:172.21.15.171:6789/0 conn(0x7fd12c1401b0 legacy=0x7fd12c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.483+0000 7fd130a00640 1 -- 172.21.15.106:0/2022055301 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12c0ca150 con 0x7fd12c0b1440 2024-08-17T02:28:28.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.483+0000 7fd131e00640 1 --2- 172.21.15.106:0/2022055301 >> v2:172.21.15.171:3300/0 conn(0x7fd12c140580 0x7fd12c0c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:28.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.484+0000 7fd130a00640 1 --2- 172.21.15.106:0/2022055301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd12c0b1440 0x7fd12c0caf10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd118009910 tx=0x7fd1180091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2363686299273b92 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:28.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.484+0000 7fd12be00640 1 -- 172.21.15.106:0/2022055301 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11802ae40 con 0x7fd12c0b1440 2024-08-17T02:28:28.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.484+0000 7fd12be00640 1 -- 172.21.15.106:0/2022055301 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd118032440 con 0x7fd12c0b1440 2024-08-17T02:28:28.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.484+0000 7fd12be00640 1 -- 172.21.15.106:0/2022055301 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd118032820 con 0x7fd12c0b1440 2024-08-17T02:28:28.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.485+0000 7fd133e00640 1 -- 172.21.15.106:0/2022055301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd12c0b1440 msgr2=0x7fd12c0caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.485+0000 7fd133e00640 1 --2- 172.21.15.106:0/2022055301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd12c0b1440 0x7fd12c0caf10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd118009910 tx=0x7fd1180091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.485+0000 7fd133e00640 1 -- 172.21.15.106:0/2022055301 shutdown_connections 2024-08-17T02:28:28.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.485+0000 7fd133e00640 1 --2- 172.21.15.106:0/2022055301 >> v2:172.21.15.171:3300/0 conn(0x7fd12c140580 0x7fd12c0c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.485+0000 7fd133e00640 1 --2- 172.21.15.106:0/2022055301 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd12c0b1440 0x7fd12c0caf10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.485+0000 7fd133e00640 1 -- 172.21.15.106:0/2022055301 >> 172.21.15.106:0/2022055301 conn(0x7fd12c0cb9b0 msgr2=0x7fd12c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:28.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.485+0000 7fd133e00640 1 -- 172.21.15.106:0/2022055301 shutdown_connections 2024-08-17T02:28:28.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.485+0000 7fd133e00640 1 -- 172.21.15.106:0/2022055301 wait complete. 2024-08-17T02:28:28.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.486+0000 7fd133e00640 1 Processor -- start 2024-08-17T02:28:28.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.486+0000 7fd133e00640 1 -- start start 2024-08-17T02:28:28.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.487+0000 7fd133e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd12c0b1440 0x7fd12c0c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.487+0000 7fd133e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd12c1401b0 0x7fd12c0c3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.487+0000 7fd133e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd12c140580 0x7fd12c0c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.487+0000 7fd133e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c0ac220 con 0x7fd12c140580 2024-08-17T02:28:28.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.487+0000 7fd133e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c0c1500 con 0x7fd12c0b1440 2024-08-17T02:28:28.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.487+0000 7fd133e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c0c0bd0 con 0x7fd12c1401b0 2024-08-17T02:28:28.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.488+0000 7fd131e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd12c140580 0x7fd12c0c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:28.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.488+0000 7fd131e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd12c140580 0x7fd12c0c3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44966/0 (socket says 172.21.15.106:44966) 2024-08-17T02:28:28.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.488+0000 7fd131e00640 1 -- 172.21.15.106:0/2021778392 learned_addr learned my addr 172.21.15.106:0/2021778392 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:28.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.488+0000 7fd131400640 1 --2- 172.21.15.106:0/2021778392 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd12c0b1440 0x7fd12c0c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:28.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.488+0000 7fd130a00640 1 --2- 172.21.15.106:0/2021778392 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd12c1401b0 0x7fd12c0c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:28.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.488+0000 7fd131e00640 1 -- 172.21.15.106:0/2021778392 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd12c1401b0 msgr2=0x7fd12c0c3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.488+0000 7fd131e00640 1 --2- 172.21.15.106:0/2021778392 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd12c1401b0 0x7fd12c0c3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.488+0000 7fd131e00640 1 -- 172.21.15.106:0/2021778392 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd12c0b1440 msgr2=0x7fd12c0c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.488+0000 7fd131e00640 1 --2- 172.21.15.106:0/2021778392 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd12c0b1440 0x7fd12c0c7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.488+0000 7fd131e00640 1 -- 172.21.15.106:0/2021778392 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd124009a20 con 0x7fd12c140580 2024-08-17T02:28:28.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.488+0000 7fd131e00640 1 --2- 172.21.15.106:0/2021778392 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd12c140580 0x7fd12c0c3a70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd124009fc0 tx=0x7fd12400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:28.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.489+0000 7fd128c00640 1 -- 172.21.15.106:0/2021778392 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12400ce70 con 0x7fd12c140580 2024-08-17T02:28:28.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.489+0000 7fd128c00640 1 -- 172.21.15.106:0/2021778392 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12400f040 con 0x7fd12c140580 2024-08-17T02:28:28.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.489+0000 7fd128c00640 1 -- 172.21.15.106:0/2021778392 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1240146d0 con 0x7fd12c140580 2024-08-17T02:28:28.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.489+0000 7fd133e00640 1 -- 172.21.15.106:0/2021778392 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd118009450 con 0x7fd12c140580 2024-08-17T02:28:28.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.489+0000 7fd133e00640 1 -- 172.21.15.106:0/2021778392 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd12c0c1190 con 0x7fd12c140580 2024-08-17T02:28:28.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.490+0000 7fd133e00640 1 -- 172.21.15.106:0/2021778392 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd12c064db0 con 0x7fd12c140580 2024-08-17T02:28:28.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.491+0000 7fd128c00640 1 -- 172.21.15.106:0/2021778392 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd124003020 con 0x7fd12c140580 2024-08-17T02:28:28.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.491+0000 7fd128c00640 1 --2- 172.21.15.106:0/2021778392 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd10c065180 0x7fd10c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.492+0000 7fd128c00640 1 -- 172.21.15.106:0/2021778392 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd124082e80 con 0x7fd12c140580 2024-08-17T02:28:28.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.492+0000 7fd131400640 1 --2- 172.21.15.106:0/2021778392 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd10c065180 0x7fd10c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:28.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.492+0000 7fd131400640 1 --2- 172.21.15.106:0/2021778392 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd10c065180 0x7fd10c067630 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd120000c00 tx=0x7fd120007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:28.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.495+0000 7fd128c00640 1 -- 172.21.15.106:0/2021778392 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd124050f50 con 0x7fd12c140580 2024-08-17T02:28:28.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.699+0000 7fd133e00640 1 -- 172.21.15.106:0/2021778392 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd12c06d1a0 con 0x7fd12c140580 2024-08-17T02:28:28.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.699+0000 7fd128c00640 1 -- 172.21.15.106:0/2021778392 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7fd124054570 con 0x7fd12c140580 2024-08-17T02:28:28.700 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:28.700 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1696744783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1696744783},{"type":"v1","addr":"172.21.15.106:6837","nonce":1696744783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/966571689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":966571689},{"type":"v1","addr":"172.21.15.171:6833","nonce":966571689}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/3205379168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3205379168},{"type":"v1","addr":"172.21.15.106:6836","nonce":3205379168}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:27:50.683483+0000","modified":"2024-08-17T02:27:54.296580+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6835/3901195482","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":3901195482},{"type":"v1","addr":"172.21.15.171:6835","nonce":3901195482}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:28:28.700 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 8 2024-08-17T02:28:28.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.701+0000 7fd133e00640 1 -- 172.21.15.106:0/2021778392 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd10c065180 msgr2=0x7fd10c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.701+0000 7fd133e00640 1 --2- 172.21.15.106:0/2021778392 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd10c065180 0x7fd10c067630 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd120000c00 tx=0x7fd120007de0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.701+0000 7fd133e00640 1 -- 172.21.15.106:0/2021778392 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd12c140580 msgr2=0x7fd12c0c3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.701+0000 7fd133e00640 1 --2- 172.21.15.106:0/2021778392 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd12c140580 0x7fd12c0c3a70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd124009fc0 tx=0x7fd12400b040 comp rx=0 tx=0).stop 2024-08-17T02:28:28.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.701+0000 7fd133e00640 1 -- 172.21.15.106:0/2021778392 shutdown_connections 2024-08-17T02:28:28.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.701+0000 7fd133e00640 1 --2- 172.21.15.106:0/2021778392 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd10c065180 0x7fd10c067630 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.701+0000 7fd133e00640 1 --2- 172.21.15.106:0/2021778392 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd12c140580 0x7fd12c0c3a70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.701+0000 7fd133e00640 1 --2- 172.21.15.106:0/2021778392 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd12c1401b0 0x7fd12c0c3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.701+0000 7fd133e00640 1 --2- 172.21.15.106:0/2021778392 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd12c0b1440 0x7fd12c0c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.701+0000 7fd133e00640 1 -- 172.21.15.106:0/2021778392 >> 172.21.15.106:0/2021778392 conn(0x7fd12c0cb9b0 msgr2=0x7fd12c0aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:28.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.701+0000 7fd133e00640 1 -- 172.21.15.106:0/2021778392 shutdown_connections 2024-08-17T02:28:28.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.701+0000 7fd133e00640 1 -- 172.21.15.106:0/2021778392 wait complete. 2024-08-17T02:28:28.717 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:28.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.865+0000 7fedb4a00640 1 Processor -- start 2024-08-17T02:28:28.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.865+0000 7fedb4a00640 1 -- start start 2024-08-17T02:28:28.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.866+0000 7fedb4a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fedb0155a20 0x7fedb00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.866+0000 7fedb4a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fedb0155df0 0x7fedb00ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.866+0000 7fedb4a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb0156670 con 0x7fedb006d7f0 2024-08-17T02:28:28.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.866+0000 7fedb4a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb00b0350 con 0x7fedb0155df0 2024-08-17T02:28:28.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.866+0000 7fedb4a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb006e5e0 con 0x7fedb0155a20 2024-08-17T02:28:28.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.867+0000 7fedad400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fedb0155df0 0x7fedb00ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:28.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.867+0000 7fedae800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fedb006d7f0 0x7fedb00ac790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39788/0 (socket says 172.21.15.106:39788) 2024-08-17T02:28:28.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.867+0000 7fedae800640 1 -- 172.21.15.106:0/799213170 learned_addr learned my addr 172.21.15.106:0/799213170 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:28.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.867+0000 7fedade00640 1 --2- 172.21.15.106:0/799213170 >> v2:172.21.15.171:3300/0 conn(0x7fedb0155a20 0x7fedb00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:28.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.867+0000 7fedad400640 1 -- 172.21.15.106:0/799213170 >> v2:172.21.15.171:3300/0 conn(0x7fedb0155a20 msgr2=0x7fedb00adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:28.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.867+0000 7fedad400640 1 --2- 172.21.15.106:0/799213170 >> v2:172.21.15.171:3300/0 conn(0x7fedb0155a20 0x7fedb00adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.867+0000 7fedad400640 1 -- 172.21.15.106:0/799213170 >> v1:172.21.15.106:6789/0 conn(0x7fedb006d7f0 legacy=0x7fedb00ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.867+0000 7fedad400640 1 -- 172.21.15.106:0/799213170 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb006e8c0 con 0x7fedb0155df0 2024-08-17T02:28:28.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.867+0000 7fedaca00640 1 -- 172.21.15.106:0/799213170 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 519268676 0 0) 0x7fedb0156670 con 0x7fedb006d7f0 2024-08-17T02:28:28.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.868+0000 7fedad400640 1 --2- 172.21.15.106:0/799213170 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedb0155df0 0x7fedb00ad9b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fedb006bc00 tx=0x7fed9c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc516b88b9935106 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:28.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.868+0000 7fedaca00640 1 -- 172.21.15.106:0/799213170 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c02adb0 con 0x7fedb0155df0 2024-08-17T02:28:28.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.868+0000 7fedaca00640 1 -- 172.21.15.106:0/799213170 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9c032440 con 0x7fedb0155df0 2024-08-17T02:28:28.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.868+0000 7fedaca00640 1 -- 172.21.15.106:0/799213170 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c0327e0 con 0x7fedb0155df0 2024-08-17T02:28:28.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.869+0000 7fedb4a00640 1 -- 172.21.15.106:0/799213170 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedb0155df0 msgr2=0x7fedb00ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.869+0000 7fedb4a00640 1 --2- 172.21.15.106:0/799213170 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedb0155df0 0x7fedb00ad9b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fedb006bc00 tx=0x7fed9c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.869+0000 7fedb4a00640 1 -- 172.21.15.106:0/799213170 shutdown_connections 2024-08-17T02:28:28.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.869+0000 7fedb4a00640 1 --2- 172.21.15.106:0/799213170 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedb0155df0 0x7fedb00ad9b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.869+0000 7fedb4a00640 1 --2- 172.21.15.106:0/799213170 >> v2:172.21.15.171:3300/0 conn(0x7fedb0155a20 0x7fedb00adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.869+0000 7fedb4a00640 1 -- 172.21.15.106:0/799213170 >> 172.21.15.106:0/799213170 conn(0x7fedb00cb9b0 msgr2=0x7fedb00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:28.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.869+0000 7fedb4a00640 1 -- 172.21.15.106:0/799213170 shutdown_connections 2024-08-17T02:28:28.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.869+0000 7fedb4a00640 1 -- 172.21.15.106:0/799213170 wait complete. 2024-08-17T02:28:28.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.870+0000 7fedb4a00640 1 Processor -- start 2024-08-17T02:28:28.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.871+0000 7fedb4a00640 1 -- start start 2024-08-17T02:28:28.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.871+0000 7fedb4a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedb006d7f0 0x7fedb016a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.871+0000 7fedb4a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fedb0155a20 0x7fedb016bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.871+0000 7fedb4a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedb0155df0 0x7fedb015b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.871+0000 7fedb4a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb014e7d0 con 0x7fedb006d7f0 2024-08-17T02:28:28.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.871+0000 7fedb4a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb014eab0 con 0x7fedb0155df0 2024-08-17T02:28:28.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.871+0000 7fedb4a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb014ed90 con 0x7fedb0155a20 2024-08-17T02:28:28.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.872+0000 7fedade00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedb006d7f0 0x7fedb016a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:28.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.872+0000 7fedade00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedb006d7f0 0x7fedb016a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44994/0 (socket says 172.21.15.106:44994) 2024-08-17T02:28:28.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.872+0000 7fedade00640 1 -- 172.21.15.106:0/2763235781 learned_addr learned my addr 172.21.15.106:0/2763235781 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:28.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.872+0000 7fedade00640 1 -- 172.21.15.106:0/2763235781 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fedb0155a20 msgr2=0x7fedb016bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.872+0000 7fedade00640 1 --2- 172.21.15.106:0/2763235781 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fedb0155a20 0x7fedb016bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.872+0000 7fedade00640 1 -- 172.21.15.106:0/2763235781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedb0155df0 msgr2=0x7fedb015b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.872+0000 7fedae800640 1 --2- 172.21.15.106:0/2763235781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedb0155df0 0x7fedb015b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:28.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.872+0000 7fedade00640 1 --2- 172.21.15.106:0/2763235781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedb0155df0 0x7fedb015b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.872+0000 7fedade00640 1 -- 172.21.15.106:0/2763235781 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c009390 con 0x7fedb006d7f0 2024-08-17T02:28:28.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.872+0000 7fedae800640 1 --2- 172.21.15.106:0/2763235781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedb0155df0 0x7fedb015b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:28.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.872+0000 7fedade00640 1 --2- 172.21.15.106:0/2763235781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedb006d7f0 0x7fedb016a460 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7feda000ea20 tx=0x7feda00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:28.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.873+0000 7feda5600640 1 -- 172.21.15.106:0/2763235781 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda000ca10 con 0x7fedb006d7f0 2024-08-17T02:28:28.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.873+0000 7feda5600640 1 -- 172.21.15.106:0/2763235781 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda000cb70 con 0x7fedb006d7f0 2024-08-17T02:28:28.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.873+0000 7feda5600640 1 -- 172.21.15.106:0/2763235781 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda0013470 con 0x7fedb006d7f0 2024-08-17T02:28:28.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.873+0000 7fedb4a00640 1 -- 172.21.15.106:0/2763235781 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb014f070 con 0x7fedb006d7f0 2024-08-17T02:28:28.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.873+0000 7fedb4a00640 1 -- 172.21.15.106:0/2763235781 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb016c4d0 con 0x7fedb006d7f0 2024-08-17T02:28:28.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.874+0000 7fedb4a00640 1 -- 172.21.15.106:0/2763235781 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb0064db0 con 0x7fedb006d7f0 2024-08-17T02:28:28.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.875+0000 7feda5600640 1 -- 172.21.15.106:0/2763235781 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7feda0013860 con 0x7fedb006d7f0 2024-08-17T02:28:28.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.876+0000 7feda5600640 1 --2- 172.21.15.106:0/2763235781 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fed90065150 0x7fed90067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.876+0000 7feda5600640 1 -- 172.21.15.106:0/2763235781 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feda0082760 con 0x7fedb006d7f0 2024-08-17T02:28:28.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.876+0000 7fedad400640 1 --2- 172.21.15.106:0/2763235781 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fed90065150 0x7fed90067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:28.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.877+0000 7fedad400640 1 --2- 172.21.15.106:0/2763235781 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fed90065150 0x7fed90067600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fed9c034000 tx=0x7fed9c032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:28.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:28.879+0000 7feda5600640 1 -- 172.21.15.106:0/2763235781 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7feda0050800 con 0x7fedb006d7f0 2024-08-17T02:28:29.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.052+0000 7fedb4a00640 1 -- 172.21.15.106:0/2763235781 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fedb014e910 con 0x7fedb006d7f0 2024-08-17T02:28:29.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.052+0000 7feda5600640 1 -- 172.21.15.106:0/2763235781 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fedb014e910 con 0x7fedb006d7f0 2024-08-17T02:28:29.053 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:29.054 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:27:52.284039+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:27:48.547438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:27:49.671073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:29.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.055+0000 7fedb4a00640 1 -- 172.21.15.106:0/2763235781 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fed90065150 msgr2=0x7fed90067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.055+0000 7fedb4a00640 1 --2- 172.21.15.106:0/2763235781 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fed90065150 0x7fed90067600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fed9c034000 tx=0x7fed9c032000 comp rx=0 tx=0).stop 2024-08-17T02:28:29.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.055+0000 7fedb4a00640 1 -- 172.21.15.106:0/2763235781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedb006d7f0 msgr2=0x7fedb016a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.055+0000 7fedb4a00640 1 --2- 172.21.15.106:0/2763235781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedb006d7f0 0x7fedb016a460 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7feda000ea20 tx=0x7feda00090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.055+0000 7fedb4a00640 1 -- 172.21.15.106:0/2763235781 shutdown_connections 2024-08-17T02:28:29.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.055+0000 7fedb4a00640 1 --2- 172.21.15.106:0/2763235781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedb0155df0 0x7fedb015b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.055+0000 7fedb4a00640 1 --2- 172.21.15.106:0/2763235781 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fedb0155a20 0x7fedb016bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.055+0000 7fedb4a00640 1 --2- 172.21.15.106:0/2763235781 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fed90065150 0x7fed90067600 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.055+0000 7fedb4a00640 1 --2- 172.21.15.106:0/2763235781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedb006d7f0 0x7fedb016a460 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.055+0000 7fedb4a00640 1 -- 172.21.15.106:0/2763235781 >> 172.21.15.106:0/2763235781 conn(0x7fedb00cb9b0 msgr2=0x7fedb0150a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:29.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.055+0000 7fedb4a00640 1 -- 172.21.15.106:0/2763235781 shutdown_connections 2024-08-17T02:28:29.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.055+0000 7fedb4a00640 1 -- 172.21.15.106:0/2763235781 wait complete. 2024-08-17T02:28:29.071 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:28:29.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.219+0000 7f6263e00640 1 Processor -- start 2024-08-17T02:28:29.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.219+0000 7f6263e00640 1 -- start start 2024-08-17T02:28:29.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.220+0000 7f6263e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f625c1401b0 0x7f625c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.220+0000 7f6263e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f625c0caa80 con 0x7f625c0b1440 2024-08-17T02:28:29.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.220+0000 7f6263e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f625c0c9e70 con 0x7f625c140580 2024-08-17T02:28:29.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.220+0000 7f6263e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625c0cb450 con 0x7f625c1401b0 2024-08-17T02:28:29.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.220+0000 7f6261e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f625c0b1440 0x7f625c0c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39798/0 (socket says 172.21.15.106:39798) 2024-08-17T02:28:29.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.220+0000 7f6261e00640 1 -- 172.21.15.106:0/1370556067 learned_addr learned my addr 172.21.15.106:0/1370556067 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:29.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.221+0000 7f6261400640 1 --2- 172.21.15.106:0/1370556067 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f625c1401b0 0x7f625c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.221+0000 7f625be00640 1 -- 172.21.15.106:0/1370556067 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3738083071 0 0) 0x7f625c0caa80 con 0x7f625c0b1440 2024-08-17T02:28:29.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.221+0000 7f625be00640 1 -- 172.21.15.106:0/1370556067 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62440034e0 con 0x7f625c0b1440 2024-08-17T02:28:29.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.221+0000 7f625be00640 1 -- 172.21.15.106:0/1370556067 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265395183 0 0) 0x7f625c0c9e70 con 0x7f625c140580 2024-08-17T02:28:29.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.221+0000 7f625be00640 1 -- 172.21.15.106:0/1370556067 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f625c0caa80 con 0x7f625c140580 2024-08-17T02:28:29.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.221+0000 7f6261400640 1 -- 172.21.15.106:0/1370556067 >> v1:172.21.15.171:6789/0 conn(0x7f625c140580 legacy=0x7f625c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.221+0000 7f6261400640 1 -- 172.21.15.106:0/1370556067 >> v1:172.21.15.106:6789/0 conn(0x7f625c0b1440 legacy=0x7f625c0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.221+0000 7f6261400640 1 -- 172.21.15.106:0/1370556067 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c0ca150 con 0x7f625c1401b0 2024-08-17T02:28:29.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.222+0000 7f6261400640 1 --2- 172.21.15.106:0/1370556067 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f625c1401b0 0x7f625c0caf10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6250009880 tx=0x7f62500090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5099a9aeee40f2dc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:29.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.222+0000 7f625be00640 1 -- 172.21.15.106:0/1370556067 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625002ad80 con 0x7f625c1401b0 2024-08-17T02:28:29.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.223+0000 7f625be00640 1 -- 172.21.15.106:0/1370556067 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6250032440 con 0x7f625c1401b0 2024-08-17T02:28:29.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.223+0000 7f625be00640 1 -- 172.21.15.106:0/1370556067 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62500327e0 con 0x7f625c1401b0 2024-08-17T02:28:29.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.223+0000 7f6263e00640 1 -- 172.21.15.106:0/1370556067 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f625c1401b0 msgr2=0x7f625c0caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.223+0000 7f6263e00640 1 --2- 172.21.15.106:0/1370556067 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f625c1401b0 0x7f625c0caf10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6250009880 tx=0x7f62500090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.223+0000 7f6263e00640 1 -- 172.21.15.106:0/1370556067 shutdown_connections 2024-08-17T02:28:29.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.223+0000 7f6263e00640 1 --2- 172.21.15.106:0/1370556067 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f625c1401b0 0x7f625c0caf10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.223+0000 7f6263e00640 1 -- 172.21.15.106:0/1370556067 >> 172.21.15.106:0/1370556067 conn(0x7f625c0cb9b0 msgr2=0x7f625c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:29.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.223+0000 7f6263e00640 1 -- 172.21.15.106:0/1370556067 shutdown_connections 2024-08-17T02:28:29.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.223+0000 7f6263e00640 1 -- 172.21.15.106:0/1370556067 wait complete. 2024-08-17T02:28:29.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.225+0000 7f6263e00640 1 Processor -- start 2024-08-17T02:28:29.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.225+0000 7f6263e00640 1 -- start start 2024-08-17T02:28:29.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.225+0000 7f6263e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f625c0b1440 0x7f625c0c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.225+0000 7f6263e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f625c1401b0 0x7f625c169050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.225+0000 7f6263e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f625c140580 0x7f625c169590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.225+0000 7f6263e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c13ecb0 con 0x7f625c1401b0 2024-08-17T02:28:29.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.225+0000 7f6263e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c0b0420 con 0x7f625c0b1440 2024-08-17T02:28:29.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.225+0000 7f6263e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625c0af810 con 0x7f625c140580 2024-08-17T02:28:29.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.226+0000 7f6260a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f625c1401b0 0x7f625c169050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.226+0000 7f6260a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f625c1401b0 0x7f625c169050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:45004/0 (socket says 172.21.15.106:45004) 2024-08-17T02:28:29.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.226+0000 7f6260a00640 1 -- 172.21.15.106:0/2272597365 learned_addr learned my addr 172.21.15.106:0/2272597365 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:29.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.226+0000 7f6261e00640 1 --2- 172.21.15.106:0/2272597365 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f625c140580 0x7f625c169590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.226+0000 7f6261400640 1 --2- 172.21.15.106:0/2272597365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f625c0b1440 0x7f625c0c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.226+0000 7f6260a00640 1 -- 172.21.15.106:0/2272597365 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f625c140580 msgr2=0x7f625c169590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.226+0000 7f6260a00640 1 --2- 172.21.15.106:0/2272597365 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f625c140580 0x7f625c169590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.226+0000 7f6260a00640 1 -- 172.21.15.106:0/2272597365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f625c0b1440 msgr2=0x7f625c0c7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.226+0000 7f6260a00640 1 --2- 172.21.15.106:0/2272597365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f625c0b1440 0x7f625c0c7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.226+0000 7f6260a00640 1 -- 172.21.15.106:0/2272597365 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6250009390 con 0x7f625c1401b0 2024-08-17T02:28:29.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.226+0000 7f6260a00640 1 --2- 172.21.15.106:0/2272597365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f625c1401b0 0x7f625c169050 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f624800c590 tx=0x7f6248007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:29.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.227+0000 7f6258c00640 1 -- 172.21.15.106:0/2272597365 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6248012630 con 0x7f625c1401b0 2024-08-17T02:28:29.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.227+0000 7f6258c00640 1 -- 172.21.15.106:0/2272597365 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62480127b0 con 0x7f625c1401b0 2024-08-17T02:28:29.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.227+0000 7f6263e00640 1 -- 172.21.15.106:0/2272597365 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f625c0afaf0 con 0x7f625c1401b0 2024-08-17T02:28:29.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.227+0000 7f6258c00640 1 -- 172.21.15.106:0/2272597365 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6248012bb0 con 0x7f625c1401b0 2024-08-17T02:28:29.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.227+0000 7f6263e00640 1 -- 172.21.15.106:0/2272597365 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f625c0b00b0 con 0x7f625c1401b0 2024-08-17T02:28:29.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.228+0000 7f6263e00640 1 -- 172.21.15.106:0/2272597365 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f625c064db0 con 0x7f625c1401b0 2024-08-17T02:28:29.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.229+0000 7f6258c00640 1 -- 172.21.15.106:0/2272597365 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f624801a3b0 con 0x7f625c1401b0 2024-08-17T02:28:29.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.229+0000 7f6258c00640 1 --2- 172.21.15.106:0/2272597365 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f623c065180 0x7f623c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.229+0000 7f6258c00640 1 -- 172.21.15.106:0/2272597365 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f62480822b0 con 0x7f625c1401b0 2024-08-17T02:28:29.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.230+0000 7f6261400640 1 --2- 172.21.15.106:0/2272597365 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f623c065180 0x7f623c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.230+0000 7f6261400640 1 --2- 172.21.15.106:0/2272597365 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f623c065180 0x7f623c067630 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6250034000 tx=0x7f6250032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:29.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.234+0000 7f6258c00640 1 -- 172.21.15.106:0/2272597365 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6248050380 con 0x7f625c1401b0 2024-08-17T02:28:29.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.442+0000 7f6263e00640 1 -- 172.21.15.106:0/2272597365 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f625c0adae0 con 0x7f625c1401b0 2024-08-17T02:28:29.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-08-17T02:28:29.443+0000 7f141ae00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:28:29.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.448+0000 7f6258c00640 1 -- 172.21.15.106:0/2272597365 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f62480539a0 con 0x7f625c1401b0 2024-08-17T02:28:29.449 INFO:teuthology.orchestra.run.smithi106.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:28:29.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.450+0000 7f6263e00640 1 -- 172.21.15.106:0/2272597365 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f623c065180 msgr2=0x7f623c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.450+0000 7f6263e00640 1 --2- 172.21.15.106:0/2272597365 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f623c065180 0x7f623c067630 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6250034000 tx=0x7f6250032000 comp rx=0 tx=0).stop 2024-08-17T02:28:29.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.450+0000 7f6263e00640 1 -- 172.21.15.106:0/2272597365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f625c1401b0 msgr2=0x7f625c169050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.450+0000 7f6263e00640 1 --2- 172.21.15.106:0/2272597365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f625c1401b0 0x7f625c169050 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f624800c590 tx=0x7f6248007d80 comp rx=0 tx=0).stop 2024-08-17T02:28:29.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.451+0000 7f6263e00640 1 -- 172.21.15.106:0/2272597365 shutdown_connections 2024-08-17T02:28:29.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.451+0000 7f6263e00640 1 --2- 172.21.15.106:0/2272597365 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f625c140580 0x7f625c169590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.451+0000 7f6263e00640 1 --2- 172.21.15.106:0/2272597365 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f623c065180 0x7f623c067630 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.451+0000 7f6263e00640 1 --2- 172.21.15.106:0/2272597365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f625c1401b0 0x7f625c169050 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.451+0000 7f6263e00640 1 --2- 172.21.15.106:0/2272597365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f625c0b1440 0x7f625c0c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.451+0000 7f6263e00640 1 -- 172.21.15.106:0/2272597365 >> 172.21.15.106:0/2272597365 conn(0x7f625c0cb9b0 msgr2=0x7f625c0ad3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:29.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.451+0000 7f6263e00640 1 -- 172.21.15.106:0/2272597365 shutdown_connections 2024-08-17T02:28:29.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.451+0000 7f6263e00640 1 -- 172.21.15.106:0/2272597365 wait complete. 2024-08-17T02:28:29.456 INFO:tasks.ceph.mds.d.smithi171.stderr: -2000> 2024-08-17T02:27:54.735+0000 7f1006400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:28:29.468 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:28:29.500 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-08-17T02:28:29.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.617+0000 7f87ed200640 1 Processor -- start 2024-08-17T02:28:29.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.617+0000 7f87ed200640 1 -- start start 2024-08-17T02:28:29.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.618+0000 7f87ed200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f87e8155980 0x7f87e8156f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.619+0000 7f87ed200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f87e80af580 0x7f87e80af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.619+0000 7f87ed200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e80aff20 con 0x7f87e80a54d0 2024-08-17T02:28:29.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.619+0000 7f87ed200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e8158400 con 0x7f87e80af580 2024-08-17T02:28:29.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.619+0000 7f87ed200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e81577f0 con 0x7f87e8155980 2024-08-17T02:28:29.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.619+0000 7f87e6800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f87e80af580 0x7f87e80af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.619+0000 7f87e6800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f87e80af580 0x7f87e80af9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:45020/0 (socket says 172.21.15.106:45020) 2024-08-17T02:28:29.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.619+0000 7f87e6800640 1 -- 172.21.15.106:0/3314218944 learned_addr learned my addr 172.21.15.106:0/3314218944 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:29.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.619+0000 7f87e5e00640 1 --2- 172.21.15.106:0/3314218944 >> v2:172.21.15.171:3300/0 conn(0x7f87e8155980 0x7f87e8156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.619+0000 7f87e6800640 1 -- 172.21.15.106:0/3314218944 >> v2:172.21.15.171:3300/0 conn(0x7f87e8155980 msgr2=0x7f87e8156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:29.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.619+0000 7f87e6800640 1 --2- 172.21.15.106:0/3314218944 >> v2:172.21.15.171:3300/0 conn(0x7f87e8155980 0x7f87e8156f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.619+0000 7f87e6800640 1 -- 172.21.15.106:0/3314218944 >> v1:172.21.15.171:6789/0 conn(0x7f87e80a54d0 legacy=0x7f87e8155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.619+0000 7f87e6800640 1 -- 172.21.15.106:0/3314218944 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e8157ad0 con 0x7f87e80af580 2024-08-17T02:28:29.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.620+0000 7f87e6800640 1 --2- 172.21.15.106:0/3314218944 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87e80af580 0x7f87e80af9e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f87e806c250 tx=0x7f87e0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60dc55b1bf8c4568 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:29.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.621+0000 7f87e5400640 1 -- 172.21.15.106:0/3314218944 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e002e050 con 0x7f87e80af580 2024-08-17T02:28:29.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.621+0000 7f87e5400640 1 -- 172.21.15.106:0/3314218944 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e0007400 con 0x7f87e80af580 2024-08-17T02:28:29.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.621+0000 7f87e5400640 1 -- 172.21.15.106:0/3314218944 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e00077e0 con 0x7f87e80af580 2024-08-17T02:28:29.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.621+0000 7f87ed200640 1 -- 172.21.15.106:0/3314218944 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87e80af580 msgr2=0x7f87e80af9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.621+0000 7f87ed200640 1 --2- 172.21.15.106:0/3314218944 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87e80af580 0x7f87e80af9e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f87e806c250 tx=0x7f87e0009840 comp rx=0 tx=0).stop 2024-08-17T02:28:29.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.621+0000 7f87ed200640 1 -- 172.21.15.106:0/3314218944 shutdown_connections 2024-08-17T02:28:29.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.621+0000 7f87ed200640 1 --2- 172.21.15.106:0/3314218944 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87e80af580 0x7f87e80af9e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.621+0000 7f87ed200640 1 --2- 172.21.15.106:0/3314218944 >> v2:172.21.15.171:3300/0 conn(0x7f87e8155980 0x7f87e8156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.621+0000 7f87ed200640 1 -- 172.21.15.106:0/3314218944 >> 172.21.15.106:0/3314218944 conn(0x7f87e8067750 msgr2=0x7f87e80cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:29.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.621+0000 7f87ed200640 1 -- 172.21.15.106:0/3314218944 shutdown_connections 2024-08-17T02:28:29.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.621+0000 7f87ed200640 1 -- 172.21.15.106:0/3314218944 wait complete. 2024-08-17T02:28:29.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.623+0000 7f87ed200640 1 Processor -- start 2024-08-17T02:28:29.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.623+0000 7f87ed200640 1 -- start start 2024-08-17T02:28:29.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.624+0000 7f87ed200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87e80a54d0 0x7f87e8069f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.624+0000 7f87ed200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87e80af580 0x7f87e80adb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.624+0000 7f87ed200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87e8155980 0x7f87e8140360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.624+0000 7f87ed200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e80ab340 con 0x7f87e8155980 2024-08-17T02:28:29.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.624+0000 7f87ed200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e80ab620 con 0x7f87e80a54d0 2024-08-17T02:28:29.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.624+0000 7f87ed200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e80ab900 con 0x7f87e80af580 2024-08-17T02:28:29.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.624+0000 7f87e6800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87e8155980 0x7f87e8140360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.624+0000 7f87e6800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87e8155980 0x7f87e8140360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:45036/0 (socket says 172.21.15.106:45036) 2024-08-17T02:28:29.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.624+0000 7f87e6800640 1 -- 172.21.15.106:0/3535368818 learned_addr learned my addr 172.21.15.106:0/3535368818 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:29.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.624+0000 7f87e5e00640 1 --2- 172.21.15.106:0/3535368818 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87e80a54d0 0x7f87e8069f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.624+0000 7f87dd400640 1 --2- 172.21.15.106:0/3535368818 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87e80af580 0x7f87e80adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.624+0000 7f87e6800640 1 -- 172.21.15.106:0/3535368818 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87e80af580 msgr2=0x7f87e80adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.624+0000 7f87e6800640 1 --2- 172.21.15.106:0/3535368818 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87e80af580 0x7f87e80adb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.624+0000 7f87e6800640 1 -- 172.21.15.106:0/3535368818 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87e80a54d0 msgr2=0x7f87e8069f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.624+0000 7f87e6800640 1 --2- 172.21.15.106:0/3535368818 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87e80a54d0 0x7f87e8069f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.624+0000 7f87e6800640 1 -- 172.21.15.106:0/3535368818 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e0009ae0 con 0x7f87e8155980 2024-08-17T02:28:29.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.624+0000 7f87dd400640 1 --2- 172.21.15.106:0/3535368818 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87e80af580 0x7f87e80adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:29.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.625+0000 7f87e6800640 1 --2- 172.21.15.106:0/3535368818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87e8155980 0x7f87e8140360 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f87e002ad60 tx=0x7f87e0037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:29.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.625+0000 7f87de000640 1 -- 172.21.15.106:0/3535368818 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0007170 con 0x7f87e8155980 2024-08-17T02:28:29.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.625+0000 7f87de000640 1 -- 172.21.15.106:0/3535368818 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e0033e40 con 0x7f87e8155980 2024-08-17T02:28:29.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.625+0000 7f87de000640 1 -- 172.21.15.106:0/3535368818 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e003c640 con 0x7f87e8155980 2024-08-17T02:28:29.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.625+0000 7f87ed200640 1 -- 172.21.15.106:0/3535368818 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e80abbe0 con 0x7f87e8155980 2024-08-17T02:28:29.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.625+0000 7f87ed200640 1 -- 172.21.15.106:0/3535368818 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e806a4d0 con 0x7f87e8155980 2024-08-17T02:28:29.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.626+0000 7f87ed200640 1 -- 172.21.15.106:0/3535368818 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e806a660 con 0x7f87e8155980 2024-08-17T02:28:29.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.627+0000 7f87de000640 1 -- 172.21.15.106:0/3535368818 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f87e0039050 con 0x7f87e8155980 2024-08-17T02:28:29.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.628+0000 7f87de000640 1 --2- 172.21.15.106:0/3535368818 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f87c4065150 0x7f87c4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.628+0000 7f87de000640 1 -- 172.21.15.106:0/3535368818 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f87e00a2be0 con 0x7f87e8155980 2024-08-17T02:28:29.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.628+0000 7f87e5e00640 1 --2- 172.21.15.106:0/3535368818 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f87c4065150 0x7f87c4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.629+0000 7f87e5e00640 1 --2- 172.21.15.106:0/3535368818 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f87c4065150 0x7f87c4067600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009cb0 tx=0x7f87d8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:29.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.632+0000 7f87de000640 1 -- 172.21.15.106:0/3535368818 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f87e0070c50 con 0x7f87e8155980 2024-08-17T02:28:29.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:29.844+0000 7f87ed200640 1 -- 172.21.15.106:0/3535368818 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f87e8071050 con 0x7f87e8155980 2024-08-17T02:28:30.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.458+0000 7f87de000640 1 -- 172.21.15.106:0/3535368818 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f87e0074270 con 0x7f87e8155980 2024-08-17T02:28:30.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.461+0000 7f87ed200640 1 -- 172.21.15.106:0/3535368818 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f87c4065150 msgr2=0x7f87c4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.461+0000 7f87ed200640 1 --2- 172.21.15.106:0/3535368818 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f87c4065150 0x7f87c4067600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009cb0 tx=0x7f87d8008040 comp rx=0 tx=0).stop 2024-08-17T02:28:30.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.461+0000 7f87ed200640 1 -- 172.21.15.106:0/3535368818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87e8155980 msgr2=0x7f87e8140360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.461+0000 7f87ed200640 1 --2- 172.21.15.106:0/3535368818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87e8155980 0x7f87e8140360 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f87e002ad60 tx=0x7f87e0037000 comp rx=0 tx=0).stop 2024-08-17T02:28:30.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.462+0000 7f87ed200640 1 -- 172.21.15.106:0/3535368818 shutdown_connections 2024-08-17T02:28:30.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.462+0000 7f87ed200640 1 --2- 172.21.15.106:0/3535368818 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f87c4065150 0x7f87c4067600 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.462+0000 7f87ed200640 1 --2- 172.21.15.106:0/3535368818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87e8155980 0x7f87e8140360 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.462+0000 7f87ed200640 1 --2- 172.21.15.106:0/3535368818 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87e80af580 0x7f87e80adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.462+0000 7f87ed200640 1 --2- 172.21.15.106:0/3535368818 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87e80a54d0 0x7f87e8069f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.462+0000 7f87ed200640 1 -- 172.21.15.106:0/3535368818 >> 172.21.15.106:0/3535368818 conn(0x7f87e8067750 msgr2=0x7f87e806c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:30.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.462+0000 7f87ed200640 1 -- 172.21.15.106:0/3535368818 shutdown_connections 2024-08-17T02:28:30.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.463+0000 7f87ed200640 1 -- 172.21.15.106:0/3535368818 wait complete. 2024-08-17T02:28:30.481 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:28:30.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.632+0000 7f5c36a00640 1 Processor -- start 2024-08-17T02:28:30.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.632+0000 7f5c36a00640 1 -- start start 2024-08-17T02:28:30.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.633+0000 7f5c36a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5c30150130 0x7f5c300aa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.633+0000 7f5c36a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c30156d40 0x7f5c3006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.633+0000 7f5c36a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5c3006e420 0x7f5c300afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.633+0000 7f5c36a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c3006e8a0 con 0x7f5c3006e420 2024-08-17T02:28:30.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.633+0000 7f5c36a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c301568b0 con 0x7f5c30150130 2024-08-17T02:28:30.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.633+0000 7f5c36a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c30150500 con 0x7f5c30156d40 2024-08-17T02:28:30.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.633+0000 7f5c34a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5c3006e420 0x7f5c300afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.633+0000 7f5c34a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5c3006e420 0x7f5c300afbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:51386/0 (socket says 172.21.15.106:51386) 2024-08-17T02:28:30.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.633+0000 7f5c34a00640 1 -- 172.21.15.106:0/1086917566 learned_addr learned my addr 172.21.15.106:0/1086917566 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:30.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.634+0000 7f5c34a00640 1 -- 172.21.15.106:0/1086917566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c30156d40 msgr2=0x7f5c3006dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:30.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.634+0000 7f5c2f400640 1 --2- 172.21.15.106:0/1086917566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c30156d40 0x7f5c3006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.634+0000 7f5c2fe00640 1 --2- 172.21.15.106:0/1086917566 >> v2:172.21.15.171:3300/0 conn(0x7f5c30150130 0x7f5c300aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.634+0000 7f5c34a00640 1 --2- 172.21.15.106:0/1086917566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c30156d40 0x7f5c3006dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.634+0000 7f5c34a00640 1 -- 172.21.15.106:0/1086917566 >> v2:172.21.15.171:3300/0 conn(0x7f5c30150130 msgr2=0x7f5c300aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:30.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.634+0000 7f5c34a00640 1 --2- 172.21.15.106:0/1086917566 >> v2:172.21.15.171:3300/0 conn(0x7f5c30150130 0x7f5c300aa730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.634+0000 7f5c34a00640 1 -- 172.21.15.106:0/1086917566 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c30155fc0 con 0x7f5c3006e420 2024-08-17T02:28:30.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.634+0000 7f5c2f400640 1 --2- 172.21.15.106:0/1086917566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c30156d40 0x7f5c3006dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:30.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.634+0000 7f5c2fe00640 1 --2- 172.21.15.106:0/1086917566 >> v2:172.21.15.171:3300/0 conn(0x7f5c30150130 0x7f5c300aa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:30.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.635+0000 7f5c34a00640 1 --2- 172.21.15.106:0/1086917566 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c3006e420 0x7f5c300afbc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5c3006f670 tx=0x7f5c28009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b60afcbebe859422 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:30.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.635+0000 7f5c2ea00640 1 -- 172.21.15.106:0/1086917566 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c28031400 con 0x7f5c3006e420 2024-08-17T02:28:30.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.635+0000 7f5c2ea00640 1 -- 172.21.15.106:0/1086917566 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2802d050 con 0x7f5c3006e420 2024-08-17T02:28:30.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.635+0000 7f5c2ea00640 1 -- 172.21.15.106:0/1086917566 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c280317d0 con 0x7f5c3006e420 2024-08-17T02:28:30.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.636+0000 7f5c36a00640 1 -- 172.21.15.106:0/1086917566 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c3006e420 msgr2=0x7f5c300afbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.636+0000 7f5c36a00640 1 --2- 172.21.15.106:0/1086917566 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c3006e420 0x7f5c300afbc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5c3006f670 tx=0x7f5c28009840 comp rx=0 tx=0).stop 2024-08-17T02:28:30.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.636+0000 7f5c36a00640 1 -- 172.21.15.106:0/1086917566 shutdown_connections 2024-08-17T02:28:30.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.636+0000 7f5c36a00640 1 --2- 172.21.15.106:0/1086917566 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c3006e420 0x7f5c300afbc0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.636+0000 7f5c36a00640 1 --2- 172.21.15.106:0/1086917566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c30156d40 0x7f5c3006dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.636+0000 7f5c36a00640 1 --2- 172.21.15.106:0/1086917566 >> v2:172.21.15.171:3300/0 conn(0x7f5c30150130 0x7f5c300aa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.636+0000 7f5c36a00640 1 -- 172.21.15.106:0/1086917566 >> 172.21.15.106:0/1086917566 conn(0x7f5c30067750 msgr2=0x7f5c3006c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:30.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.636+0000 7f5c36a00640 1 -- 172.21.15.106:0/1086917566 shutdown_connections 2024-08-17T02:28:30.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.636+0000 7f5c36a00640 1 -- 172.21.15.106:0/1086917566 wait complete. 2024-08-17T02:28:30.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.637+0000 7f5c36a00640 1 Processor -- start 2024-08-17T02:28:30.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.637+0000 7f5c36a00640 1 -- start start 2024-08-17T02:28:30.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.638+0000 7f5c36a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c3006e420 0x7f5c3014e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.638+0000 7f5c36a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c30150130 0x7f5c300a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.638+0000 7f5c36a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c30156d40 0x7f5c300a93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.638+0000 7f5c36a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c30157300 con 0x7f5c3006e420 2024-08-17T02:28:30.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.638+0000 7f5c36a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c301575e0 con 0x7f5c30150130 2024-08-17T02:28:30.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.638+0000 7f5c36a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c301578c0 con 0x7f5c30156d40 2024-08-17T02:28:30.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.639+0000 7f5c2fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c3006e420 0x7f5c3014e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.639+0000 7f5c2fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c3006e420 0x7f5c3014e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:51390/0 (socket says 172.21.15.106:51390) 2024-08-17T02:28:30.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.639+0000 7f5c2fe00640 1 -- 172.21.15.106:0/693189394 learned_addr learned my addr 172.21.15.106:0/693189394 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:30.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.639+0000 7f5c2f400640 1 --2- 172.21.15.106:0/693189394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c30150130 0x7f5c300a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.639+0000 7f5c34a00640 1 --2- 172.21.15.106:0/693189394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c30156d40 0x7f5c300a93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.639+0000 7f5c2fe00640 1 -- 172.21.15.106:0/693189394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c30156d40 msgr2=0x7f5c300a93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.639+0000 7f5c2fe00640 1 --2- 172.21.15.106:0/693189394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c30156d40 0x7f5c300a93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.639+0000 7f5c2fe00640 1 -- 172.21.15.106:0/693189394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c30150130 msgr2=0x7f5c300a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.639+0000 7f5c2fe00640 1 --2- 172.21.15.106:0/693189394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c30150130 0x7f5c300a54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.639+0000 7f5c2fe00640 1 -- 172.21.15.106:0/693189394 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c28009ae0 con 0x7f5c3006e420 2024-08-17T02:28:30.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.639+0000 7f5c2fe00640 1 --2- 172.21.15.106:0/693189394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c3006e420 0x7f5c3014e670 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5c2000c880 tx=0x7f5c20008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:30.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.639+0000 7f5c27400640 1 -- 172.21.15.106:0/693189394 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c20007620 con 0x7f5c3006e420 2024-08-17T02:28:30.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.639+0000 7f5c27400640 1 -- 172.21.15.106:0/693189394 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c20007780 con 0x7f5c3006e420 2024-08-17T02:28:30.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.640+0000 7f5c36a00640 1 -- 172.21.15.106:0/693189394 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c30157ba0 con 0x7f5c3006e420 2024-08-17T02:28:30.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.640+0000 7f5c27400640 1 -- 172.21.15.106:0/693189394 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c20007b00 con 0x7f5c3006e420 2024-08-17T02:28:30.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.640+0000 7f5c36a00640 1 -- 172.21.15.106:0/693189394 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c300a5a10 con 0x7f5c3006e420 2024-08-17T02:28:30.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.641+0000 7f5c36a00640 1 -- 172.21.15.106:0/693189394 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c300710c0 con 0x7f5c3006e420 2024-08-17T02:28:30.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.641+0000 7f5c27400640 1 -- 172.21.15.106:0/693189394 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5c200113f0 con 0x7f5c3006e420 2024-08-17T02:28:30.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.642+0000 7f5c27400640 1 --2- 172.21.15.106:0/693189394 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5c10065150 0x7f5c10067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.642+0000 7f5c27400640 1 -- 172.21.15.106:0/693189394 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5907+0+0 (secure 0 0 0) 0x7f5c200825a0 con 0x7f5c3006e420 2024-08-17T02:28:30.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.642+0000 7f5c2f400640 1 --2- 172.21.15.106:0/693189394 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5c10065150 0x7f5c10067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.643+0000 7f5c2f400640 1 --2- 172.21.15.106:0/693189394 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5c10065150 0x7f5c10067600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c006fd0 tx=0x7f5c1c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:30.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.646+0000 7f5c27400640 1 -- 172.21.15.106:0/693189394 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5c200504f0 con 0x7f5c3006e420 2024-08-17T02:28:30.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:30.818+0000 7f5c36a00640 1 -- 172.21.15.106:0/693189394 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5c300c8610 con 0x7f5c3006e420 2024-08-17T02:28:31.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.461+0000 7f5c27400640 1 -- 172.21.15.106:0/693189394 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5c20053b10 con 0x7f5c3006e420 2024-08-17T02:28:31.462 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:28:31.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.466+0000 7f5c36a00640 1 -- 172.21.15.106:0/693189394 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5c10065150 msgr2=0x7f5c10067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:31.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.466+0000 7f5c36a00640 1 --2- 172.21.15.106:0/693189394 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5c10065150 0x7f5c10067600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c006fd0 tx=0x7f5c1c008040 comp rx=0 tx=0).stop 2024-08-17T02:28:31.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.466+0000 7f5c36a00640 1 -- 172.21.15.106:0/693189394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c3006e420 msgr2=0x7f5c3014e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:31.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.466+0000 7f5c36a00640 1 --2- 172.21.15.106:0/693189394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c3006e420 0x7f5c3014e670 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5c2000c880 tx=0x7f5c20008040 comp rx=0 tx=0).stop 2024-08-17T02:28:31.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.466+0000 7f5c36a00640 1 -- 172.21.15.106:0/693189394 shutdown_connections 2024-08-17T02:28:31.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.466+0000 7f5c36a00640 1 --2- 172.21.15.106:0/693189394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c30156d40 0x7f5c300a93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.466+0000 7f5c36a00640 1 --2- 172.21.15.106:0/693189394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c30150130 0x7f5c300a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.466+0000 7f5c36a00640 1 --2- 172.21.15.106:0/693189394 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5c10065150 0x7f5c10067600 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.466+0000 7f5c36a00640 1 --2- 172.21.15.106:0/693189394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c3006e420 0x7f5c3014e670 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.466+0000 7f5c36a00640 1 -- 172.21.15.106:0/693189394 >> 172.21.15.106:0/693189394 conn(0x7f5c30067750 msgr2=0x7f5c3006d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:31.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.466+0000 7f5c36a00640 1 -- 172.21.15.106:0/693189394 shutdown_connections 2024-08-17T02:28:31.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.466+0000 7f5c36a00640 1 -- 172.21.15.106:0/693189394 wait complete. 2024-08-17T02:28:31.491 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:28:31.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.643+0000 7fd279200640 1 Processor -- start 2024-08-17T02:28:31.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.643+0000 7fd279200640 1 -- start start 2024-08-17T02:28:31.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.645+0000 7fd279200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2740adbb0 0x7fd2740af110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:31.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.645+0000 7fd279200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd274157140 0x7fd2741575c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:31.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.645+0000 7fd279200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2740aec80 con 0x7fd2741510b0 2024-08-17T02:28:31.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.645+0000 7fd279200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2740af650 con 0x7fd274157140 2024-08-17T02:28:31.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.645+0000 7fd279200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd274157b00 con 0x7fd2740adbb0 2024-08-17T02:28:31.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.645+0000 7fd273400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd2741510b0 0x7fd2740ad4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:60494/0 (socket says 172.21.15.106:60494) 2024-08-17T02:28:31.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.645+0000 7fd273400640 1 -- 172.21.15.106:0/557910780 learned_addr learned my addr 172.21.15.106:0/557910780 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:31.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.645+0000 7fd26aa00640 1 --2- 172.21.15.106:0/557910780 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2740adbb0 0x7fd2740af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:31.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.645+0000 7fd273e00640 1 --2- 172.21.15.106:0/557910780 >> v2:172.21.15.171:3300/0 conn(0x7fd274157140 0x7fd2741575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:31.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.645+0000 7fd272a00640 1 -- 172.21.15.106:0/557910780 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2863162809 0 0) 0x7fd2740aec80 con 0x7fd2741510b0 2024-08-17T02:28:31.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.645+0000 7fd272a00640 1 -- 172.21.15.106:0/557910780 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2580034e0 con 0x7fd2741510b0 2024-08-17T02:28:31.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.646+0000 7fd272a00640 1 -- 172.21.15.106:0/557910780 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1416409210 0 0) 0x7fd2580034e0 con 0x7fd2741510b0 2024-08-17T02:28:31.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.646+0000 7fd272a00640 1 -- 172.21.15.106:0/557910780 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2740adbb0 msgr2=0x7fd2740af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:31.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.646+0000 7fd272a00640 1 --2- 172.21.15.106:0/557910780 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2740adbb0 0x7fd2740af110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.646+0000 7fd272a00640 1 -- 172.21.15.106:0/557910780 >> v2:172.21.15.171:3300/0 conn(0x7fd274157140 msgr2=0x7fd2741575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:31.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.646+0000 7fd272a00640 1 --2- 172.21.15.106:0/557910780 >> v2:172.21.15.171:3300/0 conn(0x7fd274157140 0x7fd2741575c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.646+0000 7fd272a00640 1 -- 172.21.15.106:0/557910780 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2740cc6a0 con 0x7fd2741510b0 2024-08-17T02:28:31.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.646+0000 7fd272a00640 1 -- 172.21.15.106:0/557910780 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7fd264001470 con 0x7fd2741510b0 2024-08-17T02:28:31.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.646+0000 7fd272a00640 1 -- 172.21.15.106:0/557910780 >> v1:172.21.15.106:6789/0 conn(0x7fd2741510b0 legacy=0x7fd2740ad4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:31.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.646+0000 7fd272a00640 1 --2- 172.21.15.106:0/557910780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2580039d0 0x7fd258003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:31.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.646+0000 7fd272a00640 1 --2- 172.21.15.106:0/557910780 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd258004780 0x7fd258004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:31.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.646+0000 7fd272a00640 1 --2- 172.21.15.106:0/557910780 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2740adbb0 0x7fd258005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:31.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.646+0000 7fd272a00640 1 -- 172.21.15.106:0/557910780 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2740af650 con 0x7fd2580039d0 2024-08-17T02:28:31.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.646+0000 7fd272a00640 1 -- 172.21.15.106:0/557910780 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd274157b00 con 0x7fd258004780 2024-08-17T02:28:31.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.646+0000 7fd272a00640 1 -- 172.21.15.106:0/557910780 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25800b9d0 con 0x7fd2740adbb0 2024-08-17T02:28:31.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.646+0000 7fd273400640 1 --2- 172.21.15.106:0/557910780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2580039d0 0x7fd258003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:31.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.646+0000 7fd26aa00640 1 --2- 172.21.15.106:0/557910780 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd258004780 0x7fd258004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:31.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.646+0000 7fd273e00640 1 --2- 172.21.15.106:0/557910780 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2740adbb0 0x7fd258005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:31.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.647+0000 7fd273400640 1 -- 172.21.15.106:0/557910780 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2740adbb0 msgr2=0x7fd258005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:31.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.647+0000 7fd273400640 1 --2- 172.21.15.106:0/557910780 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2740adbb0 0x7fd258005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.647+0000 7fd273400640 1 -- 172.21.15.106:0/557910780 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd258004780 msgr2=0x7fd258004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:31.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.647+0000 7fd273400640 1 --2- 172.21.15.106:0/557910780 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd258004780 0x7fd258004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.647+0000 7fd273400640 1 -- 172.21.15.106:0/557910780 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2580034e0 con 0x7fd2580039d0 2024-08-17T02:28:31.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.648+0000 7fd273400640 1 --2- 172.21.15.106:0/557910780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2580039d0 0x7fd258003de0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd26400c2d0 tx=0x7fd264001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7527c98439a0ce38 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:31.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.648+0000 7fd272a00640 1 -- 172.21.15.106:0/557910780 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd264005890 con 0x7fd2580039d0 2024-08-17T02:28:31.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.648+0000 7fd272a00640 1 -- 172.21.15.106:0/557910780 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd264005a30 con 0x7fd2580039d0 2024-08-17T02:28:31.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.648+0000 7fd272a00640 1 -- 172.21.15.106:0/557910780 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd264005e30 con 0x7fd2580039d0 2024-08-17T02:28:31.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.648+0000 7fd279200640 1 -- 172.21.15.106:0/557910780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2580039d0 msgr2=0x7fd258003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:31.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.648+0000 7fd279200640 1 --2- 172.21.15.106:0/557910780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2580039d0 0x7fd258003de0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd26400c2d0 tx=0x7fd264001e90 comp rx=0 tx=0).stop 2024-08-17T02:28:31.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.648+0000 7fd273e00640 1 -- 172.21.15.106:0/557910780 reap_dead start 2024-08-17T02:28:31.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.648+0000 7fd279200640 1 -- 172.21.15.106:0/557910780 shutdown_connections 2024-08-17T02:28:31.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.648+0000 7fd279200640 1 -- 172.21.15.106:0/557910780 >> 172.21.15.106:0/557910780 conn(0x7fd274067750 msgr2=0x7fd2740cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:31.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.648+0000 7fd279200640 1 -- 172.21.15.106:0/557910780 shutdown_connections 2024-08-17T02:28:31.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.648+0000 7fd279200640 1 -- 172.21.15.106:0/557910780 wait complete. 2024-08-17T02:28:31.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.650+0000 7fd279200640 1 Processor -- start 2024-08-17T02:28:31.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.650+0000 7fd279200640 1 -- start start 2024-08-17T02:28:31.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.651+0000 7fd279200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2580039d0 0x7fd27416c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:31.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.651+0000 7fd279200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd27416cc00 0x7fd274151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:31.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.651+0000 7fd279200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd274151fe0 0x7fd274149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:31.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.651+0000 7fd279200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd274152e10 con 0x7fd274151fe0 2024-08-17T02:28:31.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.651+0000 7fd279200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27416a730 con 0x7fd27416cc00 2024-08-17T02:28:31.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.651+0000 7fd279200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27416d050 con 0x7fd2580039d0 2024-08-17T02:28:31.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.651+0000 7fd273e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd274151fe0 0x7fd274149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:31.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.651+0000 7fd273e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd274151fe0 0x7fd274149130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:51422/0 (socket says 172.21.15.106:51422) 2024-08-17T02:28:31.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.651+0000 7fd273e00640 1 -- 172.21.15.106:0/1688920922 learned_addr learned my addr 172.21.15.106:0/1688920922 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:31.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.651+0000 7fd273400640 1 --2- 172.21.15.106:0/1688920922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2580039d0 0x7fd27416c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:31.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.651+0000 7fd273e00640 1 -- 172.21.15.106:0/1688920922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2580039d0 msgr2=0x7fd27416c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:31.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.651+0000 7fd26aa00640 1 --2- 172.21.15.106:0/1688920922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd27416cc00 0x7fd274151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:31.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.651+0000 7fd273e00640 1 --2- 172.21.15.106:0/1688920922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2580039d0 0x7fd27416c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.651+0000 7fd273e00640 1 -- 172.21.15.106:0/1688920922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd27416cc00 msgr2=0x7fd274151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:31.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.651+0000 7fd273e00640 1 --2- 172.21.15.106:0/1688920922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd27416cc00 0x7fd274151aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.651+0000 7fd273e00640 1 -- 172.21.15.106:0/1688920922 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd274152850 con 0x7fd274151fe0 2024-08-17T02:28:31.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.651+0000 7fd273400640 1 --2- 172.21.15.106:0/1688920922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2580039d0 0x7fd27416c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:31.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.651+0000 7fd26aa00640 1 --2- 172.21.15.106:0/1688920922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd27416cc00 0x7fd274151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:31.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.652+0000 7fd273e00640 1 --2- 172.21.15.106:0/1688920922 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd274151fe0 0x7fd274149130 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd26c0094d0 tx=0x7fd26c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:31.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.652+0000 7fd26b400640 1 -- 172.21.15.106:0/1688920922 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c00e040 con 0x7fd274151fe0 2024-08-17T02:28:31.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.652+0000 7fd26b400640 1 -- 172.21.15.106:0/1688920922 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26c00f040 con 0x7fd274151fe0 2024-08-17T02:28:31.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.652+0000 7fd279200640 1 -- 172.21.15.106:0/1688920922 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd274152b30 con 0x7fd274151fe0 2024-08-17T02:28:31.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.652+0000 7fd26b400640 1 -- 172.21.15.106:0/1688920922 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c015940 con 0x7fd274151fe0 2024-08-17T02:28:31.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.652+0000 7fd279200640 1 -- 172.21.15.106:0/1688920922 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd274152450 con 0x7fd274151fe0 2024-08-17T02:28:31.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.653+0000 7fd279200640 1 -- 172.21.15.106:0/1688920922 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd27416a8e0 con 0x7fd274151fe0 2024-08-17T02:28:31.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.654+0000 7fd26b400640 1 -- 172.21.15.106:0/1688920922 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd26c015d30 con 0x7fd274151fe0 2024-08-17T02:28:31.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.655+0000 7fd26b400640 1 --2- 172.21.15.106:0/1688920922 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd250065150 0x7fd250067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:31.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.655+0000 7fd26b400640 1 -- 172.21.15.106:0/1688920922 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5469+0+0 (secure 0 0 0) 0x7fd26c0825f0 con 0x7fd274151fe0 2024-08-17T02:28:31.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.655+0000 7fd273400640 1 --2- 172.21.15.106:0/1688920922 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd250065150 0x7fd250067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:31.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.656+0000 7fd273400640 1 --2- 172.21.15.106:0/1688920922 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd250065150 0x7fd250067600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd264033000 tx=0x7fd264034000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:31.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.659+0000 7fd26b400640 1 -- 172.21.15.106:0/1688920922 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd27416a8e0 con 0x7fd274151fe0 2024-08-17T02:28:31.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:31.837+0000 7fd279200640 1 -- 172.21.15.106:0/1688920922 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd27416a8e0 con 0x7fd274151fe0 2024-08-17T02:28:32.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.465+0000 7fd26b400640 1 -- 172.21.15.106:0/1688920922 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd27416a8e0 con 0x7fd274151fe0 2024-08-17T02:28:32.466 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_data' removed 2024-08-17T02:28:32.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.468+0000 7fd279200640 1 -- 172.21.15.106:0/1688920922 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd250065150 msgr2=0x7fd250067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.468+0000 7fd279200640 1 --2- 172.21.15.106:0/1688920922 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd250065150 0x7fd250067600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd264033000 tx=0x7fd264034000 comp rx=0 tx=0).stop 2024-08-17T02:28:32.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.468+0000 7fd279200640 1 -- 172.21.15.106:0/1688920922 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd274151fe0 msgr2=0x7fd274149130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.468+0000 7fd279200640 1 --2- 172.21.15.106:0/1688920922 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd274151fe0 0x7fd274149130 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd26c0094d0 tx=0x7fd26c00b040 comp rx=0 tx=0).stop 2024-08-17T02:28:32.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.468+0000 7fd279200640 1 -- 172.21.15.106:0/1688920922 shutdown_connections 2024-08-17T02:28:32.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.468+0000 7fd279200640 1 --2- 172.21.15.106:0/1688920922 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd250065150 0x7fd250067600 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.468+0000 7fd279200640 1 --2- 172.21.15.106:0/1688920922 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd274151fe0 0x7fd274149130 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.468+0000 7fd279200640 1 --2- 172.21.15.106:0/1688920922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd27416cc00 0x7fd274151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.468+0000 7fd279200640 1 --2- 172.21.15.106:0/1688920922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2580039d0 0x7fd27416c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.468+0000 7fd279200640 1 -- 172.21.15.106:0/1688920922 >> 172.21.15.106:0/1688920922 conn(0x7fd274067750 msgr2=0x7fd2740a98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:32.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.468+0000 7fd279200640 1 -- 172.21.15.106:0/1688920922 shutdown_connections 2024-08-17T02:28:32.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.468+0000 7fd279200640 1 -- 172.21.15.106:0/1688920922 wait complete. 2024-08-17T02:28:32.485 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:28:32.485 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-17T02:28:32.485 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:28:32.485 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:32.486 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:28:32.486 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-17T02:28:32.486 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:28:32.486 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:32.486 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:28:32.486 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-17T02:28:32.487 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:28:32.487 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:32.487 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:28:32.487 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-17T02:28:32.487 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:28:32.487 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:28:32.500 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:28:32.500 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:28:32.502 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:28:32.502 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:28:32.503 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:28:32.503 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:28:32.504 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:28:32.504 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:28:32.546 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:28:32.546 DEBUG:teuthology.parallel:result is None 2024-08-17T02:28:32.548 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:28:32.549 DEBUG:teuthology.parallel:result is None 2024-08-17T02:28:32.549 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:28:32.549 DEBUG:teuthology.parallel:result is None 2024-08-17T02:28:32.550 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:28:32.551 DEBUG:teuthology.parallel:result is None 2024-08-17T02:28:32.551 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-17T02:28:32.670 INFO:tasks.ceph.mds.c.smithi106.stdout:starting mds.c at 2024-08-17T02:28:32.671 INFO:tasks.ceph.mds.a.smithi106.stdout:starting mds.a at 2024-08-17T02:28:32.679 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-08-17T02:28:32.679 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-08-17T02:28:32.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.707+0000 7f39f4a00640 1 Processor -- start 2024-08-17T02:28:32.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.707+0000 7f39f4a00640 1 -- start start 2024-08-17T02:28:32.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.708+0000 7f39f4a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39f0158cf0 0x7f39f015a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.708+0000 7f39f4a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f39f0159ba0 0x7f39f00cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.708+0000 7f39f4a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f015a590 con 0x7f39f01590c0 2024-08-17T02:28:32.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.708+0000 7f39f4a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f00cbd90 con 0x7f39f0159ba0 2024-08-17T02:28:32.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.708+0000 7f39f4a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f00cb4d0 con 0x7f39f0158cf0 2024-08-17T02:28:32.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.708+0000 7f39eea00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f39f01590c0 0x7f39f0159490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:60518/0 (socket says 172.21.15.106:60518) 2024-08-17T02:28:32.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.708+0000 7f39eea00640 1 -- 172.21.15.106:0/2604260799 learned_addr learned my addr 172.21.15.106:0/2604260799 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:32.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.708+0000 7f39ef400640 1 --2- 172.21.15.106:0/2604260799 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39f0158cf0 0x7f39f015a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.708+0000 7f39efe00640 1 --2- 172.21.15.106:0/2604260799 >> v2:172.21.15.171:3300/0 conn(0x7f39f0159ba0 0x7f39f00cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.709+0000 7f39ef400640 1 -- 172.21.15.106:0/2604260799 >> v2:172.21.15.171:3300/0 conn(0x7f39f0159ba0 msgr2=0x7f39f00cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:32.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.709+0000 7f39ef400640 1 --2- 172.21.15.106:0/2604260799 >> v2:172.21.15.171:3300/0 conn(0x7f39f0159ba0 0x7f39f00cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.709+0000 7f39ef400640 1 -- 172.21.15.106:0/2604260799 >> v1:172.21.15.106:6789/0 conn(0x7f39f01590c0 legacy=0x7f39f0159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.709+0000 7f39ef400640 1 -- 172.21.15.106:0/2604260799 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f00cb740 con 0x7f39f0158cf0 2024-08-17T02:28:32.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.709+0000 7f39ee000640 1 -- 172.21.15.106:0/2604260799 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1464642842 0 0) 0x7f39dc001110 con 0x7f39f01590c0 2024-08-17T02:28:32.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.710+0000 7f39ef400640 1 --2- 172.21.15.106:0/2604260799 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39f0158cf0 0x7f39f015a050 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f39e0009850 tx=0x7f39e00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81aaf81a78635610 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:32.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.710+0000 7f39ee000640 1 -- 172.21.15.106:0/2604260799 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e002ad90 con 0x7f39f0158cf0 2024-08-17T02:28:32.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.710+0000 7f39ee000640 1 -- 172.21.15.106:0/2604260799 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e0032440 con 0x7f39f0158cf0 2024-08-17T02:28:32.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.710+0000 7f39ee000640 1 -- 172.21.15.106:0/2604260799 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e00327e0 con 0x7f39f0158cf0 2024-08-17T02:28:32.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.711+0000 7f39f4a00640 1 -- 172.21.15.106:0/2604260799 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39f0158cf0 msgr2=0x7f39f015a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.711+0000 7f39f4a00640 1 --2- 172.21.15.106:0/2604260799 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39f0158cf0 0x7f39f015a050 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f39e0009850 tx=0x7f39e00090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.711+0000 7f39f4a00640 1 -- 172.21.15.106:0/2604260799 shutdown_connections 2024-08-17T02:28:32.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.711+0000 7f39f4a00640 1 --2- 172.21.15.106:0/2604260799 >> v2:172.21.15.171:3300/0 conn(0x7f39f0159ba0 0x7f39f00cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.711+0000 7f39f4a00640 1 --2- 172.21.15.106:0/2604260799 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39f0158cf0 0x7f39f015a050 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.711+0000 7f39f4a00640 1 -- 172.21.15.106:0/2604260799 >> 172.21.15.106:0/2604260799 conn(0x7f39f006eb90 msgr2=0x7f39f00cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:32.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.711+0000 7f39f4a00640 1 -- 172.21.15.106:0/2604260799 shutdown_connections 2024-08-17T02:28:32.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.711+0000 7f39f4a00640 1 -- 172.21.15.106:0/2604260799 wait complete. 2024-08-17T02:28:32.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.712+0000 7f39f4a00640 1 Processor -- start 2024-08-17T02:28:32.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.712+0000 7f39f4a00640 1 -- start start 2024-08-17T02:28:32.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.713+0000 7f39f4a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39f0158cf0 0x7f39f00b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.713+0000 7f39f4a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39f01590c0 0x7f39f00c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.713+0000 7f39f4a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39f0159ba0 0x7f39f009d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.713+0000 7f39f4a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f01450e0 con 0x7f39f0158cf0 2024-08-17T02:28:32.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.713+0000 7f39f4a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f009d7d0 con 0x7f39f01590c0 2024-08-17T02:28:32.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.713+0000 7f39f4a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f00c7610 con 0x7f39f0159ba0 2024-08-17T02:28:32.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.713+0000 7f39ef400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39f0158cf0 0x7f39f00b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.713+0000 7f39ef400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39f0158cf0 0x7f39f00b4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:51466/0 (socket says 172.21.15.106:51466) 2024-08-17T02:28:32.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.713+0000 7f39ef400640 1 -- 172.21.15.106:0/3283756551 learned_addr learned my addr 172.21.15.106:0/3283756551 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:32.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.713+0000 7f39efe00640 1 --2- 172.21.15.106:0/3283756551 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39f0159ba0 0x7f39f009d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.713+0000 7f39eea00640 1 --2- 172.21.15.106:0/3283756551 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39f01590c0 0x7f39f00c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.714+0000 7f39ef400640 1 -- 172.21.15.106:0/3283756551 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39f0159ba0 msgr2=0x7f39f009d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.714+0000 7f39ef400640 1 --2- 172.21.15.106:0/3283756551 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39f0159ba0 0x7f39f009d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.714+0000 7f39ef400640 1 -- 172.21.15.106:0/3283756551 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39f01590c0 msgr2=0x7f39f00c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.714+0000 7f39ef400640 1 --2- 172.21.15.106:0/3283756551 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39f01590c0 0x7f39f00c6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.714+0000 7f39ef400640 1 -- 172.21.15.106:0/3283756551 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e0009390 con 0x7f39f0158cf0 2024-08-17T02:28:32.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.714+0000 7f39ef400640 1 --2- 172.21.15.106:0/3283756551 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39f0158cf0 0x7f39f00b4300 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f39e0009360 tx=0x7f39e0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:32.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.714+0000 7f39e6a00640 1 -- 172.21.15.106:0/3283756551 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e0000d10 con 0x7f39f0158cf0 2024-08-17T02:28:32.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.714+0000 7f39e6a00640 1 -- 172.21.15.106:0/3283756551 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e0031e00 con 0x7f39f0158cf0 2024-08-17T02:28:32.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.714+0000 7f39e6a00640 1 -- 172.21.15.106:0/3283756551 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e003d670 con 0x7f39f0158cf0 2024-08-17T02:28:32.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.714+0000 7f39f4a00640 1 -- 172.21.15.106:0/3283756551 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f00b4950 con 0x7f39f0158cf0 2024-08-17T02:28:32.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.715+0000 7f39f4a00640 1 -- 172.21.15.106:0/3283756551 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f00b4f10 con 0x7f39f0158cf0 2024-08-17T02:28:32.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.716+0000 7f39f4a00640 1 -- 172.21.15.106:0/3283756551 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f0071050 con 0x7f39f0158cf0 2024-08-17T02:28:32.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.716+0000 7f39e6a00640 1 -- 172.21.15.106:0/3283756551 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f39e0039040 con 0x7f39f0158cf0 2024-08-17T02:28:32.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.717+0000 7f39e6a00640 1 --2- 172.21.15.106:0/3283756551 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f39d0065150 0x7f39d0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.717+0000 7f39e6a00640 1 -- 172.21.15.106:0/3283756551 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f39e00a21a0 con 0x7f39f0158cf0 2024-08-17T02:28:32.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.717+0000 7f39eea00640 1 --2- 172.21.15.106:0/3283756551 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f39d0065150 0x7f39d0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.718+0000 7f39eea00640 1 --2- 172.21.15.106:0/3283756551 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f39d0065150 0x7f39d0067600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f39f0156c10 tx=0x7f39dc007b00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:32.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.721+0000 7f39e6a00640 1 -- 172.21.15.106:0/3283756551 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f39e0070570 con 0x7f39f0158cf0 2024-08-17T02:28:32.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:32.906+0000 7f39f4a00640 1 -- 172.21.15.106:0/3283756551 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f39f0156680 con 0x7f39f0158cf0 2024-08-17T02:28:33.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.478+0000 7f39e6a00640 1 -- 172.21.15.106:0/3283756551 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7f39e0073b90 con 0x7f39f0158cf0 2024-08-17T02:28:33.479 INFO:teuthology.orchestra.run.smithi106.stderr: removed all blocklist entries 2024-08-17T02:28:33.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.481+0000 7f39f4a00640 1 -- 172.21.15.106:0/3283756551 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f39d0065150 msgr2=0x7f39d0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.481+0000 7f39f4a00640 1 --2- 172.21.15.106:0/3283756551 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f39d0065150 0x7f39d0067600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f39f0156c10 tx=0x7f39dc007b00 comp rx=0 tx=0).stop 2024-08-17T02:28:33.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.481+0000 7f39f4a00640 1 -- 172.21.15.106:0/3283756551 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39f0158cf0 msgr2=0x7f39f00b4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.481+0000 7f39f4a00640 1 --2- 172.21.15.106:0/3283756551 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39f0158cf0 0x7f39f00b4300 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f39e0009360 tx=0x7f39e0032000 comp rx=0 tx=0).stop 2024-08-17T02:28:33.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.481+0000 7f39f4a00640 1 -- 172.21.15.106:0/3283756551 shutdown_connections 2024-08-17T02:28:33.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.481+0000 7f39f4a00640 1 --2- 172.21.15.106:0/3283756551 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39f0159ba0 0x7f39f009d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.481+0000 7f39f4a00640 1 --2- 172.21.15.106:0/3283756551 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39f01590c0 0x7f39f00c6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.481+0000 7f39f4a00640 1 --2- 172.21.15.106:0/3283756551 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f39d0065150 0x7f39d0067600 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.481+0000 7f39f4a00640 1 --2- 172.21.15.106:0/3283756551 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39f0158cf0 0x7f39f00b4300 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.481+0000 7f39f4a00640 1 -- 172.21.15.106:0/3283756551 >> 172.21.15.106:0/3283756551 conn(0x7f39f006eb90 msgr2=0x7f39f0155380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:33.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.482+0000 7f39f4a00640 1 -- 172.21.15.106:0/3283756551 shutdown_connections 2024-08-17T02:28:33.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.483+0000 7f39f4a00640 1 -- 172.21.15.106:0/3283756551 wait complete. 2024-08-17T02:28:33.507 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-17T02:28:33.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.655+0000 7fa612800640 1 Processor -- start 2024-08-17T02:28:33.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.655+0000 7fa612800640 1 -- start start 2024-08-17T02:28:33.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.656+0000 7fa612800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa60c155550 0x7fa60c0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.657+0000 7fa612800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60c0afc10 con 0x7fa60c155180 2024-08-17T02:28:33.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.657+0000 7fa612800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60c0af000 con 0x7fa60c06e080 2024-08-17T02:28:33.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.657+0000 7fa612800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c0af2e0 con 0x7fa60c155550 2024-08-17T02:28:33.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.657+0000 7fa60b400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa60c155180 0x7fa60c0ae070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:60520/0 (socket says 172.21.15.106:60520) 2024-08-17T02:28:33.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.657+0000 7fa60b400640 1 -- 172.21.15.106:0/2848561752 learned_addr learned my addr 172.21.15.106:0/2848561752 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:33.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.657+0000 7fa602a00640 1 --2- 172.21.15.106:0/2848561752 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa60c155550 0x7fa60c0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.657+0000 7fa60aa00640 1 -- 172.21.15.106:0/2848561752 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769392887 0 0) 0x7fa60c0afc10 con 0x7fa60c155180 2024-08-17T02:28:33.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.657+0000 7fa60aa00640 1 -- 172.21.15.106:0/2848561752 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5f00034e0 con 0x7fa60c155180 2024-08-17T02:28:33.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.657+0000 7fa60aa00640 1 -- 172.21.15.106:0/2848561752 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2457931518 0 0) 0x7fa60c0af000 con 0x7fa60c06e080 2024-08-17T02:28:33.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.657+0000 7fa60aa00640 1 -- 172.21.15.106:0/2848561752 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa60c0afc10 con 0x7fa60c06e080 2024-08-17T02:28:33.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.657+0000 7fa60aa00640 1 -- 172.21.15.106:0/2848561752 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2918356962 0 0) 0x7fa5f00034e0 con 0x7fa60c155180 2024-08-17T02:28:33.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.657+0000 7fa60aa00640 1 -- 172.21.15.106:0/2848561752 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa60c155550 msgr2=0x7fa60c0aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:33.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.658+0000 7fa60aa00640 1 --2- 172.21.15.106:0/2848561752 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa60c155550 0x7fa60c0aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.658+0000 7fa60aa00640 1 -- 172.21.15.106:0/2848561752 >> v1:172.21.15.171:6789/0 conn(0x7fa60c06e080 legacy=0x7fa60c0c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.658+0000 7fa60aa00640 1 -- 172.21.15.106:0/2848561752 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c0af5c0 con 0x7fa60c155180 2024-08-17T02:28:33.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.658+0000 7fa60aa00640 1 -- 172.21.15.106:0/2848561752 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7fa5fc001470 con 0x7fa60c155180 2024-08-17T02:28:33.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.658+0000 7fa60aa00640 1 -- 172.21.15.106:0/2848561752 >> v1:172.21.15.106:6789/0 conn(0x7fa60c155180 legacy=0x7fa60c0ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.658+0000 7fa60aa00640 1 --2- 172.21.15.106:0/2848561752 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5f0003b90 0x7fa5f0003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.658+0000 7fa60aa00640 1 --2- 172.21.15.106:0/2848561752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5f0004780 0x7fa5f0004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.658+0000 7fa60aa00640 1 --2- 172.21.15.106:0/2848561752 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa60c155550 0x7fa5f0005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.658+0000 7fa60aa00640 1 -- 172.21.15.106:0/2848561752 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c0af2e0 con 0x7fa5f0003b90 2024-08-17T02:28:33.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.658+0000 7fa60aa00640 1 -- 172.21.15.106:0/2848561752 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f000bae0 con 0x7fa5f0004780 2024-08-17T02:28:33.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.658+0000 7fa60aa00640 1 -- 172.21.15.106:0/2848561752 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f000bca0 con 0x7fa60c155550 2024-08-17T02:28:33.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.658+0000 7fa60b400640 1 --2- 172.21.15.106:0/2848561752 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5f0003b90 0x7fa5f0003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.658+0000 7fa602a00640 1 --2- 172.21.15.106:0/2848561752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5f0004780 0x7fa5f0004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.658+0000 7fa60be00640 1 --2- 172.21.15.106:0/2848561752 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa60c155550 0x7fa5f0005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.658+0000 7fa60b400640 1 -- 172.21.15.106:0/2848561752 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa60c155550 msgr2=0x7fa5f0005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:33.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.658+0000 7fa60b400640 1 --2- 172.21.15.106:0/2848561752 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa60c155550 0x7fa5f0005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.658+0000 7fa60b400640 1 -- 172.21.15.106:0/2848561752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5f0004780 msgr2=0x7fa5f0004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:33.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.658+0000 7fa60b400640 1 --2- 172.21.15.106:0/2848561752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5f0004780 0x7fa5f0004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.658+0000 7fa60b400640 1 -- 172.21.15.106:0/2848561752 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f00034e0 con 0x7fa5f0003b90 2024-08-17T02:28:33.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.658+0000 7fa602a00640 1 --2- 172.21.15.106:0/2848561752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5f0004780 0x7fa5f0004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:33.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.659+0000 7fa60b400640 1 --2- 172.21.15.106:0/2848561752 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5f0003b90 0x7fa5f0003f80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc00c210 tx=0x7fa5fc001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa936f25e09b461 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:33.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.660+0000 7fa60aa00640 1 -- 172.21.15.106:0/2848561752 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc005960 con 0x7fa5f0003b90 2024-08-17T02:28:33.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.660+0000 7fa60aa00640 1 -- 172.21.15.106:0/2848561752 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5fc005ae0 con 0x7fa5f0003b90 2024-08-17T02:28:33.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.660+0000 7fa60aa00640 1 -- 172.21.15.106:0/2848561752 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc005ea0 con 0x7fa5f0003b90 2024-08-17T02:28:33.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.660+0000 7fa612800640 1 -- 172.21.15.106:0/2848561752 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5f0003b90 msgr2=0x7fa5f0003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.660+0000 7fa612800640 1 --2- 172.21.15.106:0/2848561752 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5f0003b90 0x7fa5f0003f80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc00c210 tx=0x7fa5fc001e10 comp rx=0 tx=0).stop 2024-08-17T02:28:33.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.660+0000 7fa60be00640 1 -- 172.21.15.106:0/2848561752 reap_dead start 2024-08-17T02:28:33.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.660+0000 7fa612800640 1 -- 172.21.15.106:0/2848561752 shutdown_connections 2024-08-17T02:28:33.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.660+0000 7fa612800640 1 -- 172.21.15.106:0/2848561752 >> 172.21.15.106:0/2848561752 conn(0x7fa60c0cb9b0 msgr2=0x7fa60c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:33.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.660+0000 7fa612800640 1 -- 172.21.15.106:0/2848561752 shutdown_connections 2024-08-17T02:28:33.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.660+0000 7fa612800640 1 -- 172.21.15.106:0/2848561752 wait complete. 2024-08-17T02:28:33.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.662+0000 7fa612800640 1 Processor -- start 2024-08-17T02:28:33.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.662+0000 7fa612800640 1 -- start start 2024-08-17T02:28:33.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.662+0000 7fa612800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5f0003b90 0x7fa60c0aa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.662+0000 7fa612800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa60c0aa810 0x7fa60c165f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.663+0000 7fa612800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa60c1664c0 0x7fa60c0a6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.663+0000 7fa612800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c0a7680 con 0x7fa60c1664c0 2024-08-17T02:28:33.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.663+0000 7fa612800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c0a7960 con 0x7fa5f0003b90 2024-08-17T02:28:33.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.663+0000 7fa612800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c0a7c40 con 0x7fa60c0aa810 2024-08-17T02:28:33.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.663+0000 7fa60be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa60c1664c0 0x7fa60c0a6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.663+0000 7fa60be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa60c1664c0 0x7fa60c0a6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:51482/0 (socket says 172.21.15.106:51482) 2024-08-17T02:28:33.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.663+0000 7fa60be00640 1 -- 172.21.15.106:0/1315778245 learned_addr learned my addr 172.21.15.106:0/1315778245 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:33.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.663+0000 7fa60b400640 1 --2- 172.21.15.106:0/1315778245 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5f0003b90 0x7fa60c0aa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.663+0000 7fa602a00640 1 --2- 172.21.15.106:0/1315778245 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa60c0aa810 0x7fa60c165f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.663+0000 7fa60be00640 1 -- 172.21.15.106:0/1315778245 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa60c0aa810 msgr2=0x7fa60c165f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.663+0000 7fa60be00640 1 --2- 172.21.15.106:0/1315778245 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa60c0aa810 0x7fa60c165f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.663+0000 7fa60be00640 1 -- 172.21.15.106:0/1315778245 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5f0003b90 msgr2=0x7fa60c0aa2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.663+0000 7fa60be00640 1 --2- 172.21.15.106:0/1315778245 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5f0003b90 0x7fa60c0aa2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.663+0000 7fa60be00640 1 -- 172.21.15.106:0/1315778245 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c0a7f20 con 0x7fa60c1664c0 2024-08-17T02:28:33.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.663+0000 7fa60b400640 1 --2- 172.21.15.106:0/1315778245 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5f0003b90 0x7fa60c0aa2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:33.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.663+0000 7fa60be00640 1 --2- 172.21.15.106:0/1315778245 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa60c1664c0 0x7fa60c0a6460 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa60c06f500 tx=0x7fa604007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:33.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.664+0000 7fa603400640 1 -- 172.21.15.106:0/1315778245 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60400ee80 con 0x7fa60c1664c0 2024-08-17T02:28:33.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.664+0000 7fa603400640 1 -- 172.21.15.106:0/1315778245 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa604006d20 con 0x7fa60c1664c0 2024-08-17T02:28:33.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.664+0000 7fa603400640 1 -- 172.21.15.106:0/1315778245 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa604007260 con 0x7fa60c1664c0 2024-08-17T02:28:33.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.664+0000 7fa612800640 1 -- 172.21.15.106:0/1315778245 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60c0a8200 con 0x7fa60c1664c0 2024-08-17T02:28:33.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.664+0000 7fa612800640 1 -- 172.21.15.106:0/1315778245 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60c0a69a0 con 0x7fa60c1664c0 2024-08-17T02:28:33.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.665+0000 7fa612800640 1 -- 172.21.15.106:0/1315778245 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60c0a83f0 con 0x7fa60c1664c0 2024-08-17T02:28:33.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.665+0000 7fa603400640 1 -- 172.21.15.106:0/1315778245 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa604007610 con 0x7fa60c1664c0 2024-08-17T02:28:33.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.666+0000 7fa603400640 1 --2- 172.21.15.106:0/1315778245 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa5e8065150 0x7fa5e8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.666+0000 7fa603400640 1 -- 172.21.15.106:0/1315778245 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa604081360 con 0x7fa60c1664c0 2024-08-17T02:28:33.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.666+0000 7fa60b400640 1 --2- 172.21.15.106:0/1315778245 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa5e8065150 0x7fa5e8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.667+0000 7fa60b400640 1 --2- 172.21.15.106:0/1315778245 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa5e8065150 0x7fa5e8067600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc033000 tx=0x7fa5fc034000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:33.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.670+0000 7fa603400640 1 -- 172.21.15.106:0/1315778245 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa60404ce40 con 0x7fa60c1664c0 2024-08-17T02:28:33.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.903+0000 7fa612800640 1 -- 172.21.15.106:0/1315778245 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa60c064db0 con 0x7fa60c1664c0 2024-08-17T02:28:33.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.904+0000 7fa603400640 1 -- 172.21.15.106:0/1315778245 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fa60404f6d0 con 0x7fa60c1664c0 2024-08-17T02:28:33.904 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:33.904 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-08-17T02:28:33.904 INFO:teuthology.orchestra.run.smithi106.stdout: "auth_dump": [ 2024-08-17T02:28:33.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:33.905 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mds.a", 2024-08-17T02:28:33.905 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBkCsBmbGwOERAATJC64Ew1XkVO3YnIq+uWJQ==", 2024-08-17T02:28:33.905 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-08-17T02:28:33.905 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2024-08-17T02:28:33.905 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2024-08-17T02:28:33.905 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2024-08-17T02:28:33.905 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-08-17T02:28:33.905 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:33.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-17T02:28:33.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:33.905 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mds.b", 2024-08-17T02:28:33.905 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBkCsBmNtrUIxAAhNrSSu2trKRewkSibyBIIA==", 2024-08-17T02:28:33.906 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-08-17T02:28:33.906 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2024-08-17T02:28:33.906 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2024-08-17T02:28:33.906 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2024-08-17T02:28:33.906 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-08-17T02:28:33.906 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:33.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-17T02:28:33.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:33.906 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mds.c", 2024-08-17T02:28:33.906 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBkCsBmOuJrGhAA+B1a9Hl6H5MF0iuHuQG9FA==", 2024-08-17T02:28:33.906 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-08-17T02:28:33.906 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2024-08-17T02:28:33.907 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2024-08-17T02:28:33.907 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2024-08-17T02:28:33.907 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-08-17T02:28:33.907 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:33.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-17T02:28:33.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:33.907 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mds.d", 2024-08-17T02:28:33.907 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBkCsBm05Y9LRAAeLg/8K7qn6rDG3kr3BHo8w==", 2024-08-17T02:28:33.907 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-08-17T02:28:33.907 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2024-08-17T02:28:33.907 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2024-08-17T02:28:33.907 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2024-08-17T02:28:33.907 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-08-17T02:28:33.908 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:33.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-17T02:28:33.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:33.908 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.0", 2024-08-17T02:28:33.908 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBoCsBmZxNTBxAAh7l7LkeEACf8iaQ1nEi8CQ==", 2024-08-17T02:28:33.908 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-08-17T02:28:33.908 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:33.908 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2024-08-17T02:28:33.908 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-08-17T02:28:33.908 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:33.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-17T02:28:33.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:33.908 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.1", 2024-08-17T02:28:33.908 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBrCsBmTytWCxAALORMyUE3eCFlcBD4V/+zeg==", 2024-08-17T02:28:33.908 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-08-17T02:28:33.909 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:33.909 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2024-08-17T02:28:33.909 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-08-17T02:28:33.909 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:33.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-17T02:28:33.909 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:33.909 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.2", 2024-08-17T02:28:33.909 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBuCsBmCNMnDhAA3mlQWk4lH8RXjvP+J4u7gQ==", 2024-08-17T02:28:33.909 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-08-17T02:28:33.909 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:33.909 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2024-08-17T02:28:33.909 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-08-17T02:28:33.909 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:33.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-17T02:28:33.910 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:33.910 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.3", 2024-08-17T02:28:33.910 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBxCsBm7guOERAAzIHD3BIvrW2VXOURxAHypQ==", 2024-08-17T02:28:33.910 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-08-17T02:28:33.910 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:33.910 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2024-08-17T02:28:33.910 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-08-17T02:28:33.910 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:33.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-17T02:28:33.910 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:33.910 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.4", 2024-08-17T02:28:33.910 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQB3CsBmFVcTCRAAezzbEswbRGrv5j4lXL0NTg==", 2024-08-17T02:28:33.910 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-08-17T02:28:33.911 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:33.911 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2024-08-17T02:28:33.911 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-08-17T02:28:33.911 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:33.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-17T02:28:33.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:33.911 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.5", 2024-08-17T02:28:33.911 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQB6CsBmgH8wDxAAMWOnEu/RJNDjrmqQjKQe8w==", 2024-08-17T02:28:33.911 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-08-17T02:28:33.911 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:33.911 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2024-08-17T02:28:33.911 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-08-17T02:28:33.911 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:33.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-17T02:28:33.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:33.912 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.6", 2024-08-17T02:28:33.912 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQB9CsBmnV7UERAAdAlDbklEmHdefAehWXFRTQ==", 2024-08-17T02:28:33.912 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-08-17T02:28:33.912 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:33.912 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2024-08-17T02:28:33.912 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-08-17T02:28:33.912 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:33.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-17T02:28:33.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:33.912 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.7", 2024-08-17T02:28:33.912 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQCACsBm7gcwFhAADEzJFJ4G284Sn5Bx39vW/A==", 2024-08-17T02:28:33.913 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-08-17T02:28:33.913 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2024-08-17T02:28:33.913 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2024-08-17T02:28:33.913 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-08-17T02:28:33.913 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:33.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-17T02:28:33.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:33.913 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.0", 2024-08-17T02:28:33.913 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBkCsBm9FBiNRAA5sJG0Im0gZDRIzlKHmiojg==", 2024-08-17T02:28:33.913 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-08-17T02:28:33.914 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2024-08-17T02:28:33.914 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow r", 2024-08-17T02:28:33.914 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow rw", 2024-08-17T02:28:33.914 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow rwx" 2024-08-17T02:28:33.914 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:33.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-17T02:28:33.914 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:33.914 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.1", 2024-08-17T02:28:33.914 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBlCsBmU6/8BRAA+W/hF8d4S1Yq8EMi24v0UQ==", 2024-08-17T02:28:33.914 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-08-17T02:28:33.914 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2024-08-17T02:28:33.914 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow r", 2024-08-17T02:28:33.915 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow rw", 2024-08-17T02:28:33.915 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow rwx" 2024-08-17T02:28:33.915 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:33.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-17T02:28:33.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:33.915 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.2", 2024-08-17T02:28:33.915 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBkCsBm08lsOxAAMmzLVevzPqMr3ylEKFn5bA==", 2024-08-17T02:28:33.915 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-08-17T02:28:33.915 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2024-08-17T02:28:33.915 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow r", 2024-08-17T02:28:33.915 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow rw", 2024-08-17T02:28:33.915 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow rwx" 2024-08-17T02:28:33.916 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:33.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-17T02:28:33.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:33.916 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.3", 2024-08-17T02:28:33.916 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBlCsBmHdEMDBAA61eU4jm7eu+hu0CMOtPK+A==", 2024-08-17T02:28:33.916 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-08-17T02:28:33.916 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2024-08-17T02:28:33.916 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow r", 2024-08-17T02:28:33.916 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow rw", 2024-08-17T02:28:33.916 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow rwx" 2024-08-17T02:28:33.916 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:33.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-17T02:28:33.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:33.917 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.admin", 2024-08-17T02:28:33.917 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBjCsBmj23mHRAAKtT0xD1NbWwi7aA1VtwfXg==", 2024-08-17T02:28:33.917 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-08-17T02:28:33.917 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow *", 2024-08-17T02:28:33.917 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2024-08-17T02:28:33.917 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2024-08-17T02:28:33.917 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-08-17T02:28:33.917 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:33.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-17T02:28:33.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:33.917 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-mds", 2024-08-17T02:28:33.917 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQCMCsBmQL7IKhAAAkAri/LluTjl0rE1IXGzEQ==", 2024-08-17T02:28:33.918 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-08-17T02:28:33.918 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-mds" 2024-08-17T02:28:33.918 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:33.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-17T02:28:33.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:33.918 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-mgr", 2024-08-17T02:28:33.918 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQCMCsBmxM7IKhAA2ZfO09A/0HHiER/42gkVYg==", 2024-08-17T02:28:33.918 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-08-17T02:28:33.918 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-mgr" 2024-08-17T02:28:33.918 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:33.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-17T02:28:33.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:33.919 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-osd", 2024-08-17T02:28:33.919 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQCMCsBmduDIKhAAas7Q0V2TVSBS7nRedOreDw==", 2024-08-17T02:28:33.919 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-08-17T02:28:33.919 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-osd" 2024-08-17T02:28:33.919 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:33.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-17T02:28:33.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:33.919 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-rbd", 2024-08-17T02:28:33.919 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQCMCsBmK/DIKhAAPrDvNuBpwlR2nxo+2uIMYQ==", 2024-08-17T02:28:33.919 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-08-17T02:28:33.919 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-rbd" 2024-08-17T02:28:33.919 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:33.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-17T02:28:33.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:33.920 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-08-17T02:28:33.920 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQCMCsBmVP/IKhAA0EkA9FJhJGjg8bhJhroPVA==", 2024-08-17T02:28:33.920 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-08-17T02:28:33.920 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-08-17T02:28:33.921 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:33.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-17T02:28:33.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:33.921 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-rgw", 2024-08-17T02:28:33.921 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQCMCsBmtQ7JKhAAHFuIysfxF75qWhVnooc/nQ==", 2024-08-17T02:28:33.921 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-08-17T02:28:33.921 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-rgw" 2024-08-17T02:28:33.921 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:33.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-17T02:28:33.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:33.921 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mgr.x", 2024-08-17T02:28:33.921 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBkCsBmrRbjChAA42nAQuNtOni4NbyVJ/h+rw==", 2024-08-17T02:28:33.921 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-08-17T02:28:33.921 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow *", 2024-08-17T02:28:33.921 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile mgr", 2024-08-17T02:28:33.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-08-17T02:28:33.922 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:33.922 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-17T02:28:33.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:33.922 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mgr.y", 2024-08-17T02:28:33.922 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQBkCsBmNHSqAxAA1jOfB2dHKJrNPHKIkkSYHw==", 2024-08-17T02:28:33.922 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2024-08-17T02:28:33.922 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow *", 2024-08-17T02:28:33.922 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile mgr", 2024-08-17T02:28:33.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2024-08-17T02:28:33.922 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:33.922 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:33.923 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-08-17T02:28:33.923 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-08-17T02:28:33.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.906+0000 7fa612800640 1 -- 172.21.15.106:0/1315778245 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa5e8065150 msgr2=0x7fa5e8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.906+0000 7fa612800640 1 --2- 172.21.15.106:0/1315778245 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa5e8065150 0x7fa5e8067600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc033000 tx=0x7fa5fc034000 comp rx=0 tx=0).stop 2024-08-17T02:28:33.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.906+0000 7fa612800640 1 -- 172.21.15.106:0/1315778245 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa60c1664c0 msgr2=0x7fa60c0a6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.906+0000 7fa612800640 1 --2- 172.21.15.106:0/1315778245 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa60c1664c0 0x7fa60c0a6460 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa60c06f500 tx=0x7fa604007f90 comp rx=0 tx=0).stop 2024-08-17T02:28:33.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.906+0000 7fa612800640 1 -- 172.21.15.106:0/1315778245 shutdown_connections 2024-08-17T02:28:33.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.906+0000 7fa612800640 1 --2- 172.21.15.106:0/1315778245 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa5e8065150 0x7fa5e8067600 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.906+0000 7fa612800640 1 --2- 172.21.15.106:0/1315778245 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa60c1664c0 0x7fa60c0a6460 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.906+0000 7fa612800640 1 --2- 172.21.15.106:0/1315778245 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa60c0aa810 0x7fa60c165f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.906+0000 7fa612800640 1 --2- 172.21.15.106:0/1315778245 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5f0003b90 0x7fa60c0aa2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.906+0000 7fa612800640 1 -- 172.21.15.106:0/1315778245 >> 172.21.15.106:0/1315778245 conn(0x7fa60c0cb9b0 msgr2=0x7fa60c0ae0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:33.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.906+0000 7fa612800640 1 -- 172.21.15.106:0/1315778245 shutdown_connections 2024-08-17T02:28:33.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:33.906+0000 7fa612800640 1 -- 172.21.15.106:0/1315778245 wait complete. 2024-08-17T02:28:33.926 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-08-17T02:28:34.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.075+0000 7f3208a00640 1 Processor -- start 2024-08-17T02:28:34.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.075+0000 7f3208a00640 1 -- start start 2024-08-17T02:28:34.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.076+0000 7f3208a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f32040ccca0 0x7f3204163870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.076+0000 7f3208a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32040cadc0 con 0x7f3204159ca0 2024-08-17T02:28:34.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.076+0000 7f3208a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32040cb060 con 0x7f32040ceb40 2024-08-17T02:28:34.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.076+0000 7f3208a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32040cd6e0 con 0x7f32040ccca0 2024-08-17T02:28:34.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.076+0000 7f3203200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f32040ccca0 0x7f3204163870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.076+0000 7f3202800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f3204159ca0 0x7f32040ca360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:60522/0 (socket says 172.21.15.106:60522) 2024-08-17T02:28:34.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.076+0000 7f3202800640 1 -- 172.21.15.106:0/1139884516 learned_addr learned my addr 172.21.15.106:0/1139884516 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:34.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.077+0000 7f3203200640 1 -- 172.21.15.106:0/1139884516 >> v1:172.21.15.171:6789/0 conn(0x7f32040ceb40 legacy=0x7f32040cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:34.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.077+0000 7f3203200640 1 -- 172.21.15.106:0/1139884516 >> v1:172.21.15.106:6789/0 conn(0x7f3204159ca0 legacy=0x7f32040ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.077+0000 7f3203200640 1 -- 172.21.15.106:0/1139884516 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32040cb300 con 0x7f32040ccca0 2024-08-17T02:28:34.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.077+0000 7f3201e00640 1 -- 172.21.15.106:0/1139884516 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747161663 0 0) 0x7f32040cadc0 con 0x7f3204159ca0 2024-08-17T02:28:34.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.078+0000 7f3203200640 1 --2- 172.21.15.106:0/1139884516 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32040ccca0 0x7f3204163870 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009e60 tx=0x7f31fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e1012682a4c483 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:34.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.078+0000 7f3201e00640 1 -- 172.21.15.106:0/1139884516 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc007550 con 0x7f32040ccca0 2024-08-17T02:28:34.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.078+0000 7f3201e00640 1 -- 172.21.15.106:0/1139884516 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc02d050 con 0x7f32040ccca0 2024-08-17T02:28:34.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.078+0000 7f3201e00640 1 -- 172.21.15.106:0/1139884516 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc0078e0 con 0x7f32040ccca0 2024-08-17T02:28:34.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.078+0000 7f3208a00640 1 -- 172.21.15.106:0/1139884516 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32040ccca0 msgr2=0x7f3204163870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.078+0000 7f3208a00640 1 --2- 172.21.15.106:0/1139884516 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32040ccca0 0x7f3204163870 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009e60 tx=0x7f31fc009780 comp rx=0 tx=0).stop 2024-08-17T02:28:34.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.079+0000 7f3208a00640 1 -- 172.21.15.106:0/1139884516 shutdown_connections 2024-08-17T02:28:34.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.079+0000 7f3208a00640 1 --2- 172.21.15.106:0/1139884516 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32040ccca0 0x7f3204163870 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.079+0000 7f3208a00640 1 -- 172.21.15.106:0/1139884516 >> 172.21.15.106:0/1139884516 conn(0x7f3204098e00 msgr2=0x7f320406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:34.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.079+0000 7f3208a00640 1 -- 172.21.15.106:0/1139884516 shutdown_connections 2024-08-17T02:28:34.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.079+0000 7f3208a00640 1 -- 172.21.15.106:0/1139884516 wait complete. 2024-08-17T02:28:34.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.080+0000 7f3208a00640 1 Processor -- start 2024-08-17T02:28:34.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.080+0000 7f3208a00640 1 -- start start 2024-08-17T02:28:34.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.081+0000 7f3208a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32040ccca0 0x7f320416ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.081+0000 7f3208a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32040ceb40 0x7f32040c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.081+0000 7f3208a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3204159ca0 0x7f32041584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.081+0000 7f3208a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32040c55f0 con 0x7f32040ceb40 2024-08-17T02:28:34.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.081+0000 7f3208a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32040c4970 con 0x7f32040ccca0 2024-08-17T02:28:34.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.081+0000 7f3208a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32040c4c50 con 0x7f3204159ca0 2024-08-17T02:28:34.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.081+0000 7f31f9e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32040ceb40 0x7f32040c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.081+0000 7f31f9e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32040ceb40 0x7f32040c3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:51494/0 (socket says 172.21.15.106:51494) 2024-08-17T02:28:34.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.081+0000 7f31f9e00640 1 -- 172.21.15.106:0/2527291060 learned_addr learned my addr 172.21.15.106:0/2527291060 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:34.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.082+0000 7f31f9e00640 1 -- 172.21.15.106:0/2527291060 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3204159ca0 msgr2=0x7f32041584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.082+0000 7f3203200640 1 --2- 172.21.15.106:0/2527291060 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3204159ca0 0x7f32041584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.082+0000 7f3202800640 1 --2- 172.21.15.106:0/2527291060 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32040ccca0 0x7f320416ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.082+0000 7f31f9e00640 1 --2- 172.21.15.106:0/2527291060 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3204159ca0 0x7f32041584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.082+0000 7f31f9e00640 1 -- 172.21.15.106:0/2527291060 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32040ccca0 msgr2=0x7f320416ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.082+0000 7f31f9e00640 1 --2- 172.21.15.106:0/2527291060 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32040ccca0 0x7f320416ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.082+0000 7f31f9e00640 1 -- 172.21.15.106:0/2527291060 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31fc009a20 con 0x7f32040ceb40 2024-08-17T02:28:34.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.082+0000 7f3202800640 1 --2- 172.21.15.106:0/2527291060 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32040ccca0 0x7f320416ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:34.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.082+0000 7f3203200640 1 --2- 172.21.15.106:0/2527291060 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3204159ca0 0x7f32041584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:34.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.082+0000 7f31f9e00640 1 --2- 172.21.15.106:0/2527291060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32040ceb40 0x7f32040c3fc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f31ec00c5e0 tx=0x7f31ec007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:34.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.082+0000 7f31faa00640 1 -- 172.21.15.106:0/2527291060 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec012630 con 0x7f32040ceb40 2024-08-17T02:28:34.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.082+0000 7f31faa00640 1 -- 172.21.15.106:0/2527291060 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ec0127b0 con 0x7f32040ceb40 2024-08-17T02:28:34.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.082+0000 7f3208a00640 1 -- 172.21.15.106:0/2527291060 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32040c4f30 con 0x7f32040ceb40 2024-08-17T02:28:34.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.082+0000 7f31faa00640 1 -- 172.21.15.106:0/2527291060 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec012bb0 con 0x7f32040ceb40 2024-08-17T02:28:34.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.082+0000 7f3208a00640 1 -- 172.21.15.106:0/2527291060 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f320416bfa0 con 0x7f32040ceb40 2024-08-17T02:28:34.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.083+0000 7f3208a00640 1 -- 172.21.15.106:0/2527291060 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32040c5730 con 0x7f32040ceb40 2024-08-17T02:28:34.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.084+0000 7f31faa00640 1 -- 172.21.15.106:0/2527291060 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f31ec01a3b0 con 0x7f32040ceb40 2024-08-17T02:28:34.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.085+0000 7f31faa00640 1 --2- 172.21.15.106:0/2527291060 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f31e0065150 0x7f31e0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.085+0000 7f31faa00640 1 -- 172.21.15.106:0/2527291060 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f31ec081ca0 con 0x7f32040ceb40 2024-08-17T02:28:34.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.085+0000 7f3202800640 1 --2- 172.21.15.106:0/2527291060 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f31e0065150 0x7f31e0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.086+0000 7f3202800640 1 --2- 172.21.15.106:0/2527291060 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f31e0065150 0x7f31e0067600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3204089ab0 tx=0x7f31f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:34.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.089+0000 7f31faa00640 1 -- 172.21.15.106:0/2527291060 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f31ec0500b0 con 0x7f32040ceb40 2024-08-17T02:28:34.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.324+0000 7f3208a00640 1 -- 172.21.15.106:0/2527291060 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f32040c53b0 con 0x7f32040ceb40 2024-08-17T02:28:34.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.328+0000 7f31faa00640 1 -- 172.21.15.106:0/2527291060 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f31ec0160a0 con 0x7f32040ceb40 2024-08-17T02:28:34.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.330+0000 7f3208a00640 1 -- 172.21.15.106:0/2527291060 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f31e0065150 msgr2=0x7f31e0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.330+0000 7f3208a00640 1 --2- 172.21.15.106:0/2527291060 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f31e0065150 0x7f31e0067600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3204089ab0 tx=0x7f31f4009040 comp rx=0 tx=0).stop 2024-08-17T02:28:34.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.330+0000 7f3208a00640 1 -- 172.21.15.106:0/2527291060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32040ceb40 msgr2=0x7f32040c3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.330+0000 7f3208a00640 1 --2- 172.21.15.106:0/2527291060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32040ceb40 0x7f32040c3fc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f31ec00c5e0 tx=0x7f31ec007ed0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.331+0000 7f3208a00640 1 -- 172.21.15.106:0/2527291060 shutdown_connections 2024-08-17T02:28:34.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.331+0000 7f3208a00640 1 --2- 172.21.15.106:0/2527291060 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3204159ca0 0x7f32041584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.331+0000 7f3208a00640 1 --2- 172.21.15.106:0/2527291060 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f31e0065150 0x7f31e0067600 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.331+0000 7f3208a00640 1 --2- 172.21.15.106:0/2527291060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32040ceb40 0x7f32040c3fc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.331+0000 7f3208a00640 1 --2- 172.21.15.106:0/2527291060 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32040ccca0 0x7f320416ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.331+0000 7f3208a00640 1 -- 172.21.15.106:0/2527291060 >> 172.21.15.106:0/2527291060 conn(0x7f3204098e00 msgr2=0x7f320406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:34.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.331+0000 7f3208a00640 1 -- 172.21.15.106:0/2527291060 shutdown_connections 2024-08-17T02:28:34.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.331+0000 7f3208a00640 1 -- 172.21.15.106:0/2527291060 wait complete. 2024-08-17T02:28:34.347 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-08-17T02:28:34.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.500+0000 7efe09e00640 1 Processor -- start 2024-08-17T02:28:34.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.500+0000 7efe09e00640 1 -- start start 2024-08-17T02:28:34.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.501+0000 7efe09e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe04158f80 0x7efe040ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.501+0000 7efe09e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7efe04159350 0x7efe040ca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.501+0000 7efe09e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe040cb560 con 0x7efe040cf280 2024-08-17T02:28:34.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.501+0000 7efe09e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe040cf7e0 con 0x7efe04159350 2024-08-17T02:28:34.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.501+0000 7efe09e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe040cfac0 con 0x7efe04158f80 2024-08-17T02:28:34.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.502+0000 7efdfa000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7efe04159350 0x7efe040ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.502+0000 7efe02a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe04158f80 0x7efe040ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.502+0000 7efdfa000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7efe04159350 0x7efe040ca870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:50528/0 (socket says 172.21.15.106:50528) 2024-08-17T02:28:34.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.502+0000 7efdfa000640 1 -- 172.21.15.106:0/547496579 learned_addr learned my addr 172.21.15.106:0/547496579 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:34.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.502+0000 7efe02a00640 1 -- 172.21.15.106:0/547496579 >> v2:172.21.15.171:3300/0 conn(0x7efe04159350 msgr2=0x7efe040ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:34.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.502+0000 7efe02a00640 1 --2- 172.21.15.106:0/547496579 >> v2:172.21.15.171:3300/0 conn(0x7efe04159350 0x7efe040ca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.502+0000 7efe02a00640 1 -- 172.21.15.106:0/547496579 >> v1:172.21.15.171:6789/0 conn(0x7efe040cf280 legacy=0x7efe040cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.502+0000 7efe02a00640 1 -- 172.21.15.106:0/547496579 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe040caf10 con 0x7efe04158f80 2024-08-17T02:28:34.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.502+0000 7efdfa000640 1 --2- 172.21.15.106:0/547496579 >> v2:172.21.15.171:3300/0 conn(0x7efe04159350 0x7efe040ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:34.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.503+0000 7efe02a00640 1 --2- 172.21.15.106:0/547496579 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe04158f80 0x7efe040ca330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efdf4009850 tx=0x7efdf40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ad445e181204d82 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:34.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.503+0000 7efe02000640 1 -- 172.21.15.106:0/547496579 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf402ad80 con 0x7efe04158f80 2024-08-17T02:28:34.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.504+0000 7efe02000640 1 -- 172.21.15.106:0/547496579 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf4032440 con 0x7efe04158f80 2024-08-17T02:28:34.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.504+0000 7efe02000640 1 -- 172.21.15.106:0/547496579 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf4032820 con 0x7efe04158f80 2024-08-17T02:28:34.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.504+0000 7efe09e00640 1 -- 172.21.15.106:0/547496579 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe04158f80 msgr2=0x7efe040ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.504+0000 7efe09e00640 1 --2- 172.21.15.106:0/547496579 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe04158f80 0x7efe040ca330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efdf4009850 tx=0x7efdf40090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.504+0000 7efe09e00640 1 -- 172.21.15.106:0/547496579 shutdown_connections 2024-08-17T02:28:34.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.504+0000 7efe09e00640 1 --2- 172.21.15.106:0/547496579 >> v2:172.21.15.171:3300/0 conn(0x7efe04159350 0x7efe040ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.504+0000 7efe09e00640 1 --2- 172.21.15.106:0/547496579 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe04158f80 0x7efe040ca330 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.504+0000 7efe09e00640 1 -- 172.21.15.106:0/547496579 >> 172.21.15.106:0/547496579 conn(0x7efe040cfd90 msgr2=0x7efe040d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:34.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.505+0000 7efe09e00640 1 -- 172.21.15.106:0/547496579 shutdown_connections 2024-08-17T02:28:34.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.505+0000 7efe09e00640 1 -- 172.21.15.106:0/547496579 wait complete. 2024-08-17T02:28:34.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.506+0000 7efe09e00640 1 Processor -- start 2024-08-17T02:28:34.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.506+0000 7efe09e00640 1 -- start start 2024-08-17T02:28:34.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.507+0000 7efe09e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe040cf280 0x7efe040b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.507+0000 7efe09e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe04158f80 0x7efe040b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.507+0000 7efe09e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe04159350 0x7efe0416c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.507+0000 7efe09e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe040b56f0 con 0x7efe04158f80 2024-08-17T02:28:34.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.507+0000 7efe09e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe040b4110 con 0x7efe040cf280 2024-08-17T02:28:34.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.507+0000 7efe09e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe040b43f0 con 0x7efe04159350 2024-08-17T02:28:34.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.507+0000 7efdfa000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe04158f80 0x7efe040b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.507+0000 7efdfa000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe04158f80 0x7efe040b51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:51500/0 (socket says 172.21.15.106:51500) 2024-08-17T02:28:34.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.507+0000 7efdfa000640 1 -- 172.21.15.106:0/1921858073 learned_addr learned my addr 172.21.15.106:0/1921858073 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:34.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.507+0000 7efe02a00640 1 --2- 172.21.15.106:0/1921858073 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe040cf280 0x7efe040b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.507+0000 7efe03400640 1 --2- 172.21.15.106:0/1921858073 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe04159350 0x7efe0416c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.508+0000 7efdfa000640 1 -- 172.21.15.106:0/1921858073 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe04159350 msgr2=0x7efe0416c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.508+0000 7efdfa000640 1 --2- 172.21.15.106:0/1921858073 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe04159350 0x7efe0416c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.508+0000 7efdfa000640 1 -- 172.21.15.106:0/1921858073 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe040cf280 msgr2=0x7efe040b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.508+0000 7efdfa000640 1 --2- 172.21.15.106:0/1921858073 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe040cf280 0x7efe040b3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.508+0000 7efdfa000640 1 -- 172.21.15.106:0/1921858073 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdec009450 con 0x7efe04158f80 2024-08-17T02:28:34.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.508+0000 7efdfa000640 1 --2- 172.21.15.106:0/1921858073 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe04158f80 0x7efe040b51b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7efdec00ec50 tx=0x7efdec0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:34.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.508+0000 7efdfaa00640 1 -- 172.21.15.106:0/1921858073 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec00ee90 con 0x7efe04158f80 2024-08-17T02:28:34.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.508+0000 7efdfaa00640 1 -- 172.21.15.106:0/1921858073 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdec00cbc0 con 0x7efe04158f80 2024-08-17T02:28:34.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.508+0000 7efdfaa00640 1 -- 172.21.15.106:0/1921858073 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec013470 con 0x7efe04158f80 2024-08-17T02:28:34.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.508+0000 7efe09e00640 1 -- 172.21.15.106:0/1921858073 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf4009390 con 0x7efe04158f80 2024-08-17T02:28:34.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.508+0000 7efe09e00640 1 -- 172.21.15.106:0/1921858073 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe040b49b0 con 0x7efe04158f80 2024-08-17T02:28:34.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.509+0000 7efe09e00640 1 -- 172.21.15.106:0/1921858073 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe04064db0 con 0x7efe04158f80 2024-08-17T02:28:34.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.510+0000 7efdfaa00640 1 -- 172.21.15.106:0/1921858073 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efdec013820 con 0x7efe04158f80 2024-08-17T02:28:34.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.511+0000 7efdfaa00640 1 --2- 172.21.15.106:0/1921858073 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7efde0065150 0x7efde0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.511+0000 7efdfaa00640 1 -- 172.21.15.106:0/1921858073 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7efdec0823c0 con 0x7efe04158f80 2024-08-17T02:28:34.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.511+0000 7efe02a00640 1 --2- 172.21.15.106:0/1921858073 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7efde0065150 0x7efde0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.512+0000 7efe02a00640 1 --2- 172.21.15.106:0/1921858073 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7efde0065150 0x7efde0067600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efdf4034000 tx=0x7efdf4032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:34.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.515+0000 7efdfaa00640 1 -- 172.21.15.106:0/1921858073 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efdec050880 con 0x7efe04158f80 2024-08-17T02:28:34.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.749+0000 7efe09e00640 1 -- 172.21.15.106:0/1921858073 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7efe04156cf0 con 0x7efe04158f80 2024-08-17T02:28:34.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.753+0000 7efdfaa00640 1 -- 172.21.15.106:0/1921858073 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7efdec053ea0 con 0x7efe04158f80 2024-08-17T02:28:34.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.756+0000 7efe09e00640 1 -- 172.21.15.106:0/1921858073 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7efde0065150 msgr2=0x7efde0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.756+0000 7efe09e00640 1 --2- 172.21.15.106:0/1921858073 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7efde0065150 0x7efde0067600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efdf4034000 tx=0x7efdf4032000 comp rx=0 tx=0).stop 2024-08-17T02:28:34.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.756+0000 7efe09e00640 1 -- 172.21.15.106:0/1921858073 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe04158f80 msgr2=0x7efe040b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.756+0000 7efe09e00640 1 --2- 172.21.15.106:0/1921858073 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe04158f80 0x7efe040b51b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7efdec00ec50 tx=0x7efdec0091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.756+0000 7efe09e00640 1 -- 172.21.15.106:0/1921858073 shutdown_connections 2024-08-17T02:28:34.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.756+0000 7efe09e00640 1 --2- 172.21.15.106:0/1921858073 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efe04159350 0x7efe0416c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.756+0000 7efe09e00640 1 --2- 172.21.15.106:0/1921858073 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7efde0065150 0x7efde0067600 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.756+0000 7efe09e00640 1 --2- 172.21.15.106:0/1921858073 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe04158f80 0x7efe040b51b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.756+0000 7efe09e00640 1 --2- 172.21.15.106:0/1921858073 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efe040cf280 0x7efe040b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.756+0000 7efe09e00640 1 -- 172.21.15.106:0/1921858073 >> 172.21.15.106:0/1921858073 conn(0x7efe040cfd90 msgr2=0x7efe040ca330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:34.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.756+0000 7efe09e00640 1 -- 172.21.15.106:0/1921858073 shutdown_connections 2024-08-17T02:28:34.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.756+0000 7efe09e00640 1 -- 172.21.15.106:0/1921858073 wait complete. 2024-08-17T02:28:34.771 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-08-17T02:28:34.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.919+0000 7feeca400640 1 Processor -- start 2024-08-17T02:28:34.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.920+0000 7feeca400640 1 -- start start 2024-08-17T02:28:34.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.921+0000 7feeca400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feec40ab2b0 0x7feec40afe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.921+0000 7feeca400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feec40b03d0 0x7feec415c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.921+0000 7feeca400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec40ab950 con 0x7feec40cc010 2024-08-17T02:28:34.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.921+0000 7feeca400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec40ab730 con 0x7feec40ab2b0 2024-08-17T02:28:34.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.921+0000 7feeca400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec40abc30 con 0x7feec40b03d0 2024-08-17T02:28:34.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.921+0000 7feebbe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feec40ab2b0 0x7feec40afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.921+0000 7feebbe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feec40ab2b0 0x7feec40afe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:51510/0 (socket says 172.21.15.106:51510) 2024-08-17T02:28:34.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.921+0000 7feebbe00640 1 -- 172.21.15.106:0/944945164 learned_addr learned my addr 172.21.15.106:0/944945164 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:34.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.921+0000 7feec9a00640 1 --2- 172.21.15.106:0/944945164 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feec40b03d0 0x7feec415c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.921+0000 7feebbe00640 1 -- 172.21.15.106:0/944945164 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feec40b03d0 msgr2=0x7feec415c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:34.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.922+0000 7feebbe00640 1 --2- 172.21.15.106:0/944945164 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feec40b03d0 0x7feec415c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.922+0000 7feebbe00640 1 -- 172.21.15.106:0/944945164 >> v1:172.21.15.171:6789/0 conn(0x7feec40cc010 legacy=0x7feec40a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.922+0000 7feebbe00640 1 -- 172.21.15.106:0/944945164 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec40abf10 con 0x7feec40ab2b0 2024-08-17T02:28:34.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.922+0000 7feebbe00640 1 --2- 172.21.15.106:0/944945164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feec40ab2b0 0x7feec40afe90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7feeac009910 tx=0x7feeac0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d09376afc071b8c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:34.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.923+0000 7feec3e00640 1 -- 172.21.15.106:0/944945164 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac02add0 con 0x7feec40ab2b0 2024-08-17T02:28:34.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.923+0000 7feec3e00640 1 -- 172.21.15.106:0/944945164 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeac032440 con 0x7feec40ab2b0 2024-08-17T02:28:34.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.923+0000 7feec3e00640 1 -- 172.21.15.106:0/944945164 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac032820 con 0x7feec40ab2b0 2024-08-17T02:28:34.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.923+0000 7feeca400640 1 -- 172.21.15.106:0/944945164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feec40ab2b0 msgr2=0x7feec40afe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.923+0000 7feeca400640 1 --2- 172.21.15.106:0/944945164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feec40ab2b0 0x7feec40afe90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7feeac009910 tx=0x7feeac0091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.923+0000 7feeca400640 1 -- 172.21.15.106:0/944945164 shutdown_connections 2024-08-17T02:28:34.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.923+0000 7feeca400640 1 --2- 172.21.15.106:0/944945164 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feec40b03d0 0x7feec415c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.923+0000 7feeca400640 1 --2- 172.21.15.106:0/944945164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feec40ab2b0 0x7feec40afe90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.923+0000 7feeca400640 1 -- 172.21.15.106:0/944945164 >> 172.21.15.106:0/944945164 conn(0x7feec4067de0 msgr2=0x7feec40681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:34.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.923+0000 7feeca400640 1 -- 172.21.15.106:0/944945164 shutdown_connections 2024-08-17T02:28:34.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.924+0000 7feeca400640 1 -- 172.21.15.106:0/944945164 wait complete. 2024-08-17T02:28:34.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.925+0000 7feeca400640 1 Processor -- start 2024-08-17T02:28:34.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.925+0000 7feeca400640 1 -- start start 2024-08-17T02:28:34.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.926+0000 7feeca400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feec40ab2b0 0x7feec41556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.926+0000 7feeca400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feec40b03d0 0x7feec4169e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.926+0000 7feeca400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feec40cc010 0x7feec40ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.926+0000 7feeca400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec4155c20 con 0x7feec40b03d0 2024-08-17T02:28:34.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.926+0000 7feeca400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec416a3b0 con 0x7feec40cc010 2024-08-17T02:28:34.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.926+0000 7feeca400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec40c4410 con 0x7feec40ab2b0 2024-08-17T02:28:34.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.926+0000 7feebbe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feec40b03d0 0x7feec4169e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.926+0000 7feebbe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feec40b03d0 0x7feec4169e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:51512/0 (socket says 172.21.15.106:51512) 2024-08-17T02:28:34.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.926+0000 7feebbe00640 1 -- 172.21.15.106:0/2840759887 learned_addr learned my addr 172.21.15.106:0/2840759887 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:34.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.926+0000 7feebbe00640 1 -- 172.21.15.106:0/2840759887 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feec40ab2b0 msgr2=0x7feec41556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.926+0000 7feebbe00640 1 --2- 172.21.15.106:0/2840759887 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feec40ab2b0 0x7feec41556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.926+0000 7feebbe00640 1 -- 172.21.15.106:0/2840759887 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feec40cc010 msgr2=0x7feec40ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.926+0000 7feebbe00640 1 --2- 172.21.15.106:0/2840759887 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feec40cc010 0x7feec40ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.926+0000 7feebbe00640 1 -- 172.21.15.106:0/2840759887 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeac009450 con 0x7feec40b03d0 2024-08-17T02:28:34.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.927+0000 7feebbe00640 1 --2- 172.21.15.106:0/2840759887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feec40b03d0 0x7feec4169e70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7feeac035040 tx=0x7feeac032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:34.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.927+0000 7feec0c00640 1 -- 172.21.15.106:0/2840759887 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac031bb0 con 0x7feec40b03d0 2024-08-17T02:28:34.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.927+0000 7feec0c00640 1 -- 172.21.15.106:0/2840759887 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeac031d70 con 0x7feec40b03d0 2024-08-17T02:28:34.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.927+0000 7feec0c00640 1 -- 172.21.15.106:0/2840759887 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac03d670 con 0x7feec40b03d0 2024-08-17T02:28:34.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.927+0000 7feeca400640 1 -- 172.21.15.106:0/2840759887 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec40c46f0 con 0x7feec40b03d0 2024-08-17T02:28:34.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.927+0000 7feeca400640 1 -- 172.21.15.106:0/2840759887 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec40c4cb0 con 0x7feec40b03d0 2024-08-17T02:28:34.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.928+0000 7feeca400640 1 -- 172.21.15.106:0/2840759887 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec4071050 con 0x7feec40b03d0 2024-08-17T02:28:34.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.929+0000 7feec0c00640 1 -- 172.21.15.106:0/2840759887 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7feeac039040 con 0x7feec40b03d0 2024-08-17T02:28:34.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.930+0000 7feec0c00640 1 --2- 172.21.15.106:0/2840759887 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7feea0065150 0x7feea0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.930+0000 7feec0c00640 1 -- 172.21.15.106:0/2840759887 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7feeac0a1fe0 con 0x7feec40b03d0 2024-08-17T02:28:34.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.930+0000 7feec9000640 1 --2- 172.21.15.106:0/2840759887 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7feea0065150 0x7feea0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.931+0000 7feec9000640 1 --2- 172.21.15.106:0/2840759887 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7feea0065150 0x7feea0067600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7feec416a5c0 tx=0x7feeb4007ab0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:34.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:34.934+0000 7feec0c00640 1 -- 172.21.15.106:0/2840759887 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7feeac070390 con 0x7feec40b03d0 2024-08-17T02:28:35.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.166+0000 7feeca400640 1 -- 172.21.15.106:0/2840759887 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7feec40b1620 con 0x7feec40b03d0 2024-08-17T02:28:35.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.170+0000 7feec0c00640 1 -- 172.21.15.106:0/2840759887 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7feeac0420a0 con 0x7feec40b03d0 2024-08-17T02:28:35.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.172+0000 7feeca400640 1 -- 172.21.15.106:0/2840759887 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7feea0065150 msgr2=0x7feea0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:35.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.172+0000 7feeca400640 1 --2- 172.21.15.106:0/2840759887 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7feea0065150 0x7feea0067600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7feec416a5c0 tx=0x7feeb4007ab0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.172+0000 7feeca400640 1 -- 172.21.15.106:0/2840759887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feec40b03d0 msgr2=0x7feec4169e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:35.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.172+0000 7feeca400640 1 --2- 172.21.15.106:0/2840759887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feec40b03d0 0x7feec4169e70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7feeac035040 tx=0x7feeac032000 comp rx=0 tx=0).stop 2024-08-17T02:28:35.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.172+0000 7feeca400640 1 -- 172.21.15.106:0/2840759887 shutdown_connections 2024-08-17T02:28:35.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.172+0000 7feeca400640 1 --2- 172.21.15.106:0/2840759887 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feec40cc010 0x7feec40ae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.172+0000 7feeca400640 1 --2- 172.21.15.106:0/2840759887 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7feea0065150 0x7feea0067600 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.172+0000 7feeca400640 1 --2- 172.21.15.106:0/2840759887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feec40b03d0 0x7feec4169e70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.172+0000 7feeca400640 1 --2- 172.21.15.106:0/2840759887 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feec40ab2b0 0x7feec41556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.172+0000 7feeca400640 1 -- 172.21.15.106:0/2840759887 >> 172.21.15.106:0/2840759887 conn(0x7feec4067de0 msgr2=0x7feec406d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:35.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.172+0000 7feeca400640 1 -- 172.21.15.106:0/2840759887 shutdown_connections 2024-08-17T02:28:35.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.172+0000 7feeca400640 1 -- 172.21.15.106:0/2840759887 wait complete. 2024-08-17T02:28:35.187 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-08-17T02:28:35.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.336+0000 7f6b7d000640 1 Processor -- start 2024-08-17T02:28:35.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.336+0000 7f6b7d000640 1 -- start start 2024-08-17T02:28:35.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.337+0000 7f6b7d000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6b78140580 0x7f6b780c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:35.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.338+0000 7f6b7d000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b780caa80 con 0x7f6b780b1440 2024-08-17T02:28:35.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.338+0000 7f6b7d000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b780c9e70 con 0x7f6b781401b0 2024-08-17T02:28:35.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.338+0000 7f6b7d000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b780c9c90 con 0x7f6b78140580 2024-08-17T02:28:35.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.338+0000 7f6b76800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6b78140580 0x7f6b780c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:35.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.338+0000 7f6b6d400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6b780b1440 0x7f6b780c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:60528/0 (socket says 172.21.15.106:60528) 2024-08-17T02:28:35.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.338+0000 7f6b6d400640 1 -- 172.21.15.106:0/292806395 learned_addr learned my addr 172.21.15.106:0/292806395 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:35.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.338+0000 7f6b76800640 1 -- 172.21.15.106:0/292806395 >> v1:172.21.15.171:6789/0 conn(0x7f6b781401b0 legacy=0x7f6b780b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:35.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.338+0000 7f6b76800640 1 -- 172.21.15.106:0/292806395 >> v1:172.21.15.106:6789/0 conn(0x7f6b780b1440 legacy=0x7f6b780c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:35.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.338+0000 7f6b76800640 1 -- 172.21.15.106:0/292806395 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b780ca150 con 0x7f6b78140580 2024-08-17T02:28:35.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.339+0000 7f6b76800640 1 --2- 172.21.15.106:0/292806395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b78140580 0x7f6b780c9750 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6b70009e60 tx=0x7f6b70009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771ef9114869b5fe server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:35.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.339+0000 7f6b75400640 1 -- 172.21.15.106:0/292806395 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b70007550 con 0x7f6b78140580 2024-08-17T02:28:35.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.339+0000 7f6b75400640 1 -- 172.21.15.106:0/292806395 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7002d050 con 0x7f6b78140580 2024-08-17T02:28:35.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.340+0000 7f6b75400640 1 -- 172.21.15.106:0/292806395 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b70007920 con 0x7f6b78140580 2024-08-17T02:28:35.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.340+0000 7f6b7d000640 1 -- 172.21.15.106:0/292806395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b78140580 msgr2=0x7f6b780c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:35.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.340+0000 7f6b7d000640 1 --2- 172.21.15.106:0/292806395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b78140580 0x7f6b780c9750 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6b70009e60 tx=0x7f6b70009780 comp rx=0 tx=0).stop 2024-08-17T02:28:35.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.340+0000 7f6b7d000640 1 -- 172.21.15.106:0/292806395 shutdown_connections 2024-08-17T02:28:35.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.340+0000 7f6b7d000640 1 --2- 172.21.15.106:0/292806395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b78140580 0x7f6b780c9750 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.340+0000 7f6b7d000640 1 -- 172.21.15.106:0/292806395 >> 172.21.15.106:0/292806395 conn(0x7f6b780cb9b0 msgr2=0x7f6b780cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:35.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.340+0000 7f6b7d000640 1 -- 172.21.15.106:0/292806395 shutdown_connections 2024-08-17T02:28:35.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.340+0000 7f6b7d000640 1 -- 172.21.15.106:0/292806395 wait complete. 2024-08-17T02:28:35.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.341+0000 7f6b7d000640 1 Processor -- start 2024-08-17T02:28:35.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.342+0000 7f6b7d000640 1 -- start start 2024-08-17T02:28:35.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.342+0000 7f6b7d000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b780b1440 0x7f6b7813da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:35.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.342+0000 7f6b7d000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b781401b0 0x7f6b7813a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:35.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.342+0000 7f6b7d000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b78140580 0x7f6b78153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:35.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.342+0000 7f6b7d000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b780c65c0 con 0x7f6b780b1440 2024-08-17T02:28:35.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.342+0000 7f6b7d000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7813e060 con 0x7f6b781401b0 2024-08-17T02:28:35.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.342+0000 7f6b7d000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b780c5c90 con 0x7f6b78140580 2024-08-17T02:28:35.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.343+0000 7f6b75e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b780b1440 0x7f6b7813da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:35.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.343+0000 7f6b75e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b780b1440 0x7f6b7813da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:51532/0 (socket says 172.21.15.106:51532) 2024-08-17T02:28:35.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.343+0000 7f6b75e00640 1 -- 172.21.15.106:0/1935117348 learned_addr learned my addr 172.21.15.106:0/1935117348 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:35.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.343+0000 7f6b6d400640 1 --2- 172.21.15.106:0/1935117348 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b781401b0 0x7f6b7813a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:35.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.343+0000 7f6b76800640 1 --2- 172.21.15.106:0/1935117348 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b78140580 0x7f6b78153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:35.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.343+0000 7f6b75e00640 1 -- 172.21.15.106:0/1935117348 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b78140580 msgr2=0x7f6b78153720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:35.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.343+0000 7f6b75e00640 1 --2- 172.21.15.106:0/1935117348 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b78140580 0x7f6b78153720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.343+0000 7f6b75e00640 1 -- 172.21.15.106:0/1935117348 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b781401b0 msgr2=0x7f6b7813a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:35.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.343+0000 7f6b75e00640 1 --2- 172.21.15.106:0/1935117348 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b781401b0 0x7f6b7813a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.343+0000 7f6b75e00640 1 -- 172.21.15.106:0/1935117348 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b70009a20 con 0x7f6b780b1440 2024-08-17T02:28:35.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.343+0000 7f6b76800640 1 --2- 172.21.15.106:0/1935117348 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b78140580 0x7f6b78153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:35.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.343+0000 7f6b75e00640 1 --2- 172.21.15.106:0/1935117348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b780b1440 0x7f6b7813da80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800c5e0 tx=0x7f6b68007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:35.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.344+0000 7f6b6e000640 1 -- 172.21.15.106:0/1935117348 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68012630 con 0x7f6b780b1440 2024-08-17T02:28:35.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.344+0000 7f6b6e000640 1 -- 172.21.15.106:0/1935117348 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b680127b0 con 0x7f6b780b1440 2024-08-17T02:28:35.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.344+0000 7f6b7d000640 1 -- 172.21.15.106:0/1935117348 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b780c5f70 con 0x7f6b780b1440 2024-08-17T02:28:35.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.344+0000 7f6b6e000640 1 -- 172.21.15.106:0/1935117348 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68012bb0 con 0x7f6b780b1440 2024-08-17T02:28:35.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.344+0000 7f6b7d000640 1 -- 172.21.15.106:0/1935117348 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b7813aa50 con 0x7f6b780b1440 2024-08-17T02:28:35.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.345+0000 7f6b7d000640 1 -- 172.21.15.106:0/1935117348 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b780c63f0 con 0x7f6b780b1440 2024-08-17T02:28:35.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.345+0000 7f6b6e000640 1 -- 172.21.15.106:0/1935117348 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6b6801b400 con 0x7f6b780b1440 2024-08-17T02:28:35.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.346+0000 7f6b6e000640 1 --2- 172.21.15.106:0/1935117348 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6b54065150 0x7f6b54067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:35.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.346+0000 7f6b6e000640 1 -- 172.21.15.106:0/1935117348 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6b68082370 con 0x7f6b780b1440 2024-08-17T02:28:35.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.346+0000 7f6b6d400640 1 --2- 172.21.15.106:0/1935117348 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6b54065150 0x7f6b54067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:35.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.347+0000 7f6b6d400640 1 --2- 172.21.15.106:0/1935117348 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6b54065150 0x7f6b54067600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6b780c8320 tx=0x7f6b60007e20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:35.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.350+0000 7f6b6e000640 1 -- 172.21.15.106:0/1935117348 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6b680507a0 con 0x7f6b780b1440 2024-08-17T02:28:35.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.585+0000 7f6b7d000640 1 -- 172.21.15.106:0/1935117348 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f6b78064db0 con 0x7f6b780b1440 2024-08-17T02:28:35.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.589+0000 7f6b6e000640 1 -- 172.21.15.106:0/1935117348 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6b680160a0 con 0x7f6b780b1440 2024-08-17T02:28:35.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.592+0000 7f6b7d000640 1 -- 172.21.15.106:0/1935117348 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6b54065150 msgr2=0x7f6b54067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:35.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.592+0000 7f6b7d000640 1 --2- 172.21.15.106:0/1935117348 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6b54065150 0x7f6b54067600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6b780c8320 tx=0x7f6b60007e20 comp rx=0 tx=0).stop 2024-08-17T02:28:35.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.592+0000 7f6b7d000640 1 -- 172.21.15.106:0/1935117348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b780b1440 msgr2=0x7f6b7813da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:35.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.592+0000 7f6b7d000640 1 --2- 172.21.15.106:0/1935117348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b780b1440 0x7f6b7813da80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800c5e0 tx=0x7f6b68007ed0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.592+0000 7f6b7d000640 1 -- 172.21.15.106:0/1935117348 shutdown_connections 2024-08-17T02:28:35.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.592+0000 7f6b7d000640 1 --2- 172.21.15.106:0/1935117348 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6b78140580 0x7f6b78153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.592+0000 7f6b7d000640 1 --2- 172.21.15.106:0/1935117348 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b781401b0 0x7f6b7813a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.592+0000 7f6b7d000640 1 --2- 172.21.15.106:0/1935117348 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6b54065150 0x7f6b54067600 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.592+0000 7f6b7d000640 1 --2- 172.21.15.106:0/1935117348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b780b1440 0x7f6b7813da80 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.592+0000 7f6b7d000640 1 -- 172.21.15.106:0/1935117348 >> 172.21.15.106:0/1935117348 conn(0x7f6b780cb9b0 msgr2=0x7f6b7813f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:35.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.592+0000 7f6b7d000640 1 -- 172.21.15.106:0/1935117348 shutdown_connections 2024-08-17T02:28:35.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.592+0000 7f6b7d000640 1 -- 172.21.15.106:0/1935117348 wait complete. 2024-08-17T02:28:35.608 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-08-17T02:28:35.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.755+0000 7f792be00640 1 Processor -- start 2024-08-17T02:28:35.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.756+0000 7f792be00640 1 -- start start 2024-08-17T02:28:35.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.757+0000 7f792be00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f792c155900 0x7f792c155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:35.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.757+0000 7f792be00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f792c0b0270 0x7f792c156210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:35.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.757+0000 7f792be00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f792c157b20 0x7f792c157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:35.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.757+0000 7f792be00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792c157690 con 0x7f792c155900 2024-08-17T02:28:35.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.757+0000 7f792be00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792c156a80 con 0x7f792c157b20 2024-08-17T02:28:35.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.757+0000 7f792be00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792c156d60 con 0x7f792c0b0270 2024-08-17T02:28:35.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.757+0000 7f792aa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f792c155900 0x7f792c155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:35.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.757+0000 7f792aa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f792c155900 0x7f792c155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:51548/0 (socket says 172.21.15.106:51548) 2024-08-17T02:28:35.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.757+0000 7f792aa00640 1 -- 172.21.15.106:0/2492802990 learned_addr learned my addr 172.21.15.106:0/2492802990 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:35.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.757+0000 7f792b400640 1 --2- 172.21.15.106:0/2492802990 >> v2:172.21.15.171:3300/0 conn(0x7f792c157b20 0x7f792c157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:35.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.757+0000 7f7922000640 1 --2- 172.21.15.106:0/2492802990 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f792c0b0270 0x7f792c156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:35.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.757+0000 7f792aa00640 1 -- 172.21.15.106:0/2492802990 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f792c0b0270 msgr2=0x7f792c156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:35.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.757+0000 7f792aa00640 1 --2- 172.21.15.106:0/2492802990 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f792c0b0270 0x7f792c156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.757+0000 7f792aa00640 1 -- 172.21.15.106:0/2492802990 >> v2:172.21.15.171:3300/0 conn(0x7f792c157b20 msgr2=0x7f792c157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:35.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.757+0000 7f792aa00640 1 --2- 172.21.15.106:0/2492802990 >> v2:172.21.15.171:3300/0 conn(0x7f792c157b20 0x7f792c157fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.758+0000 7f792aa00640 1 -- 172.21.15.106:0/2492802990 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792c157040 con 0x7f792c155900 2024-08-17T02:28:35.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.758+0000 7f792aa00640 1 --2- 172.21.15.106:0/2492802990 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f792c155900 0x7f792c155cd0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f792c0cc860 tx=0x7f791c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d24a81eeea137fa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:35.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.759+0000 7f792a000640 1 -- 172.21.15.106:0/2492802990 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c02ad40 con 0x7f792c155900 2024-08-17T02:28:35.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.759+0000 7f792a000640 1 -- 172.21.15.106:0/2492802990 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791c032440 con 0x7f792c155900 2024-08-17T02:28:35.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.759+0000 7f792a000640 1 -- 172.21.15.106:0/2492802990 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c02aea0 con 0x7f792c155900 2024-08-17T02:28:35.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.759+0000 7f792be00640 1 -- 172.21.15.106:0/2492802990 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f792c155900 msgr2=0x7f792c155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:35.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.759+0000 7f792be00640 1 --2- 172.21.15.106:0/2492802990 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f792c155900 0x7f792c155cd0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f792c0cc860 tx=0x7f791c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.759+0000 7f792be00640 1 -- 172.21.15.106:0/2492802990 shutdown_connections 2024-08-17T02:28:35.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.759+0000 7f792be00640 1 --2- 172.21.15.106:0/2492802990 >> v2:172.21.15.171:3300/0 conn(0x7f792c157b20 0x7f792c157fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.759+0000 7f792be00640 1 --2- 172.21.15.106:0/2492802990 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f792c0b0270 0x7f792c156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.759+0000 7f792be00640 1 --2- 172.21.15.106:0/2492802990 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f792c155900 0x7f792c155cd0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.759+0000 7f792be00640 1 -- 172.21.15.106:0/2492802990 >> 172.21.15.106:0/2492802990 conn(0x7f792c067750 msgr2=0x7f792c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:35.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.760+0000 7f792be00640 1 -- 172.21.15.106:0/2492802990 shutdown_connections 2024-08-17T02:28:35.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.760+0000 7f792be00640 1 -- 172.21.15.106:0/2492802990 wait complete. 2024-08-17T02:28:35.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.761+0000 7f792be00640 1 Processor -- start 2024-08-17T02:28:35.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.761+0000 7f792be00640 1 -- start start 2024-08-17T02:28:35.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.762+0000 7f792be00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f792c0b0270 0x7f792c146950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:35.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.762+0000 7f792be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f792c155900 0x7f792c143e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:35.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.762+0000 7f792be00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f792c157b20 0x7f792c0c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:35.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.762+0000 7f792be00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c144340 con 0x7f792c155900 2024-08-17T02:28:35.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.762+0000 7f792be00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792c0c49b0 con 0x7f792c157b20 2024-08-17T02:28:35.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.762+0000 7f792be00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792c144560 con 0x7f792c0b0270 2024-08-17T02:28:35.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.762+0000 7f7922000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f792c155900 0x7f792c143e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:35.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.762+0000 7f7922000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f792c155900 0x7f792c143e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:51556/0 (socket says 172.21.15.106:51556) 2024-08-17T02:28:35.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.762+0000 7f7922000640 1 -- 172.21.15.106:0/1919979796 learned_addr learned my addr 172.21.15.106:0/1919979796 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:35.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.762+0000 7f792aa00640 1 --2- 172.21.15.106:0/1919979796 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f792c0b0270 0x7f792c146950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:35.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.762+0000 7f792b400640 1 --2- 172.21.15.106:0/1919979796 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f792c157b20 0x7f792c0c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:35.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.763+0000 7f7922000640 1 -- 172.21.15.106:0/1919979796 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f792c0b0270 msgr2=0x7f792c146950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:35.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.763+0000 7f7922000640 1 --2- 172.21.15.106:0/1919979796 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f792c0b0270 0x7f792c146950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.763+0000 7f7922000640 1 -- 172.21.15.106:0/1919979796 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f792c157b20 msgr2=0x7f792c0c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:35.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.763+0000 7f7922000640 1 --2- 172.21.15.106:0/1919979796 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f792c157b20 0x7f792c0c4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.763+0000 7f7922000640 1 -- 172.21.15.106:0/1919979796 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791c009450 con 0x7f792c155900 2024-08-17T02:28:35.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.763+0000 7f792b400640 1 --2- 172.21.15.106:0/1919979796 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f792c157b20 0x7f792c0c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:35.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.763+0000 7f7922000640 1 --2- 172.21.15.106:0/1919979796 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f792c155900 0x7f792c143e00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f791400d890 tx=0x7f7914008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:35.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.763+0000 7f7922a00640 1 -- 172.21.15.106:0/1919979796 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791400de20 con 0x7f792c155900 2024-08-17T02:28:35.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.763+0000 7f7922a00640 1 -- 172.21.15.106:0/1919979796 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791400b8d0 con 0x7f792c155900 2024-08-17T02:28:35.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.763+0000 7f792be00640 1 -- 172.21.15.106:0/1919979796 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f792c144840 con 0x7f792c155900 2024-08-17T02:28:35.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.763+0000 7f7922a00640 1 -- 172.21.15.106:0/1919979796 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791400bc70 con 0x7f792c155900 2024-08-17T02:28:35.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.763+0000 7f792be00640 1 -- 172.21.15.106:0/1919979796 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f792c144e00 con 0x7f792c155900 2024-08-17T02:28:35.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.765+0000 7f792be00640 1 -- 172.21.15.106:0/1919979796 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f792c063840 con 0x7f792c155900 2024-08-17T02:28:35.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.765+0000 7f7922a00640 1 -- 172.21.15.106:0/1919979796 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7914014640 con 0x7f792c155900 2024-08-17T02:28:35.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.766+0000 7f7922a00640 1 --2- 172.21.15.106:0/1919979796 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7908065150 0x7f7908067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:35.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.767+0000 7f7922a00640 1 -- 172.21.15.106:0/1919979796 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7914082650 con 0x7f792c155900 2024-08-17T02:28:35.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.767+0000 7f792aa00640 1 --2- 172.21.15.106:0/1919979796 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7908065150 0x7f7908067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:35.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.767+0000 7f792aa00640 1 --2- 172.21.15.106:0/1919979796 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7908065150 0x7f7908067600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f791c034000 tx=0x7f791c032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:35.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:35.771+0000 7f7922a00640 1 -- 172.21.15.106:0/1919979796 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7914050b20 con 0x7f792c155900 2024-08-17T02:28:36.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.002+0000 7f792be00640 1 -- 172.21.15.106:0/1919979796 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f792c071050 con 0x7f792c155900 2024-08-17T02:28:36.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.006+0000 7f7922a00640 1 -- 172.21.15.106:0/1919979796 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7914054140 con 0x7f792c155900 2024-08-17T02:28:36.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.008+0000 7f792be00640 1 -- 172.21.15.106:0/1919979796 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7908065150 msgr2=0x7f7908067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.009+0000 7f792be00640 1 --2- 172.21.15.106:0/1919979796 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7908065150 0x7f7908067600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f791c034000 tx=0x7f791c032000 comp rx=0 tx=0).stop 2024-08-17T02:28:36.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.009+0000 7f792be00640 1 -- 172.21.15.106:0/1919979796 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f792c155900 msgr2=0x7f792c143e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.009+0000 7f792be00640 1 --2- 172.21.15.106:0/1919979796 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f792c155900 0x7f792c143e00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f791400d890 tx=0x7f7914008040 comp rx=0 tx=0).stop 2024-08-17T02:28:36.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.009+0000 7f792be00640 1 -- 172.21.15.106:0/1919979796 shutdown_connections 2024-08-17T02:28:36.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.009+0000 7f792be00640 1 --2- 172.21.15.106:0/1919979796 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f792c157b20 0x7f792c0c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.009+0000 7f792be00640 1 --2- 172.21.15.106:0/1919979796 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7908065150 0x7f7908067600 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.009+0000 7f792be00640 1 --2- 172.21.15.106:0/1919979796 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f792c155900 0x7f792c143e00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.009+0000 7f792be00640 1 --2- 172.21.15.106:0/1919979796 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f792c0b0270 0x7f792c146950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.009+0000 7f792be00640 1 -- 172.21.15.106:0/1919979796 >> 172.21.15.106:0/1919979796 conn(0x7f792c067750 msgr2=0x7f792c06d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:36.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.009+0000 7f792be00640 1 -- 172.21.15.106:0/1919979796 shutdown_connections 2024-08-17T02:28:36.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.009+0000 7f792be00640 1 -- 172.21.15.106:0/1919979796 wait complete. 2024-08-17T02:28:36.024 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-08-17T02:28:36.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.172+0000 7f634fc00640 1 Processor -- start 2024-08-17T02:28:36.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.172+0000 7f634fc00640 1 -- start start 2024-08-17T02:28:36.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.173+0000 7f634fc00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f634815d830 0x7f634806e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.173+0000 7f634fc00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f63480b0610 0x7f634815dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.173+0000 7f634fc00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f634815e140 0x7f634815e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.173+0000 7f634fc00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63480b1b20 con 0x7f63480b0610 2024-08-17T02:28:36.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.173+0000 7f634fc00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63480b1690 con 0x7f634815e140 2024-08-17T02:28:36.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.173+0000 7f634fc00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63480ae4a0 con 0x7f634815d830 2024-08-17T02:28:36.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.174+0000 7f633fe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f63480b0610 0x7f634815dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.174+0000 7f633fe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f63480b0610 0x7f634815dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:51566/0 (socket says 172.21.15.106:51566) 2024-08-17T02:28:36.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.174+0000 7f633fe00640 1 -- 172.21.15.106:0/791563714 learned_addr learned my addr 172.21.15.106:0/791563714 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:36.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.174+0000 7f634d200640 1 --2- 172.21.15.106:0/791563714 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f634815d830 0x7f634806e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.174+0000 7f634dc00640 1 --2- 172.21.15.106:0/791563714 >> v2:172.21.15.171:3300/0 conn(0x7f634815e140 0x7f634815e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.174+0000 7f633fe00640 1 -- 172.21.15.106:0/791563714 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f634815d830 msgr2=0x7f634806e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:36.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.174+0000 7f633fe00640 1 --2- 172.21.15.106:0/791563714 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f634815d830 0x7f634806e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.174+0000 7f633fe00640 1 -- 172.21.15.106:0/791563714 >> v2:172.21.15.171:3300/0 conn(0x7f634815e140 msgr2=0x7f634815e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:36.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.174+0000 7f633fe00640 1 --2- 172.21.15.106:0/791563714 >> v2:172.21.15.171:3300/0 conn(0x7f634815e140 0x7f634815e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.174+0000 7f633fe00640 1 -- 172.21.15.106:0/791563714 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634815b200 con 0x7f63480b0610 2024-08-17T02:28:36.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.175+0000 7f633fe00640 1 --2- 172.21.15.106:0/791563714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63480b0610 0x7f634815dc00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f634806c290 tx=0x7f63300091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a069f64e97d2bbb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:36.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.176+0000 7f6347e00640 1 -- 172.21.15.106:0/791563714 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633002add0 con 0x7f63480b0610 2024-08-17T02:28:36.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.176+0000 7f6347e00640 1 -- 172.21.15.106:0/791563714 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6330032440 con 0x7f63480b0610 2024-08-17T02:28:36.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.176+0000 7f6347e00640 1 -- 172.21.15.106:0/791563714 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6330032820 con 0x7f63480b0610 2024-08-17T02:28:36.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.176+0000 7f634fc00640 1 -- 172.21.15.106:0/791563714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63480b0610 msgr2=0x7f634815dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.176+0000 7f634fc00640 1 --2- 172.21.15.106:0/791563714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63480b0610 0x7f634815dc00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f634806c290 tx=0x7f63300091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.176+0000 7f634fc00640 1 -- 172.21.15.106:0/791563714 shutdown_connections 2024-08-17T02:28:36.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.176+0000 7f634fc00640 1 --2- 172.21.15.106:0/791563714 >> v2:172.21.15.171:3300/0 conn(0x7f634815e140 0x7f634815e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.176+0000 7f634fc00640 1 --2- 172.21.15.106:0/791563714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63480b0610 0x7f634815dc00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.176+0000 7f634fc00640 1 --2- 172.21.15.106:0/791563714 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f634815d830 0x7f634806e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.176+0000 7f634fc00640 1 -- 172.21.15.106:0/791563714 >> 172.21.15.106:0/791563714 conn(0x7f63480cb9b0 msgr2=0x7f63480cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:36.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.176+0000 7f634fc00640 1 -- 172.21.15.106:0/791563714 shutdown_connections 2024-08-17T02:28:36.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.176+0000 7f634fc00640 1 -- 172.21.15.106:0/791563714 wait complete. 2024-08-17T02:28:36.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.178+0000 7f634fc00640 1 Processor -- start 2024-08-17T02:28:36.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.178+0000 7f634fc00640 1 -- start start 2024-08-17T02:28:36.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.179+0000 7f634fc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63480b0610 0x7f6348160f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.179+0000 7f634fc00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f634815d830 0x7f63481629a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.179+0000 7f634fc00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f634815e140 0x7f6348149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.179+0000 7f634fc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63481575d0 con 0x7f63480b0610 2024-08-17T02:28:36.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.179+0000 7f634fc00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6348160ad0 con 0x7f634815e140 2024-08-17T02:28:36.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.179+0000 7f634fc00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634815fec0 con 0x7f634815d830 2024-08-17T02:28:36.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.179+0000 7f634d200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63480b0610 0x7f6348160f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.179+0000 7f634d200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63480b0610 0x7f6348160f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:51582/0 (socket says 172.21.15.106:51582) 2024-08-17T02:28:36.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.179+0000 7f634d200640 1 -- 172.21.15.106:0/3433426744 learned_addr learned my addr 172.21.15.106:0/3433426744 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:36.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.179+0000 7f633fe00640 1 --2- 172.21.15.106:0/3433426744 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f634815d830 0x7f63481629a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.179+0000 7f634d200640 1 -- 172.21.15.106:0/3433426744 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f634815d830 msgr2=0x7f63481629a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.179+0000 7f634d200640 1 --2- 172.21.15.106:0/3433426744 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f634815d830 0x7f63481629a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.179+0000 7f634d200640 1 -- 172.21.15.106:0/3433426744 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f634815e140 msgr2=0x7f6348149ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.179+0000 7f634dc00640 1 --2- 172.21.15.106:0/3433426744 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f634815e140 0x7f6348149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.179+0000 7f634d200640 1 --2- 172.21.15.106:0/3433426744 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f634815e140 0x7f6348149ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.179+0000 7f634d200640 1 -- 172.21.15.106:0/3433426744 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6330009450 con 0x7f63480b0610 2024-08-17T02:28:36.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.179+0000 7f633fe00640 1 --2- 172.21.15.106:0/3433426744 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f634815d830 0x7f63481629a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:36.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.180+0000 7f634d200640 1 --2- 172.21.15.106:0/3433426744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63480b0610 0x7f6348160f60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f633800ea20 tx=0x7f63380090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:36.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.180+0000 7f6344c00640 1 -- 172.21.15.106:0/3433426744 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633800ca10 con 0x7f63480b0610 2024-08-17T02:28:36.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.180+0000 7f6344c00640 1 -- 172.21.15.106:0/3433426744 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633800cb70 con 0x7f63480b0610 2024-08-17T02:28:36.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.180+0000 7f634fc00640 1 -- 172.21.15.106:0/3433426744 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63481601a0 con 0x7f63480b0610 2024-08-17T02:28:36.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.180+0000 7f6344c00640 1 -- 172.21.15.106:0/3433426744 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6338013470 con 0x7f63480b0610 2024-08-17T02:28:36.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.180+0000 7f634fc00640 1 -- 172.21.15.106:0/3433426744 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6348160760 con 0x7f63480b0610 2024-08-17T02:28:36.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.181+0000 7f634fc00640 1 -- 172.21.15.106:0/3433426744 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6348064db0 con 0x7f63480b0610 2024-08-17T02:28:36.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.182+0000 7f6344c00640 1 -- 172.21.15.106:0/3433426744 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6338013820 con 0x7f63480b0610 2024-08-17T02:28:36.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.183+0000 7f6344c00640 1 --2- 172.21.15.106:0/3433426744 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6324065150 0x7f6324067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.183+0000 7f6344c00640 1 -- 172.21.15.106:0/3433426744 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6338082480 con 0x7f63480b0610 2024-08-17T02:28:36.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.183+0000 7f633fe00640 1 --2- 172.21.15.106:0/3433426744 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6324065150 0x7f6324067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.183+0000 7f633fe00640 1 --2- 172.21.15.106:0/3433426744 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6324065150 0x7f6324067600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6330034000 tx=0x7f6330032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:36.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.186+0000 7f6344c00640 1 -- 172.21.15.106:0/3433426744 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f63380507f0 con 0x7f63480b0610 2024-08-17T02:28:36.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.423+0000 7f634fc00640 1 -- 172.21.15.106:0/3433426744 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f63480ae280 con 0x7f63480b0610 2024-08-17T02:28:36.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.427+0000 7f6344c00640 1 -- 172.21.15.106:0/3433426744 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6338053e10 con 0x7f63480b0610 2024-08-17T02:28:36.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.430+0000 7f634fc00640 1 -- 172.21.15.106:0/3433426744 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6324065150 msgr2=0x7f6324067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.430+0000 7f634fc00640 1 --2- 172.21.15.106:0/3433426744 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6324065150 0x7f6324067600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6330034000 tx=0x7f6330032000 comp rx=0 tx=0).stop 2024-08-17T02:28:36.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.430+0000 7f634fc00640 1 -- 172.21.15.106:0/3433426744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63480b0610 msgr2=0x7f6348160f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.430+0000 7f634fc00640 1 --2- 172.21.15.106:0/3433426744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63480b0610 0x7f6348160f60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f633800ea20 tx=0x7f63380090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.430+0000 7f634fc00640 1 -- 172.21.15.106:0/3433426744 shutdown_connections 2024-08-17T02:28:36.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.430+0000 7f634fc00640 1 --2- 172.21.15.106:0/3433426744 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f634815e140 0x7f6348149ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.430+0000 7f634fc00640 1 --2- 172.21.15.106:0/3433426744 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f634815d830 0x7f63481629a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.430+0000 7f634fc00640 1 --2- 172.21.15.106:0/3433426744 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6324065150 0x7f6324067600 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.430+0000 7f634fc00640 1 --2- 172.21.15.106:0/3433426744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f63480b0610 0x7f6348160f60 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.430+0000 7f634fc00640 1 -- 172.21.15.106:0/3433426744 >> 172.21.15.106:0/3433426744 conn(0x7f63480cb9b0 msgr2=0x7f634815a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:36.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.430+0000 7f634fc00640 1 -- 172.21.15.106:0/3433426744 shutdown_connections 2024-08-17T02:28:36.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.430+0000 7f634fc00640 1 -- 172.21.15.106:0/3433426744 wait complete. 2024-08-17T02:28:36.445 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:36.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.594+0000 7f5385e00640 1 Processor -- start 2024-08-17T02:28:36.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.594+0000 7f5385e00640 1 -- start start 2024-08-17T02:28:36.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.595+0000 7f5385e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53800ca350 0x7f53800cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.595+0000 7f5385e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f53800ae1b0 0x7f53800cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.595+0000 7f5385e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53800cb730 con 0x7f53800ca720 2024-08-17T02:28:36.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.595+0000 7f5385e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53800cf9c0 con 0x7f53800ae1b0 2024-08-17T02:28:36.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.595+0000 7f5385e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53800cb0e0 con 0x7f53800ca350 2024-08-17T02:28:36.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.595+0000 7f5377e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f53800ca720 0x7f53800cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:60538/0 (socket says 172.21.15.106:60538) 2024-08-17T02:28:36.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.595+0000 7f5377e00640 1 -- 172.21.15.106:0/2739291618 learned_addr learned my addr 172.21.15.106:0/2739291618 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:36.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.596+0000 7f5384a00640 1 --2- 172.21.15.106:0/2739291618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53800ca350 0x7f53800cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.596+0000 7f5385400640 1 --2- 172.21.15.106:0/2739291618 >> v2:172.21.15.171:3300/0 conn(0x7f53800ae1b0 0x7f53800cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.596+0000 7f537fe00640 1 -- 172.21.15.106:0/2739291618 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2266410235 0 0) 0x7f53800cb730 con 0x7f53800ca720 2024-08-17T02:28:36.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.596+0000 7f537fe00640 1 -- 172.21.15.106:0/2739291618 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53640034e0 con 0x7f53800ca720 2024-08-17T02:28:36.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.596+0000 7f537fe00640 1 -- 172.21.15.106:0/2739291618 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3096830578 0 0) 0x7f53640034e0 con 0x7f53800ca720 2024-08-17T02:28:36.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.596+0000 7f537fe00640 1 -- 172.21.15.106:0/2739291618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53800ca350 msgr2=0x7f53800cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:36.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.596+0000 7f537fe00640 1 --2- 172.21.15.106:0/2739291618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53800ca350 0x7f53800cf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.596+0000 7f537fe00640 1 -- 172.21.15.106:0/2739291618 >> v2:172.21.15.171:3300/0 conn(0x7f53800ae1b0 msgr2=0x7f53800cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:36.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.596+0000 7f537fe00640 1 --2- 172.21.15.106:0/2739291618 >> v2:172.21.15.171:3300/0 conn(0x7f53800ae1b0 0x7f53800cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.596+0000 7f537fe00640 1 -- 172.21.15.106:0/2739291618 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53800cb3c0 con 0x7f53800ca720 2024-08-17T02:28:36.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.596+0000 7f537fe00640 1 -- 172.21.15.106:0/2739291618 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7f5368001470 con 0x7f53800ca720 2024-08-17T02:28:36.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.596+0000 7f537fe00640 1 -- 172.21.15.106:0/2739291618 >> v1:172.21.15.106:6789/0 conn(0x7f53800ca720 legacy=0x7f53800cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.596+0000 7f537fe00640 1 --2- 172.21.15.106:0/2739291618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53800ca350 0x7f53640039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.596+0000 7f537fe00640 1 --2- 172.21.15.106:0/2739291618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5364003f50 0x7f5364004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.596+0000 7f537fe00640 1 --2- 172.21.15.106:0/2739291618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5364004cc0 0x7f5364005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.596+0000 7f537fe00640 1 -- 172.21.15.106:0/2739291618 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53800cf9c0 con 0x7f5364004cc0 2024-08-17T02:28:36.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.596+0000 7f537fe00640 1 -- 172.21.15.106:0/2739291618 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53800cb0e0 con 0x7f5364003f50 2024-08-17T02:28:36.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.596+0000 7f537fe00640 1 -- 172.21.15.106:0/2739291618 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536400ba00 con 0x7f53800ca350 2024-08-17T02:28:36.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.596+0000 7f5385400640 1 --2- 172.21.15.106:0/2739291618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5364004cc0 0x7f5364005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.597+0000 7f5377e00640 1 --2- 172.21.15.106:0/2739291618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5364003f50 0x7f5364004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.597+0000 7f5384a00640 1 --2- 172.21.15.106:0/2739291618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53800ca350 0x7f53640039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.597+0000 7f5385400640 1 -- 172.21.15.106:0/2739291618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53800ca350 msgr2=0x7f53640039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:36.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.597+0000 7f5385400640 1 --2- 172.21.15.106:0/2739291618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53800ca350 0x7f53640039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.597+0000 7f5385400640 1 -- 172.21.15.106:0/2739291618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5364003f50 msgr2=0x7f5364004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:36.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.597+0000 7f5385400640 1 --2- 172.21.15.106:0/2739291618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5364003f50 0x7f5364004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.597+0000 7f5385400640 1 -- 172.21.15.106:0/2739291618 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53640034e0 con 0x7f5364004cc0 2024-08-17T02:28:36.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.597+0000 7f5384a00640 1 --2- 172.21.15.106:0/2739291618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53800ca350 0x7f53640039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:36.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.597+0000 7f5377e00640 1 --2- 172.21.15.106:0/2739291618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5364003f50 0x7f5364004780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:36.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.598+0000 7f5385400640 1 --2- 172.21.15.106:0/2739291618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5364004cc0 0x7f5364005130 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f537800e210 tx=0x7f537800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499b214928e14c33 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:36.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.598+0000 7f537fe00640 1 -- 172.21.15.106:0/2739291618 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53780303f0 con 0x7f5364004cc0 2024-08-17T02:28:36.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.598+0000 7f537fe00640 1 -- 172.21.15.106:0/2739291618 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537800f040 con 0x7f5364004cc0 2024-08-17T02:28:36.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.598+0000 7f537fe00640 1 -- 172.21.15.106:0/2739291618 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5378030780 con 0x7f5364004cc0 2024-08-17T02:28:36.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.599+0000 7f5385e00640 1 -- 172.21.15.106:0/2739291618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5364004cc0 msgr2=0x7f5364005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.599+0000 7f5385e00640 1 --2- 172.21.15.106:0/2739291618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5364004cc0 0x7f5364005130 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f537800e210 tx=0x7f537800b040 comp rx=0 tx=0).stop 2024-08-17T02:28:36.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.599+0000 7f5385400640 1 -- 172.21.15.106:0/2739291618 reap_dead start 2024-08-17T02:28:36.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.599+0000 7f5385e00640 1 -- 172.21.15.106:0/2739291618 shutdown_connections 2024-08-17T02:28:36.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.599+0000 7f5385e00640 1 -- 172.21.15.106:0/2739291618 >> 172.21.15.106:0/2739291618 conn(0x7f53800cfdb0 msgr2=0x7f53800d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:36.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.599+0000 7f5385e00640 1 -- 172.21.15.106:0/2739291618 shutdown_connections 2024-08-17T02:28:36.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.599+0000 7f5385e00640 1 -- 172.21.15.106:0/2739291618 wait complete. 2024-08-17T02:28:36.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.600+0000 7f5385e00640 1 Processor -- start 2024-08-17T02:28:36.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.600+0000 7f5385e00640 1 -- start start 2024-08-17T02:28:36.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.601+0000 7f5385e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5364004cc0 0x7f53800b1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.601+0000 7f5385e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5380169dc0 0x7f53800c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.601+0000 7f5385e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f538016b9e0 0x7f53800c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.601+0000 7f5385e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53800af230 con 0x7f538016b9e0 2024-08-17T02:28:36.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.601+0000 7f5385e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53800afad0 con 0x7f5380169dc0 2024-08-17T02:28:36.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.601+0000 7f5385e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53800c8000 con 0x7f5364004cc0 2024-08-17T02:28:36.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.601+0000 7f5385400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f538016b9e0 0x7f53800c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.601+0000 7f5385400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f538016b9e0 0x7f53800c84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:51594/0 (socket says 172.21.15.106:51594) 2024-08-17T02:28:36.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.601+0000 7f5385400640 1 -- 172.21.15.106:0/2204540949 learned_addr learned my addr 172.21.15.106:0/2204540949 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:36.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.602+0000 7f5384a00640 1 --2- 172.21.15.106:0/2204540949 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5364004cc0 0x7f53800b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.602+0000 7f5377e00640 1 --2- 172.21.15.106:0/2204540949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5380169dc0 0x7f53800c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.602+0000 7f5385400640 1 -- 172.21.15.106:0/2204540949 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5364004cc0 msgr2=0x7f53800b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.602+0000 7f5385400640 1 --2- 172.21.15.106:0/2204540949 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5364004cc0 0x7f53800b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.602+0000 7f5385400640 1 -- 172.21.15.106:0/2204540949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5380169dc0 msgr2=0x7f53800c77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.602+0000 7f5385400640 1 --2- 172.21.15.106:0/2204540949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5380169dc0 0x7f53800c77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.602+0000 7f5385400640 1 -- 172.21.15.106:0/2204540949 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53800af480 con 0x7f538016b9e0 2024-08-17T02:28:36.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.602+0000 7f5385400640 1 --2- 172.21.15.106:0/2204540949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f538016b9e0 0x7f53800c84c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f537800e210 tx=0x7f5378036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:36.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.602+0000 7f537cc00640 1 -- 172.21.15.106:0/2204540949 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537803f070 con 0x7f538016b9e0 2024-08-17T02:28:36.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.602+0000 7f537cc00640 1 -- 172.21.15.106:0/2204540949 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5378039630 con 0x7f538016b9e0 2024-08-17T02:28:36.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.602+0000 7f537cc00640 1 -- 172.21.15.106:0/2204540949 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53780399f0 con 0x7f538016b9e0 2024-08-17T02:28:36.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.602+0000 7f5385e00640 1 -- 172.21.15.106:0/2204540949 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53800af760 con 0x7f538016b9e0 2024-08-17T02:28:36.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.603+0000 7f5385e00640 1 -- 172.21.15.106:0/2204540949 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f538016a230 con 0x7f538016b9e0 2024-08-17T02:28:36.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.604+0000 7f5385e00640 1 -- 172.21.15.106:0/2204540949 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53800afc60 con 0x7f538016b9e0 2024-08-17T02:28:36.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.604+0000 7f537cc00640 1 -- 172.21.15.106:0/2204540949 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5378003030 con 0x7f538016b9e0 2024-08-17T02:28:36.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.605+0000 7f537cc00640 1 --2- 172.21.15.106:0/2204540949 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f535c065150 0x7f535c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.605+0000 7f537cc00640 1 -- 172.21.15.106:0/2204540949 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f537802d070 con 0x7f538016b9e0 2024-08-17T02:28:36.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.605+0000 7f5384a00640 1 --2- 172.21.15.106:0/2204540949 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f535c065150 0x7f535c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.606+0000 7f5384a00640 1 --2- 172.21.15.106:0/2204540949 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f535c065150 0x7f535c067600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5370009e50 tx=0x7f5370008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:36.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.609+0000 7f537cc00640 1 -- 172.21.15.106:0/2204540949 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5378070620 con 0x7f538016b9e0 2024-08-17T02:28:36.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.782+0000 7f5385e00640 1 -- 172.21.15.106:0/2204540949 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5380071050 con 0x7f538016b9e0 2024-08-17T02:28:36.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.783+0000 7f537cc00640 1 -- 172.21.15.106:0/2204540949 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12182 (secure 0 0 0) 0x7f5378034020 con 0x7f538016b9e0 2024-08-17T02:28:36.783 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:36.784 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":28,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:28:33.486318+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:36.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.785+0000 7f5385e00640 1 -- 172.21.15.106:0/2204540949 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f535c065150 msgr2=0x7f535c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.785+0000 7f5385e00640 1 --2- 172.21.15.106:0/2204540949 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f535c065150 0x7f535c067600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5370009e50 tx=0x7f5370008040 comp rx=0 tx=0).stop 2024-08-17T02:28:36.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.785+0000 7f5385e00640 1 -- 172.21.15.106:0/2204540949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f538016b9e0 msgr2=0x7f53800c84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.785+0000 7f5385e00640 1 --2- 172.21.15.106:0/2204540949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f538016b9e0 0x7f53800c84c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f537800e210 tx=0x7f5378036000 comp rx=0 tx=0).stop 2024-08-17T02:28:36.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.785+0000 7f5385e00640 1 -- 172.21.15.106:0/2204540949 shutdown_connections 2024-08-17T02:28:36.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.785+0000 7f5385e00640 1 --2- 172.21.15.106:0/2204540949 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f535c065150 0x7f535c067600 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.785+0000 7f5385e00640 1 --2- 172.21.15.106:0/2204540949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f538016b9e0 0x7f53800c84c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.785+0000 7f5385e00640 1 --2- 172.21.15.106:0/2204540949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5380169dc0 0x7f53800c77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.785+0000 7f5385e00640 1 --2- 172.21.15.106:0/2204540949 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5364004cc0 0x7f53800b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.785+0000 7f5385e00640 1 -- 172.21.15.106:0/2204540949 >> 172.21.15.106:0/2204540949 conn(0x7f53800cfdb0 msgr2=0x7f53800ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:36.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.785+0000 7f5385e00640 1 -- 172.21.15.106:0/2204540949 shutdown_connections 2024-08-17T02:28:36.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.785+0000 7f5385e00640 1 -- 172.21.15.106:0/2204540949 wait complete. 2024-08-17T02:28:36.801 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:37.928826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:28:36.801 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:28:36.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.951+0000 7fb965000640 1 Processor -- start 2024-08-17T02:28:36.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.951+0000 7fb965000640 1 -- start start 2024-08-17T02:28:36.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.952+0000 7fb965000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb960158f60 0x7fb9600ac820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.952+0000 7fb965000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb9600cc5f0 0x7fb9600acd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.952+0000 7fb965000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9600ac390 con 0x7fb960158b90 2024-08-17T02:28:36.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.952+0000 7fb965000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9600ab4a0 con 0x7fb9600cc5f0 2024-08-17T02:28:36.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.952+0000 7fb965000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9600ab780 con 0x7fb960158f60 2024-08-17T02:28:36.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.952+0000 7fb95e800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb9600cc5f0 0x7fb9600acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.952+0000 7fb95e800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb9600cc5f0 0x7fb9600acd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:51598/0 (socket says 172.21.15.106:51598) 2024-08-17T02:28:36.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.952+0000 7fb95e800640 1 -- 172.21.15.106:0/771870111 learned_addr learned my addr 172.21.15.106:0/771870111 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:36.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.952+0000 7fb95de00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb960158b90 0x7fb9600aea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:60540/0 (socket says 172.21.15.106:60540) 2024-08-17T02:28:36.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.953+0000 7fb95d400640 1 --2- 172.21.15.106:0/771870111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb960158f60 0x7fb9600ac820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.953+0000 7fb95e800640 1 -- 172.21.15.106:0/771870111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb960158f60 msgr2=0x7fb9600ac820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:36.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.953+0000 7fb95e800640 1 --2- 172.21.15.106:0/771870111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb960158f60 0x7fb9600ac820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.953+0000 7fb95e800640 1 -- 172.21.15.106:0/771870111 >> v1:172.21.15.106:6789/0 conn(0x7fb960158b90 legacy=0x7fb9600aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.953+0000 7fb95e800640 1 -- 172.21.15.106:0/771870111 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9600aba60 con 0x7fb9600cc5f0 2024-08-17T02:28:36.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.954+0000 7fb95e800640 1 --2- 172.21.15.106:0/771870111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9600cc5f0 0x7fb9600acd60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb958009f20 tx=0x7fb958009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c861c1417229bf77 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:36.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.954+0000 7fb95ca00640 1 -- 172.21.15.106:0/771870111 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb958031400 con 0x7fb9600cc5f0 2024-08-17T02:28:36.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.954+0000 7fb95ca00640 1 -- 172.21.15.106:0/771870111 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95802d050 con 0x7fb9600cc5f0 2024-08-17T02:28:36.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.954+0000 7fb95ca00640 1 -- 172.21.15.106:0/771870111 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9580317d0 con 0x7fb9600cc5f0 2024-08-17T02:28:36.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.955+0000 7fb965000640 1 -- 172.21.15.106:0/771870111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9600cc5f0 msgr2=0x7fb9600acd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.955+0000 7fb965000640 1 --2- 172.21.15.106:0/771870111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9600cc5f0 0x7fb9600acd60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb958009f20 tx=0x7fb958009840 comp rx=0 tx=0).stop 2024-08-17T02:28:36.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.955+0000 7fb965000640 1 -- 172.21.15.106:0/771870111 shutdown_connections 2024-08-17T02:28:36.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.955+0000 7fb965000640 1 --2- 172.21.15.106:0/771870111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9600cc5f0 0x7fb9600acd60 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.955+0000 7fb965000640 1 --2- 172.21.15.106:0/771870111 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb960158f60 0x7fb9600ac820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.955+0000 7fb965000640 1 -- 172.21.15.106:0/771870111 >> 172.21.15.106:0/771870111 conn(0x7fb960067750 msgr2=0x7fb9600cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:36.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.955+0000 7fb965000640 1 -- 172.21.15.106:0/771870111 shutdown_connections 2024-08-17T02:28:36.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.955+0000 7fb965000640 1 -- 172.21.15.106:0/771870111 wait complete. 2024-08-17T02:28:36.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.956+0000 7fb965000640 1 Processor -- start 2024-08-17T02:28:36.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.956+0000 7fb965000640 1 -- start start 2024-08-17T02:28:36.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.957+0000 7fb965000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9600cc5f0 0x7fb96014d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.957+0000 7fb965000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb960158b90 0x7fb960169da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.957+0000 7fb965000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb960158f60 0x7fb96006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.957+0000 7fb965000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9600c8770 con 0x7fb960158f60 2024-08-17T02:28:36.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.957+0000 7fb965000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb960157e90 con 0x7fb960158b90 2024-08-17T02:28:36.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.957+0000 7fb965000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9600ca030 con 0x7fb9600cc5f0 2024-08-17T02:28:36.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.957+0000 7fb95e800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb960158f60 0x7fb96006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.957+0000 7fb95e800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb960158f60 0x7fb96006d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:51612/0 (socket says 172.21.15.106:51612) 2024-08-17T02:28:36.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.957+0000 7fb95e800640 1 -- 172.21.15.106:0/2441354876 learned_addr learned my addr 172.21.15.106:0/2441354876 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:36.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.958+0000 7fb95de00640 1 --2- 172.21.15.106:0/2441354876 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9600cc5f0 0x7fb96014d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.958+0000 7fb95d400640 1 --2- 172.21.15.106:0/2441354876 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb960158b90 0x7fb960169da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.958+0000 7fb95e800640 1 -- 172.21.15.106:0/2441354876 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9600cc5f0 msgr2=0x7fb96014d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.958+0000 7fb95e800640 1 --2- 172.21.15.106:0/2441354876 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9600cc5f0 0x7fb96014d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.958+0000 7fb95e800640 1 -- 172.21.15.106:0/2441354876 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb960158b90 msgr2=0x7fb960169da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.958+0000 7fb95e800640 1 --2- 172.21.15.106:0/2441354876 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb960158b90 0x7fb960169da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.958+0000 7fb95e800640 1 -- 172.21.15.106:0/2441354876 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb958009ae0 con 0x7fb960158f60 2024-08-17T02:28:36.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.958+0000 7fb95e800640 1 --2- 172.21.15.106:0/2441354876 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb960158f60 0x7fb96006d2b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb958009f80 tx=0x7fb958036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:36.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.958+0000 7fb955600640 1 -- 172.21.15.106:0/2441354876 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb958008e50 con 0x7fb960158f60 2024-08-17T02:28:36.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.958+0000 7fb955600640 1 -- 172.21.15.106:0/2441354876 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95803b410 con 0x7fb960158f60 2024-08-17T02:28:36.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.958+0000 7fb955600640 1 -- 172.21.15.106:0/2441354876 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95803b7d0 con 0x7fb960158f60 2024-08-17T02:28:36.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.958+0000 7fb965000640 1 -- 172.21.15.106:0/2441354876 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9600c9d00 con 0x7fb960158f60 2024-08-17T02:28:36.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.959+0000 7fb965000640 1 -- 172.21.15.106:0/2441354876 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb960158380 con 0x7fb960158f60 2024-08-17T02:28:36.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.959+0000 7fb965000640 1 -- 172.21.15.106:0/2441354876 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9600c9b60 con 0x7fb960158f60 2024-08-17T02:28:36.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.960+0000 7fb955600640 1 -- 172.21.15.106:0/2441354876 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb958038050 con 0x7fb960158f60 2024-08-17T02:28:36.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.962+0000 7fb955600640 1 --2- 172.21.15.106:0/2441354876 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb940065150 0x7fb940067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.962+0000 7fb955600640 1 -- 172.21.15.106:0/2441354876 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb9580a2d90 con 0x7fb960158f60 2024-08-17T02:28:36.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.962+0000 7fb95de00640 1 --2- 172.21.15.106:0/2441354876 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb940065150 0x7fb940067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.963+0000 7fb95de00640 1 --2- 172.21.15.106:0/2441354876 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb940065150 0x7fb940067600 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb950007800 tx=0x7fb950007e20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:36.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:36.966+0000 7fb955600640 1 -- 172.21.15.106:0/2441354876 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb9600c9b60 con 0x7fb960158f60 2024-08-17T02:28:37.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.137+0000 7fb965000640 1 -- 172.21.15.106:0/2441354876 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb9600c9b60 con 0x7fb960158f60 2024-08-17T02:28:37.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.138+0000 7fb955600640 1 -- 172.21.15.106:0/2441354876 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb95803f020 con 0x7fb960158f60 2024-08-17T02:28:37.138 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-08-17T02:28:37.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.140+0000 7fb965000640 1 -- 172.21.15.106:0/2441354876 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb940065150 msgr2=0x7fb940067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.140+0000 7fb965000640 1 --2- 172.21.15.106:0/2441354876 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb940065150 0x7fb940067600 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb950007800 tx=0x7fb950007e20 comp rx=0 tx=0).stop 2024-08-17T02:28:37.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.140+0000 7fb965000640 1 -- 172.21.15.106:0/2441354876 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb960158f60 msgr2=0x7fb96006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.140+0000 7fb965000640 1 --2- 172.21.15.106:0/2441354876 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb960158f60 0x7fb96006d2b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb958009f80 tx=0x7fb958036000 comp rx=0 tx=0).stop 2024-08-17T02:28:37.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.140+0000 7fb965000640 1 -- 172.21.15.106:0/2441354876 shutdown_connections 2024-08-17T02:28:37.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.140+0000 7fb965000640 1 --2- 172.21.15.106:0/2441354876 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb940065150 0x7fb940067600 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.140+0000 7fb965000640 1 --2- 172.21.15.106:0/2441354876 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb960158f60 0x7fb96006d2b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.140+0000 7fb965000640 1 --2- 172.21.15.106:0/2441354876 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb960158b90 0x7fb960169da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.140+0000 7fb965000640 1 --2- 172.21.15.106:0/2441354876 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9600cc5f0 0x7fb96014d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.140+0000 7fb965000640 1 -- 172.21.15.106:0/2441354876 >> 172.21.15.106:0/2441354876 conn(0x7fb960067750 msgr2=0x7fb96015ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:37.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.140+0000 7fb965000640 1 -- 172.21.15.106:0/2441354876 shutdown_connections 2024-08-17T02:28:37.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.140+0000 7fb965000640 1 -- 172.21.15.106:0/2441354876 wait complete. 2024-08-17T02:28:37.155 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:28:37.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.302+0000 7fe9bd800640 1 Processor -- start 2024-08-17T02:28:37.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.302+0000 7fe9bd800640 1 -- start start 2024-08-17T02:28:37.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.303+0000 7fe9bd800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe9b8155900 0x7fe9b8155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.303+0000 7fe9bd800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9b80b0270 0x7fe9b8156210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.303+0000 7fe9bd800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe9b8157b20 0x7fe9b8157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.303+0000 7fe9bd800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9b8157690 con 0x7fe9b8157b20 2024-08-17T02:28:37.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.303+0000 7fe9bd800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9b8156a80 con 0x7fe9b8155900 2024-08-17T02:28:37.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.303+0000 7fe9bd800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b8156d60 con 0x7fe9b80b0270 2024-08-17T02:28:37.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.303+0000 7fe9bce00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe9b8157b20 0x7fe9b8157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.303+0000 7fe9bce00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe9b8157b20 0x7fe9b8157fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:51618/0 (socket says 172.21.15.106:51618) 2024-08-17T02:28:37.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.303+0000 7fe9b7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe9b8155900 0x7fe9b8155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.303+0000 7fe9bce00640 1 -- 172.21.15.106:0/3391078932 learned_addr learned my addr 172.21.15.106:0/3391078932 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:37.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.303+0000 7fe9af400640 1 --2- 172.21.15.106:0/3391078932 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9b80b0270 0x7fe9b8156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.304+0000 7fe9bce00640 1 -- 172.21.15.106:0/3391078932 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9b80b0270 msgr2=0x7fe9b8156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:37.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.304+0000 7fe9bce00640 1 --2- 172.21.15.106:0/3391078932 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9b80b0270 0x7fe9b8156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.304+0000 7fe9bce00640 1 -- 172.21.15.106:0/3391078932 >> v2:172.21.15.171:3300/0 conn(0x7fe9b8155900 msgr2=0x7fe9b8155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:37.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.304+0000 7fe9bce00640 1 --2- 172.21.15.106:0/3391078932 >> v2:172.21.15.171:3300/0 conn(0x7fe9b8155900 0x7fe9b8155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.304+0000 7fe9bce00640 1 -- 172.21.15.106:0/3391078932 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b8157040 con 0x7fe9b8157b20 2024-08-17T02:28:37.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.305+0000 7fe9bce00640 1 --2- 172.21.15.106:0/3391078932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9b8157b20 0x7fe9b8157fa0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8065fd0 tx=0x7fe9b000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570e5dc784259210 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:37.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.305+0000 7fe9b7400640 1 -- 172.21.15.106:0/3391078932 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b000b2e0 con 0x7fe9b8157b20 2024-08-17T02:28:37.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.305+0000 7fe9b7400640 1 -- 172.21.15.106:0/3391078932 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b000b440 con 0x7fe9b8157b20 2024-08-17T02:28:37.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.305+0000 7fe9b7400640 1 -- 172.21.15.106:0/3391078932 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0009840 con 0x7fe9b8157b20 2024-08-17T02:28:37.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.306+0000 7fe9bd800640 1 -- 172.21.15.106:0/3391078932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9b8157b20 msgr2=0x7fe9b8157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.306+0000 7fe9bd800640 1 --2- 172.21.15.106:0/3391078932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9b8157b20 0x7fe9b8157fa0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8065fd0 tx=0x7fe9b000ba50 comp rx=0 tx=0).stop 2024-08-17T02:28:37.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.306+0000 7fe9bd800640 1 -- 172.21.15.106:0/3391078932 shutdown_connections 2024-08-17T02:28:37.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.306+0000 7fe9bd800640 1 --2- 172.21.15.106:0/3391078932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9b8157b20 0x7fe9b8157fa0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.306+0000 7fe9bd800640 1 --2- 172.21.15.106:0/3391078932 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9b80b0270 0x7fe9b8156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.306+0000 7fe9bd800640 1 --2- 172.21.15.106:0/3391078932 >> v2:172.21.15.171:3300/0 conn(0x7fe9b8155900 0x7fe9b8155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.306+0000 7fe9bd800640 1 -- 172.21.15.106:0/3391078932 >> 172.21.15.106:0/3391078932 conn(0x7fe9b8067750 msgr2=0x7fe9b80cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:37.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.306+0000 7fe9bd800640 1 -- 172.21.15.106:0/3391078932 shutdown_connections 2024-08-17T02:28:37.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.306+0000 7fe9bd800640 1 -- 172.21.15.106:0/3391078932 wait complete. 2024-08-17T02:28:37.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.307+0000 7fe9bd800640 1 Processor -- start 2024-08-17T02:28:37.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.307+0000 7fe9bd800640 1 -- start start 2024-08-17T02:28:37.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.308+0000 7fe9bd800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9b80b0270 0x7fe9b816cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.308+0000 7fe9bd800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9b8155900 0x7fe9b8152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.308+0000 7fe9bd800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9b8157b20 0x7fe9b8168ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.308+0000 7fe9bd800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b815b2d0 con 0x7fe9b8157b20 2024-08-17T02:28:37.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.308+0000 7fe9bd800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b815c130 con 0x7fe9b80b0270 2024-08-17T02:28:37.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.308+0000 7fe9bd800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b816d460 con 0x7fe9b8155900 2024-08-17T02:28:37.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.309+0000 7fe9bce00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9b8157b20 0x7fe9b8168ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.309+0000 7fe9bce00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9b8157b20 0x7fe9b8168ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:51626/0 (socket says 172.21.15.106:51626) 2024-08-17T02:28:37.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.309+0000 7fe9bce00640 1 -- 172.21.15.106:0/2483040071 learned_addr learned my addr 172.21.15.106:0/2483040071 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:37.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.309+0000 7fe9b7e00640 1 --2- 172.21.15.106:0/2483040071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9b80b0270 0x7fe9b816cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.309+0000 7fe9af400640 1 --2- 172.21.15.106:0/2483040071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9b8155900 0x7fe9b8152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.309+0000 7fe9bce00640 1 -- 172.21.15.106:0/2483040071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9b8155900 msgr2=0x7fe9b8152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.309+0000 7fe9bce00640 1 --2- 172.21.15.106:0/2483040071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9b8155900 0x7fe9b8152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.309+0000 7fe9bce00640 1 -- 172.21.15.106:0/2483040071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9b80b0270 msgr2=0x7fe9b816cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.309+0000 7fe9bce00640 1 --2- 172.21.15.106:0/2483040071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9b80b0270 0x7fe9b816cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.309+0000 7fe9bce00640 1 -- 172.21.15.106:0/2483040071 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b000bcf0 con 0x7fe9b8157b20 2024-08-17T02:28:37.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.309+0000 7fe9b7e00640 1 --2- 172.21.15.106:0/2483040071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9b80b0270 0x7fe9b816cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:37.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.309+0000 7fe9bce00640 1 --2- 172.21.15.106:0/2483040071 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9b8157b20 0x7fe9b8168ee0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe9b002ce40 tx=0x7fe9b0039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:37.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.309+0000 7fe9afe00640 1 -- 172.21.15.106:0/2483040071 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b000b2e0 con 0x7fe9b8157b20 2024-08-17T02:28:37.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.310+0000 7fe9afe00640 1 -- 172.21.15.106:0/2483040071 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b0033e70 con 0x7fe9b8157b20 2024-08-17T02:28:37.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.310+0000 7fe9afe00640 1 -- 172.21.15.106:0/2483040071 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b003c640 con 0x7fe9b8157b20 2024-08-17T02:28:37.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.310+0000 7fe9bd800640 1 -- 172.21.15.106:0/2483040071 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b8152f90 con 0x7fe9b8157b20 2024-08-17T02:28:37.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.310+0000 7fe9bd800640 1 -- 172.21.15.106:0/2483040071 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b815b800 con 0x7fe9b8157b20 2024-08-17T02:28:37.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.311+0000 7fe9bd800640 1 -- 172.21.15.106:0/2483040071 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b815c2c0 con 0x7fe9b8157b20 2024-08-17T02:28:37.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.311+0000 7fe9afe00640 1 -- 172.21.15.106:0/2483040071 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe9b003ca30 con 0x7fe9b8157b20 2024-08-17T02:28:37.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.312+0000 7fe9afe00640 1 --2- 172.21.15.106:0/2483040071 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe994065150 0x7fe994067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.312+0000 7fe9afe00640 1 -- 172.21.15.106:0/2483040071 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe9b00a39f0 con 0x7fe9b8157b20 2024-08-17T02:28:37.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.312+0000 7fe9b7e00640 1 --2- 172.21.15.106:0/2483040071 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe994065150 0x7fe994067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.313+0000 7fe9b7e00640 1 --2- 172.21.15.106:0/2483040071 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe994065150 0x7fe994067600 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8009cf0 tx=0x7fe9a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:37.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.316+0000 7fe9afe00640 1 -- 172.21.15.106:0/2483040071 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe9b0071e20 con 0x7fe9b8157b20 2024-08-17T02:28:37.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.490+0000 7fe9bd800640 1 -- 172.21.15.106:0/2483040071 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe9b8071050 con 0x7fe9b8157b20 2024-08-17T02:28:37.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.490+0000 7fe9afe00640 1 -- 172.21.15.106:0/2483040071 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe9b0075440 con 0x7fe9b8157b20 2024-08-17T02:28:37.491 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:37.491 INFO:teuthology.orchestra.run.smithi106.stdout:[ 2024-08-17T02:28:37.491 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:37.491 INFO:teuthology.orchestra.run.smithi106.stdout: "poolnum": 1, 2024-08-17T02:28:37.491 INFO:teuthology.orchestra.run.smithi106.stdout: "poolname": ".mgr" 2024-08-17T02:28:37.491 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:37.491 INFO:teuthology.orchestra.run.smithi106.stdout:] 2024-08-17T02:28:37.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.492+0000 7fe9bd800640 1 -- 172.21.15.106:0/2483040071 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe994065150 msgr2=0x7fe994067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.492+0000 7fe9bd800640 1 --2- 172.21.15.106:0/2483040071 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe994065150 0x7fe994067600 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8009cf0 tx=0x7fe9a8008040 comp rx=0 tx=0).stop 2024-08-17T02:28:37.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.492+0000 7fe9bd800640 1 -- 172.21.15.106:0/2483040071 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9b8157b20 msgr2=0x7fe9b8168ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.492+0000 7fe9bd800640 1 --2- 172.21.15.106:0/2483040071 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9b8157b20 0x7fe9b8168ee0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe9b002ce40 tx=0x7fe9b0039000 comp rx=0 tx=0).stop 2024-08-17T02:28:37.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.492+0000 7fe9bd800640 1 -- 172.21.15.106:0/2483040071 shutdown_connections 2024-08-17T02:28:37.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.492+0000 7fe9bd800640 1 --2- 172.21.15.106:0/2483040071 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe994065150 0x7fe994067600 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.492+0000 7fe9bd800640 1 --2- 172.21.15.106:0/2483040071 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9b8157b20 0x7fe9b8168ee0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.492+0000 7fe9bd800640 1 --2- 172.21.15.106:0/2483040071 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe9b8155900 0x7fe9b8152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.492+0000 7fe9bd800640 1 --2- 172.21.15.106:0/2483040071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9b80b0270 0x7fe9b816cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.492+0000 7fe9bd800640 1 -- 172.21.15.106:0/2483040071 >> 172.21.15.106:0/2483040071 conn(0x7fe9b8067750 msgr2=0x7fe9b8154a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:37.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.492+0000 7fe9bd800640 1 -- 172.21.15.106:0/2483040071 shutdown_connections 2024-08-17T02:28:37.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.493+0000 7fe9bd800640 1 -- 172.21.15.106:0/2483040071 wait complete. 2024-08-17T02:28:37.507 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:28:37.508 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:28:37.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.657+0000 7ff939c00640 1 Processor -- start 2024-08-17T02:28:37.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.657+0000 7ff939c00640 1 -- start start 2024-08-17T02:28:37.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.659+0000 7ff939c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9340ab010 0x7ff93406e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.659+0000 7ff939c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9340af5f0 con 0x7ff93406df00 2024-08-17T02:28:37.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.659+0000 7ff939c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff934159600 con 0x7ff93415a0e0 2024-08-17T02:28:37.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.659+0000 7ff939c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9341598e0 con 0x7ff9340ab010 2024-08-17T02:28:37.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.659+0000 7ff933e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff93406df00 0x7ff9340aa900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:60550/0 (socket says 172.21.15.106:60550) 2024-08-17T02:28:37.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.659+0000 7ff933e00640 1 -- 172.21.15.106:0/520910455 learned_addr learned my addr 172.21.15.106:0/520910455 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:37.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.659+0000 7ff939200640 1 --2- 172.21.15.106:0/520910455 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9340ab010 0x7ff93406e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.659+0000 7ff932a00640 1 -- 172.21.15.106:0/520910455 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445858555 0 0) 0x7ff9340af5f0 con 0x7ff93406df00 2024-08-17T02:28:37.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.660+0000 7ff932a00640 1 -- 172.21.15.106:0/520910455 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9180034e0 con 0x7ff93406df00 2024-08-17T02:28:37.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.660+0000 7ff932a00640 1 -- 172.21.15.106:0/520910455 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1179659610 0 0) 0x7ff9180034e0 con 0x7ff93406df00 2024-08-17T02:28:37.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.660+0000 7ff932a00640 1 -- 172.21.15.106:0/520910455 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9340ab010 msgr2=0x7ff93406e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:37.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.660+0000 7ff932a00640 1 --2- 172.21.15.106:0/520910455 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9340ab010 0x7ff93406e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.660+0000 7ff932a00640 1 -- 172.21.15.106:0/520910455 >> v1:172.21.15.171:6789/0 conn(0x7ff93415a0e0 legacy=0x7ff9340ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.660+0000 7ff932a00640 1 -- 172.21.15.106:0/520910455 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff934159bc0 con 0x7ff93406df00 2024-08-17T02:28:37.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.660+0000 7ff932a00640 1 -- 172.21.15.106:0/520910455 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7ff9240017f0 con 0x7ff93406df00 2024-08-17T02:28:37.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.660+0000 7ff932a00640 1 -- 172.21.15.106:0/520910455 >> v1:172.21.15.106:6789/0 conn(0x7ff93406df00 legacy=0x7ff9340aa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.660+0000 7ff932a00640 1 --2- 172.21.15.106:0/520910455 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9340ab010 0x7ff918003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.660+0000 7ff932a00640 1 --2- 172.21.15.106:0/520910455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff918003f80 0x7ff918004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.660+0000 7ff932a00640 1 --2- 172.21.15.106:0/520910455 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff918004cc0 0x7ff918005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.660+0000 7ff932a00640 1 -- 172.21.15.106:0/520910455 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9341598e0 con 0x7ff918004cc0 2024-08-17T02:28:37.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.660+0000 7ff932a00640 1 -- 172.21.15.106:0/520910455 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91800bb60 con 0x7ff918003f80 2024-08-17T02:28:37.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.660+0000 7ff932a00640 1 -- 172.21.15.106:0/520910455 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff91800df30 con 0x7ff9340ab010 2024-08-17T02:28:37.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.660+0000 7ff939200640 1 --2- 172.21.15.106:0/520910455 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff918004cc0 0x7ff918005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.660+0000 7ff933400640 1 --2- 172.21.15.106:0/520910455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff918003f80 0x7ff918004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.660+0000 7ff933e00640 1 --2- 172.21.15.106:0/520910455 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9340ab010 0x7ff918003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.661+0000 7ff939200640 1 -- 172.21.15.106:0/520910455 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9340ab010 msgr2=0x7ff918003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:37.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.661+0000 7ff939200640 1 --2- 172.21.15.106:0/520910455 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff9340ab010 0x7ff918003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.661+0000 7ff939200640 1 -- 172.21.15.106:0/520910455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff918003f80 msgr2=0x7ff918004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:37.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.661+0000 7ff939200640 1 --2- 172.21.15.106:0/520910455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff918003f80 0x7ff918004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.661+0000 7ff939200640 1 -- 172.21.15.106:0/520910455 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9180034e0 con 0x7ff918004cc0 2024-08-17T02:28:37.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.662+0000 7ff939200640 1 --2- 172.21.15.106:0/520910455 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff918004cc0 0x7ff918005130 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff92c006e70 tx=0x7ff92c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=194de16faadfd5fc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:37.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.662+0000 7ff932a00640 1 -- 172.21.15.106:0/520910455 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c031400 con 0x7ff918004cc0 2024-08-17T02:28:37.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.662+0000 7ff932a00640 1 -- 172.21.15.106:0/520910455 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92c02d050 con 0x7ff918004cc0 2024-08-17T02:28:37.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.662+0000 7ff932a00640 1 -- 172.21.15.106:0/520910455 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c031790 con 0x7ff918004cc0 2024-08-17T02:28:37.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.662+0000 7ff939c00640 1 -- 172.21.15.106:0/520910455 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff918004cc0 msgr2=0x7ff918005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.662+0000 7ff939c00640 1 --2- 172.21.15.106:0/520910455 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff918004cc0 0x7ff918005130 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff92c006e70 tx=0x7ff92c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.662+0000 7ff939200640 1 -- 172.21.15.106:0/520910455 reap_dead start 2024-08-17T02:28:37.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.662+0000 7ff939c00640 1 -- 172.21.15.106:0/520910455 shutdown_connections 2024-08-17T02:28:37.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.662+0000 7ff939c00640 1 -- 172.21.15.106:0/520910455 >> 172.21.15.106:0/520910455 conn(0x7ff934067750 msgr2=0x7ff93406c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:37.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.663+0000 7ff939c00640 1 -- 172.21.15.106:0/520910455 shutdown_connections 2024-08-17T02:28:37.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.663+0000 7ff939c00640 1 -- 172.21.15.106:0/520910455 wait complete. 2024-08-17T02:28:37.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.664+0000 7ff939c00640 1 Processor -- start 2024-08-17T02:28:37.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.664+0000 7ff939c00640 1 -- start start 2024-08-17T02:28:37.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.665+0000 7ff939c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff918004cc0 0x7ff934153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.665+0000 7ff939c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff93414f770 0x7ff93414ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.665+0000 7ff939c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff934154b90 0x7ff934154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.665+0000 7ff939c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9341548f0 con 0x7ff93414f770 2024-08-17T02:28:37.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.665+0000 7ff939c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff934155ed0 con 0x7ff918004cc0 2024-08-17T02:28:37.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.665+0000 7ff939c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff934155520 con 0x7ff934154b90 2024-08-17T02:28:37.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.665+0000 7ff933400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff93414f770 0x7ff93414ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.665+0000 7ff933400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff93414f770 0x7ff93414ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:51646/0 (socket says 172.21.15.106:51646) 2024-08-17T02:28:37.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.665+0000 7ff933400640 1 -- 172.21.15.106:0/3021530432 learned_addr learned my addr 172.21.15.106:0/3021530432 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:37.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.665+0000 7ff933e00640 1 --2- 172.21.15.106:0/3021530432 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff918004cc0 0x7ff934153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.665+0000 7ff933400640 1 -- 172.21.15.106:0/3021530432 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff934154b90 msgr2=0x7ff934154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.665+0000 7ff933400640 1 --2- 172.21.15.106:0/3021530432 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff934154b90 0x7ff934154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.665+0000 7ff933400640 1 -- 172.21.15.106:0/3021530432 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff918004cc0 msgr2=0x7ff934153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.665+0000 7ff933400640 1 --2- 172.21.15.106:0/3021530432 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff918004cc0 0x7ff934153ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.665+0000 7ff933400640 1 -- 172.21.15.106:0/3021530432 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9341543e0 con 0x7ff93414f770 2024-08-17T02:28:37.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.665+0000 7ff933e00640 1 --2- 172.21.15.106:0/3021530432 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff918004cc0 0x7ff934153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:37.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.666+0000 7ff933400640 1 --2- 172.21.15.106:0/3021530432 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff93414f770 0x7ff93414ef20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff920002920 tx=0x7ff920007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:37.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.666+0000 7ff92b400640 1 -- 172.21.15.106:0/3021530432 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92000f9c0 con 0x7ff93414f770 2024-08-17T02:28:37.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.666+0000 7ff92b400640 1 -- 172.21.15.106:0/3021530432 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92000fb20 con 0x7ff93414f770 2024-08-17T02:28:37.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.666+0000 7ff92b400640 1 -- 172.21.15.106:0/3021530432 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920007030 con 0x7ff93414f770 2024-08-17T02:28:37.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.666+0000 7ff939c00640 1 -- 172.21.15.106:0/3021530432 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9340a9c90 con 0x7ff93414f770 2024-08-17T02:28:37.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.666+0000 7ff939c00640 1 -- 172.21.15.106:0/3021530432 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9340aa250 con 0x7ff93414f770 2024-08-17T02:28:37.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.667+0000 7ff939c00640 1 -- 172.21.15.106:0/3021530432 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff934071050 con 0x7ff93414f770 2024-08-17T02:28:37.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.668+0000 7ff92b400640 1 -- 172.21.15.106:0/3021530432 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff920007460 con 0x7ff93414f770 2024-08-17T02:28:37.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.669+0000 7ff92b400640 1 --2- 172.21.15.106:0/3021530432 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ff914065150 0x7ff914067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.669+0000 7ff92b400640 1 -- 172.21.15.106:0/3021530432 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff9200821f0 con 0x7ff93414f770 2024-08-17T02:28:37.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.669+0000 7ff933e00640 1 --2- 172.21.15.106:0/3021530432 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ff914065150 0x7ff914067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.669+0000 7ff933e00640 1 --2- 172.21.15.106:0/3021530432 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ff914065150 0x7ff914067600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff924002250 tx=0x7ff924001360 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:37.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.672+0000 7ff92b400640 1 -- 172.21.15.106:0/3021530432 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff9200505a0 con 0x7ff93414f770 2024-08-17T02:28:37.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:37.842+0000 7ff939c00640 1 -- 172.21.15.106:0/3021530432 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff9340ad9a0 con 0x7ff93414f770 2024-08-17T02:28:38.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.494+0000 7ff92b400640 1 -- 172.21.15.106:0/3021530432 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff920053bc0 con 0x7ff93414f770 2024-08-17T02:28:38.495 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_metadata' created 2024-08-17T02:28:38.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.496+0000 7ff939c00640 1 -- 172.21.15.106:0/3021530432 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ff914065150 msgr2=0x7ff914067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:38.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.496+0000 7ff939c00640 1 --2- 172.21.15.106:0/3021530432 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ff914065150 0x7ff914067600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff924002250 tx=0x7ff924001360 comp rx=0 tx=0).stop 2024-08-17T02:28:38.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.496+0000 7ff939c00640 1 -- 172.21.15.106:0/3021530432 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff93414f770 msgr2=0x7ff93414ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:38.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.496+0000 7ff939c00640 1 --2- 172.21.15.106:0/3021530432 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff93414f770 0x7ff93414ef20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff920002920 tx=0x7ff920007ca0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.497+0000 7ff939c00640 1 -- 172.21.15.106:0/3021530432 shutdown_connections 2024-08-17T02:28:38.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.497+0000 7ff939c00640 1 --2- 172.21.15.106:0/3021530432 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff934154b90 0x7ff934154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.497+0000 7ff939c00640 1 --2- 172.21.15.106:0/3021530432 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ff914065150 0x7ff914067600 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.497+0000 7ff939c00640 1 --2- 172.21.15.106:0/3021530432 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff93414f770 0x7ff93414ef20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.497+0000 7ff939c00640 1 --2- 172.21.15.106:0/3021530432 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff918004cc0 0x7ff934153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.497+0000 7ff939c00640 1 -- 172.21.15.106:0/3021530432 >> 172.21.15.106:0/3021530432 conn(0x7ff934067750 msgr2=0x7ff9340ae8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:38.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.498+0000 7ff939c00640 1 -- 172.21.15.106:0/3021530432 shutdown_connections 2024-08-17T02:28:38.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.498+0000 7ff939c00640 1 -- 172.21.15.106:0/3021530432 wait complete. 2024-08-17T02:28:38.517 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:28:38.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.670+0000 7fd2ca200640 1 Processor -- start 2024-08-17T02:28:38.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.671+0000 7fd2ca200640 1 -- start start 2024-08-17T02:28:38.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.672+0000 7fd2ca200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd2c4156890 0x7fd2c406dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:38.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.672+0000 7fd2ca200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2c4156c60 0x7fd2c406e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:38.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.672+0000 7fd2ca200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd2c40c8130 0x7fd2c40c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:38.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.672+0000 7fd2ca200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c40ae9b0 con 0x7fd2c40c8130 2024-08-17T02:28:38.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.672+0000 7fd2ca200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c40ab320 con 0x7fd2c4156890 2024-08-17T02:28:38.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.672+0000 7fd2ca200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c40aa730 con 0x7fd2c4156c60 2024-08-17T02:28:38.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.672+0000 7fd2c3e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd2c40c8130 0x7fd2c40c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:38.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.672+0000 7fd2c3e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd2c40c8130 0x7fd2c40c85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:51650/0 (socket says 172.21.15.106:51650) 2024-08-17T02:28:38.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.672+0000 7fd2c3e00640 1 -- 172.21.15.106:0/2109763348 learned_addr learned my addr 172.21.15.106:0/2109763348 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:38.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.672+0000 7fd2baa00640 1 --2- 172.21.15.106:0/2109763348 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2c4156c60 0x7fd2c406e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:38.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.672+0000 7fd2c3400640 1 --2- 172.21.15.106:0/2109763348 >> v2:172.21.15.171:3300/0 conn(0x7fd2c4156890 0x7fd2c406dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:38.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.673+0000 7fd2c3e00640 1 -- 172.21.15.106:0/2109763348 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2c4156c60 msgr2=0x7fd2c406e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:38.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.673+0000 7fd2c3e00640 1 --2- 172.21.15.106:0/2109763348 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2c4156c60 0x7fd2c406e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.673+0000 7fd2c3e00640 1 -- 172.21.15.106:0/2109763348 >> v2:172.21.15.171:3300/0 conn(0x7fd2c4156890 msgr2=0x7fd2c406dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:38.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.673+0000 7fd2c3e00640 1 --2- 172.21.15.106:0/2109763348 >> v2:172.21.15.171:3300/0 conn(0x7fd2c4156890 0x7fd2c406dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.673+0000 7fd2c3e00640 1 -- 172.21.15.106:0/2109763348 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c40aa9f0 con 0x7fd2c40c8130 2024-08-17T02:28:38.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.673+0000 7fd2c3400640 1 --2- 172.21.15.106:0/2109763348 >> v2:172.21.15.171:3300/0 conn(0x7fd2c4156890 0x7fd2c406dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:38.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.674+0000 7fd2c3e00640 1 --2- 172.21.15.106:0/2109763348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2c40c8130 0x7fd2c40c85b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd2c406c5c0 tx=0x7fd2bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aeb7821c68c8a48 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:38.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.674+0000 7fd2c2a00640 1 -- 172.21.15.106:0/2109763348 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc031400 con 0x7fd2c40c8130 2024-08-17T02:28:38.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.674+0000 7fd2c2a00640 1 -- 172.21.15.106:0/2109763348 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2bc02d050 con 0x7fd2c40c8130 2024-08-17T02:28:38.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.674+0000 7fd2c2a00640 1 -- 172.21.15.106:0/2109763348 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc0317d0 con 0x7fd2c40c8130 2024-08-17T02:28:38.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.674+0000 7fd2ca200640 1 -- 172.21.15.106:0/2109763348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2c40c8130 msgr2=0x7fd2c40c85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:38.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.674+0000 7fd2ca200640 1 --2- 172.21.15.106:0/2109763348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2c40c8130 0x7fd2c40c85b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd2c406c5c0 tx=0x7fd2bc009840 comp rx=0 tx=0).stop 2024-08-17T02:28:38.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.675+0000 7fd2ca200640 1 -- 172.21.15.106:0/2109763348 shutdown_connections 2024-08-17T02:28:38.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.675+0000 7fd2ca200640 1 --2- 172.21.15.106:0/2109763348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2c40c8130 0x7fd2c40c85b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.675+0000 7fd2ca200640 1 --2- 172.21.15.106:0/2109763348 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2c4156c60 0x7fd2c406e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.675+0000 7fd2ca200640 1 --2- 172.21.15.106:0/2109763348 >> v2:172.21.15.171:3300/0 conn(0x7fd2c4156890 0x7fd2c406dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.675+0000 7fd2ca200640 1 -- 172.21.15.106:0/2109763348 >> 172.21.15.106:0/2109763348 conn(0x7fd2c4067750 msgr2=0x7fd2c406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:38.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.675+0000 7fd2ca200640 1 -- 172.21.15.106:0/2109763348 shutdown_connections 2024-08-17T02:28:38.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.675+0000 7fd2ca200640 1 -- 172.21.15.106:0/2109763348 wait complete. 2024-08-17T02:28:38.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.676+0000 7fd2ca200640 1 Processor -- start 2024-08-17T02:28:38.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.676+0000 7fd2ca200640 1 -- start start 2024-08-17T02:28:38.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.677+0000 7fd2ca200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2c40c8130 0x7fd2c41581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:38.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.677+0000 7fd2ca200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2c4156890 0x7fd2c41422f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:38.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.677+0000 7fd2ca200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2c4156c60 0x7fd2c4153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:38.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.677+0000 7fd2ca200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c4157d60 con 0x7fd2c4156890 2024-08-17T02:28:38.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.677+0000 7fd2ca200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c4157150 con 0x7fd2c40c8130 2024-08-17T02:28:38.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.677+0000 7fd2ca200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c4157430 con 0x7fd2c4156c60 2024-08-17T02:28:38.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.677+0000 7fd2baa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2c4156890 0x7fd2c41422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:38.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.677+0000 7fd2baa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2c4156890 0x7fd2c41422f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:51652/0 (socket says 172.21.15.106:51652) 2024-08-17T02:28:38.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.677+0000 7fd2baa00640 1 -- 172.21.15.106:0/4266474865 learned_addr learned my addr 172.21.15.106:0/4266474865 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:38.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.678+0000 7fd2c3400640 1 --2- 172.21.15.106:0/4266474865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2c40c8130 0x7fd2c41581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:38.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.678+0000 7fd2c3e00640 1 --2- 172.21.15.106:0/4266474865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2c4156c60 0x7fd2c4153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:38.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.678+0000 7fd2baa00640 1 -- 172.21.15.106:0/4266474865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2c4156c60 msgr2=0x7fd2c4153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:38.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.678+0000 7fd2baa00640 1 --2- 172.21.15.106:0/4266474865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2c4156c60 0x7fd2c4153420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.678+0000 7fd2baa00640 1 -- 172.21.15.106:0/4266474865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2c40c8130 msgr2=0x7fd2c41581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:38.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.678+0000 7fd2baa00640 1 --2- 172.21.15.106:0/4266474865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2c40c8130 0x7fd2c41581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.678+0000 7fd2baa00640 1 -- 172.21.15.106:0/4266474865 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc009ae0 con 0x7fd2c4156890 2024-08-17T02:28:38.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.678+0000 7fd2baa00640 1 --2- 172.21.15.106:0/4266474865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2c4156890 0x7fd2c41422f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00e900 tx=0x7fd2ac0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:38.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.678+0000 7fd2bb400640 1 -- 172.21.15.106:0/4266474865 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac00c8e0 con 0x7fd2c4156890 2024-08-17T02:28:38.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.678+0000 7fd2bb400640 1 -- 172.21.15.106:0/4266474865 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ac00ca40 con 0x7fd2c4156890 2024-08-17T02:28:38.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.678+0000 7fd2bb400640 1 -- 172.21.15.106:0/4266474865 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac00cde0 con 0x7fd2c4156890 2024-08-17T02:28:38.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.678+0000 7fd2ca200640 1 -- 172.21.15.106:0/4266474865 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c4157710 con 0x7fd2c4156890 2024-08-17T02:28:38.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.678+0000 7fd2ca200640 1 -- 172.21.15.106:0/4266474865 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c4142830 con 0x7fd2c4156890 2024-08-17T02:28:38.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.679+0000 7fd2ca200640 1 -- 172.21.15.106:0/4266474865 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c4157ed0 con 0x7fd2c4156890 2024-08-17T02:28:38.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.680+0000 7fd2bb400640 1 -- 172.21.15.106:0/4266474865 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd2ac013680 con 0x7fd2c4156890 2024-08-17T02:28:38.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.681+0000 7fd2bb400640 1 --2- 172.21.15.106:0/4266474865 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd2a0065150 0x7fd2a0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:38.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.681+0000 7fd2bb400640 1 -- 172.21.15.106:0/4266474865 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fd2ac0824c0 con 0x7fd2c4156890 2024-08-17T02:28:38.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.681+0000 7fd2c3400640 1 --2- 172.21.15.106:0/4266474865 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd2a0065150 0x7fd2a0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:38.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.682+0000 7fd2c3400640 1 --2- 172.21.15.106:0/4266474865 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd2a0065150 0x7fd2a0067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4006e70 tx=0x7fd2b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:38.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.685+0000 7fd2bb400640 1 -- 172.21.15.106:0/4266474865 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd2ac050780 con 0x7fd2c4156890 2024-08-17T02:28:38.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:38.859+0000 7fd2ca200640 1 -- 172.21.15.106:0/4266474865 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd2c4157b90 con 0x7fd2c4156890 2024-08-17T02:28:39.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.498+0000 7fd2bb400640 1 -- 172.21.15.106:0/4266474865 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd2ac053da0 con 0x7fd2c4156890 2024-08-17T02:28:39.499 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_data' created 2024-08-17T02:28:39.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.506+0000 7fd2ca200640 1 -- 172.21.15.106:0/4266474865 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd2a0065150 msgr2=0x7fd2a0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:39.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.506+0000 7fd2ca200640 1 --2- 172.21.15.106:0/4266474865 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd2a0065150 0x7fd2a0067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4006e70 tx=0x7fd2b4008040 comp rx=0 tx=0).stop 2024-08-17T02:28:39.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.506+0000 7fd2ca200640 1 -- 172.21.15.106:0/4266474865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2c4156890 msgr2=0x7fd2c41422f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:39.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.506+0000 7fd2ca200640 1 --2- 172.21.15.106:0/4266474865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2c4156890 0x7fd2c41422f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00e900 tx=0x7fd2ac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:39.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.506+0000 7fd2ca200640 1 -- 172.21.15.106:0/4266474865 shutdown_connections 2024-08-17T02:28:39.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.506+0000 7fd2ca200640 1 --2- 172.21.15.106:0/4266474865 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd2c4156c60 0x7fd2c4153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:39.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.506+0000 7fd2ca200640 1 --2- 172.21.15.106:0/4266474865 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd2a0065150 0x7fd2a0067600 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:39.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.506+0000 7fd2ca200640 1 --2- 172.21.15.106:0/4266474865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2c4156890 0x7fd2c41422f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:39.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.506+0000 7fd2ca200640 1 --2- 172.21.15.106:0/4266474865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd2c40c8130 0x7fd2c41581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:39.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.506+0000 7fd2ca200640 1 -- 172.21.15.106:0/4266474865 >> 172.21.15.106:0/4266474865 conn(0x7fd2c4067750 msgr2=0x7fd2c4069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:39.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.507+0000 7fd2ca200640 1 -- 172.21.15.106:0/4266474865 shutdown_connections 2024-08-17T02:28:39.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.507+0000 7fd2ca200640 1 -- 172.21.15.106:0/4266474865 wait complete. 2024-08-17T02:28:39.531 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:28:39.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.681+0000 7f4819800640 1 Processor -- start 2024-08-17T02:28:39.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.681+0000 7f4819800640 1 -- start start 2024-08-17T02:28:39.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.682+0000 7f4819800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f4814159170 0x7f48140ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:39.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.682+0000 7f4819800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48140aaf20 0x7f48140ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:39.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.682+0000 7f4819800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48140681f0 con 0x7f4814158da0 2024-08-17T02:28:39.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.682+0000 7f4819800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48140b08c0 con 0x7f4814159170 2024-08-17T02:28:39.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.682+0000 7f4819800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48140aca00 con 0x7f48140aaf20 2024-08-17T02:28:39.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.682+0000 7f4812a00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f4814158da0 0x7f48140aa810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:60564/0 (socket says 172.21.15.106:60564) 2024-08-17T02:28:39.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.682+0000 7f4812a00640 1 -- 172.21.15.106:0/3395112242 learned_addr learned my addr 172.21.15.106:0/3395112242 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:39.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.683+0000 7f4813400640 1 --2- 172.21.15.106:0/3395112242 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48140aaf20 0x7f48140ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:39.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.683+0000 7f4812000640 1 --2- 172.21.15.106:0/3395112242 >> v2:172.21.15.171:3300/0 conn(0x7f4814159170 0x7f48140ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:39.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.683+0000 7f4811600640 1 -- 172.21.15.106:0/3395112242 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193683236 0 0) 0x7f48140681f0 con 0x7f4814158da0 2024-08-17T02:28:39.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.683+0000 7f4811600640 1 -- 172.21.15.106:0/3395112242 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47f80034e0 con 0x7f4814158da0 2024-08-17T02:28:39.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.683+0000 7f4811600640 1 -- 172.21.15.106:0/3395112242 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3774556856 0 0) 0x7f47f80034e0 con 0x7f4814158da0 2024-08-17T02:28:39.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.683+0000 7f4811600640 1 -- 172.21.15.106:0/3395112242 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48140aaf20 msgr2=0x7f48140ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:39.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.683+0000 7f4811600640 1 --2- 172.21.15.106:0/3395112242 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48140aaf20 0x7f48140ae7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:39.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.683+0000 7f4811600640 1 -- 172.21.15.106:0/3395112242 >> v2:172.21.15.171:3300/0 conn(0x7f4814159170 msgr2=0x7f48140ac3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:39.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.683+0000 7f4811600640 1 --2- 172.21.15.106:0/3395112242 >> v2:172.21.15.171:3300/0 conn(0x7f4814159170 0x7f48140ac3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:39.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.683+0000 7f4811600640 1 -- 172.21.15.106:0/3395112242 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48140acce0 con 0x7f4814158da0 2024-08-17T02:28:39.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.683+0000 7f4811600640 1 -- 172.21.15.106:0/3395112242 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7f4804001470 con 0x7f4814158da0 2024-08-17T02:28:39.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.683+0000 7f4813400640 1 --2- 172.21.15.106:0/3395112242 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48140aaf20 0x7f48140ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:39.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.683+0000 7f4811600640 1 -- 172.21.15.106:0/3395112242 >> v1:172.21.15.106:6789/0 conn(0x7f4814158da0 legacy=0x7f48140aa810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:39.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.683+0000 7f4811600640 1 --2- 172.21.15.106:0/3395112242 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47f80039d0 0x7f47f8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:39.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.683+0000 7f4811600640 1 --2- 172.21.15.106:0/3395112242 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48140aaf20 0x7f47f8004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:39.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.683+0000 7f4811600640 1 --2- 172.21.15.106:0/3395112242 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47f8004cc0 0x7f47f8005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:39.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.683+0000 7f4811600640 1 -- 172.21.15.106:0/3395112242 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48140b08c0 con 0x7f47f80039d0 2024-08-17T02:28:39.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.683+0000 7f4811600640 1 -- 172.21.15.106:0/3395112242 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48140aca00 con 0x7f47f8004cc0 2024-08-17T02:28:39.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.683+0000 7f4811600640 1 -- 172.21.15.106:0/3395112242 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f800b9d0 con 0x7f48140aaf20 2024-08-17T02:28:39.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.684+0000 7f4812a00640 1 --2- 172.21.15.106:0/3395112242 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47f80039d0 0x7f47f8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:39.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.684+0000 7f4812000640 1 --2- 172.21.15.106:0/3395112242 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48140aaf20 0x7f47f8004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:39.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.684+0000 7f4813400640 1 --2- 172.21.15.106:0/3395112242 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47f8004cc0 0x7f47f8005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:39.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.684+0000 7f4812a00640 1 -- 172.21.15.106:0/3395112242 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48140aaf20 msgr2=0x7f47f8004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:39.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.684+0000 7f4812a00640 1 --2- 172.21.15.106:0/3395112242 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f48140aaf20 0x7f47f8004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:39.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.684+0000 7f4812a00640 1 -- 172.21.15.106:0/3395112242 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47f8004cc0 msgr2=0x7f47f8005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:39.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.684+0000 7f4812a00640 1 --2- 172.21.15.106:0/3395112242 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47f8004cc0 0x7f47f8005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:39.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.684+0000 7f4812a00640 1 -- 172.21.15.106:0/3395112242 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480c009a20 con 0x7f47f80039d0 2024-08-17T02:28:39.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.684+0000 7f4813400640 1 --2- 172.21.15.106:0/3395112242 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47f8004cc0 0x7f47f8005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:39.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.685+0000 7f4812a00640 1 --2- 172.21.15.106:0/3395112242 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47f80039d0 0x7f47f8003de0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f480400c2a0 tx=0x7f481406db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d7b63a489cae92 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:39.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.685+0000 7f4811600640 1 -- 172.21.15.106:0/3395112242 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804005890 con 0x7f47f80039d0 2024-08-17T02:28:39.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.685+0000 7f4811600640 1 -- 172.21.15.106:0/3395112242 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4804005a30 con 0x7f47f80039d0 2024-08-17T02:28:39.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.685+0000 7f4811600640 1 -- 172.21.15.106:0/3395112242 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804005e30 con 0x7f47f80039d0 2024-08-17T02:28:39.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.686+0000 7f4819800640 1 -- 172.21.15.106:0/3395112242 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47f80039d0 msgr2=0x7f47f8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:39.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.686+0000 7f4819800640 1 --2- 172.21.15.106:0/3395112242 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47f80039d0 0x7f47f8003de0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f480400c2a0 tx=0x7f481406db90 comp rx=0 tx=0).stop 2024-08-17T02:28:39.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.686+0000 7f4813400640 1 -- 172.21.15.106:0/3395112242 reap_dead start 2024-08-17T02:28:39.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.686+0000 7f4819800640 1 -- 172.21.15.106:0/3395112242 shutdown_connections 2024-08-17T02:28:39.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.686+0000 7f4819800640 1 -- 172.21.15.106:0/3395112242 >> 172.21.15.106:0/3395112242 conn(0x7f4814096a70 msgr2=0x7f4814096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:39.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.686+0000 7f4819800640 1 -- 172.21.15.106:0/3395112242 shutdown_connections 2024-08-17T02:28:39.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.686+0000 7f4819800640 1 -- 172.21.15.106:0/3395112242 wait complete. 2024-08-17T02:28:39.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.687+0000 7f4819800640 1 Processor -- start 2024-08-17T02:28:39.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.687+0000 7f4819800640 1 -- start start 2024-08-17T02:28:39.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.688+0000 7f4819800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47f80039d0 0x7f48140c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:39.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.688+0000 7f4819800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4814155a10 0x7f481415b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:39.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.688+0000 7f4819800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f481415b580 0x7f4814168e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:39.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.688+0000 7f4819800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48140c7890 con 0x7f47f80039d0 2024-08-17T02:28:39.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.688+0000 7f4819800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481415abb0 con 0x7f481415b580 2024-08-17T02:28:39.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.688+0000 7f4819800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481415cd50 con 0x7f4814155a10 2024-08-17T02:28:39.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.689+0000 7f4812a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47f80039d0 0x7f48140c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:39.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.689+0000 7f4812a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47f80039d0 0x7f48140c7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:51676/0 (socket says 172.21.15.106:51676) 2024-08-17T02:28:39.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.689+0000 7f4812a00640 1 -- 172.21.15.106:0/1174466859 learned_addr learned my addr 172.21.15.106:0/1174466859 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:39.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.689+0000 7f4813400640 1 --2- 172.21.15.106:0/1174466859 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f481415b580 0x7f4814168e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:39.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.689+0000 7f4812000640 1 --2- 172.21.15.106:0/1174466859 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4814155a10 0x7f481415b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:39.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.689+0000 7f4812a00640 1 -- 172.21.15.106:0/1174466859 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4814155a10 msgr2=0x7f481415b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:39.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.689+0000 7f4812a00640 1 --2- 172.21.15.106:0/1174466859 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4814155a10 0x7f481415b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:39.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.689+0000 7f4812a00640 1 -- 172.21.15.106:0/1174466859 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f481415b580 msgr2=0x7f4814168e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:39.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.689+0000 7f4812a00640 1 --2- 172.21.15.106:0/1174466859 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f481415b580 0x7f4814168e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:39.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.689+0000 7f4812a00640 1 -- 172.21.15.106:0/1174466859 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481415c790 con 0x7f47f80039d0 2024-08-17T02:28:39.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.689+0000 7f4812a00640 1 --2- 172.21.15.106:0/1174466859 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47f80039d0 0x7f48140c7350 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4804007c40 tx=0x7f4804034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:39.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.690+0000 7f480a000640 1 -- 172.21.15.106:0/1174466859 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804005ba0 con 0x7f47f80039d0 2024-08-17T02:28:39.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.690+0000 7f480a000640 1 -- 172.21.15.106:0/1174466859 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4804005d00 con 0x7f47f80039d0 2024-08-17T02:28:39.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.690+0000 7f480a000640 1 -- 172.21.15.106:0/1174466859 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804007530 con 0x7f47f80039d0 2024-08-17T02:28:39.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.690+0000 7f4819800640 1 -- 172.21.15.106:0/1174466859 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f481415ca70 con 0x7f47f80039d0 2024-08-17T02:28:39.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.690+0000 7f4819800640 1 -- 172.21.15.106:0/1174466859 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4814155e80 con 0x7f47f80039d0 2024-08-17T02:28:39.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.691+0000 7f4819800640 1 -- 172.21.15.106:0/1174466859 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4814071050 con 0x7f47f80039d0 2024-08-17T02:28:39.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.692+0000 7f480a000640 1 -- 172.21.15.106:0/1174466859 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4804038030 con 0x7f47f80039d0 2024-08-17T02:28:39.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.693+0000 7f480a000640 1 --2- 172.21.15.106:0/1174466859 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f47f4065150 0x7f47f4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:39.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.693+0000 7f480a000640 1 -- 172.21.15.106:0/1174466859 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f48040a2e60 con 0x7f47f80039d0 2024-08-17T02:28:39.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.693+0000 7f4812000640 1 --2- 172.21.15.106:0/1174466859 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f47f4065150 0x7f47f4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:39.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.694+0000 7f4812000640 1 --2- 172.21.15.106:0/1174466859 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f47f4065150 0x7f47f4067600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f481406bf00 tx=0x7f48000090f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:39.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.697+0000 7f480a000640 1 -- 172.21.15.106:0/1174466859 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4804071010 con 0x7f47f80039d0 2024-08-17T02:28:39.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:39.906+0000 7f4819800640 1 -- 172.21.15.106:0/1174466859 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f481406bc50 con 0x7f47f80039d0 2024-08-17T02:28:40.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.522+0000 7f480a000640 1 -- 172.21.15.106:0/1174466859 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4804074630 con 0x7f47f80039d0 2024-08-17T02:28:40.523 INFO:teuthology.orchestra.run.smithi106.stderr:new fs with metadata pool 4 and data pool 5 2024-08-17T02:28:40.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.532+0000 7f4819800640 1 -- 172.21.15.106:0/1174466859 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f47f4065150 msgr2=0x7f47f4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:40.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.532+0000 7f4819800640 1 --2- 172.21.15.106:0/1174466859 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f47f4065150 0x7f47f4067600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f481406bf00 tx=0x7f48000090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.532+0000 7f4819800640 1 -- 172.21.15.106:0/1174466859 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47f80039d0 msgr2=0x7f48140c7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:40.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.532+0000 7f4819800640 1 --2- 172.21.15.106:0/1174466859 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47f80039d0 0x7f48140c7350 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4804007c40 tx=0x7f4804034000 comp rx=0 tx=0).stop 2024-08-17T02:28:40.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.532+0000 7f4819800640 1 -- 172.21.15.106:0/1174466859 shutdown_connections 2024-08-17T02:28:40.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.532+0000 7f4819800640 1 --2- 172.21.15.106:0/1174466859 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f481415b580 0x7f4814168e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.532+0000 7f4819800640 1 --2- 172.21.15.106:0/1174466859 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4814155a10 0x7f481415b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.532+0000 7f4819800640 1 --2- 172.21.15.106:0/1174466859 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f47f4065150 0x7f47f4067600 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.532+0000 7f4819800640 1 --2- 172.21.15.106:0/1174466859 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47f80039d0 0x7f48140c7350 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.532+0000 7f4819800640 1 -- 172.21.15.106:0/1174466859 >> 172.21.15.106:0/1174466859 conn(0x7f4814096a70 msgr2=0x7f481406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:40.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.532+0000 7f4819800640 1 -- 172.21.15.106:0/1174466859 shutdown_connections 2024-08-17T02:28:40.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.532+0000 7f4819800640 1 -- 172.21.15.106:0/1174466859 wait complete. 2024-08-17T02:28:40.559 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:40.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.708+0000 7f9c63e00640 1 Processor -- start 2024-08-17T02:28:40.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.708+0000 7f9c63e00640 1 -- start start 2024-08-17T02:28:40.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.709+0000 7f9c63e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9c640ceb40 0x7f9c640cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:40.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.709+0000 7f9c63e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c640ccf30 con 0x7f9c64159ca0 2024-08-17T02:28:40.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.709+0000 7f9c63e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c640cadc0 con 0x7f9c640ccad0 2024-08-17T02:28:40.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.709+0000 7f9c63e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c640cd6e0 con 0x7f9c640ceb40 2024-08-17T02:28:40.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.709+0000 7f9c62a00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f9c64159ca0 0x7f9c640ca360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:52024/0 (socket says 172.21.15.106:52024) 2024-08-17T02:28:40.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.709+0000 7f9c62a00640 1 -- 172.21.15.106:0/3267279899 learned_addr learned my addr 172.21.15.106:0/3267279899 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:40.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.709+0000 7f9c62000640 1 --2- 172.21.15.106:0/3267279899 >> v2:172.21.15.106:3300/0 conn(0x7f9c640ceb40 0x7f9c640cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:40.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.710+0000 7f9c61600640 1 -- 172.21.15.106:0/3267279899 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2900249459 0 0) 0x7f9c640ccf30 con 0x7f9c64159ca0 2024-08-17T02:28:40.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.710+0000 7f9c61600640 1 -- 172.21.15.106:0/3267279899 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c480034e0 con 0x7f9c64159ca0 2024-08-17T02:28:40.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.710+0000 7f9c62000640 1 -- 172.21.15.106:0/3267279899 >> v1:172.21.15.171:6789/0 conn(0x7f9c640ccad0 legacy=0x7f9c64162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:40.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.710+0000 7f9c62000640 1 -- 172.21.15.106:0/3267279899 >> v1:172.21.15.106:6789/0 conn(0x7f9c64159ca0 legacy=0x7f9c640ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:40.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.710+0000 7f9c62000640 1 -- 172.21.15.106:0/3267279899 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c640cb060 con 0x7f9c640ceb40 2024-08-17T02:28:40.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.711+0000 7f9c62000640 1 --2- 172.21.15.106:0/3267279899 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c640ceb40 0x7f9c640cc590 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9c50009850 tx=0x7f9c500090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff56833e942f0543 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:40.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.711+0000 7f9c61600640 1 -- 172.21.15.106:0/3267279899 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5002ae20 con 0x7f9c640ceb40 2024-08-17T02:28:40.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.711+0000 7f9c61600640 1 -- 172.21.15.106:0/3267279899 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c50032440 con 0x7f9c640ceb40 2024-08-17T02:28:40.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.711+0000 7f9c61600640 1 -- 172.21.15.106:0/3267279899 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c500327e0 con 0x7f9c640ceb40 2024-08-17T02:28:40.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.712+0000 7f9c63e00640 1 -- 172.21.15.106:0/3267279899 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c640ceb40 msgr2=0x7f9c640cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:40.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.712+0000 7f9c63e00640 1 --2- 172.21.15.106:0/3267279899 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c640ceb40 0x7f9c640cc590 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9c50009850 tx=0x7f9c500090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.712+0000 7f9c63e00640 1 -- 172.21.15.106:0/3267279899 shutdown_connections 2024-08-17T02:28:40.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.712+0000 7f9c63e00640 1 --2- 172.21.15.106:0/3267279899 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c640ceb40 0x7f9c640cc590 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.712+0000 7f9c63e00640 1 -- 172.21.15.106:0/3267279899 >> 172.21.15.106:0/3267279899 conn(0x7f9c64098e00 msgr2=0x7f9c6406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:40.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.712+0000 7f9c63e00640 1 -- 172.21.15.106:0/3267279899 shutdown_connections 2024-08-17T02:28:40.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.712+0000 7f9c63e00640 1 -- 172.21.15.106:0/3267279899 wait complete. 2024-08-17T02:28:40.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.713+0000 7f9c63e00640 1 Processor -- start 2024-08-17T02:28:40.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.713+0000 7f9c63e00640 1 -- start start 2024-08-17T02:28:40.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.714+0000 7f9c63e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c640ccad0 0x7f9c64154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:40.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.714+0000 7f9c63e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c640ceb40 0x7f9c640c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:40.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.714+0000 7f9c63e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c64159ca0 0x7f9c640ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:40.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.714+0000 7f9c63e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c64154d40 con 0x7f9c64159ca0 2024-08-17T02:28:40.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.714+0000 7f9c63e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c640c8760 con 0x7f9c640ccad0 2024-08-17T02:28:40.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.714+0000 7f9c63e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c640c92e0 con 0x7f9c640ceb40 2024-08-17T02:28:40.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.714+0000 7f9c63400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c64159ca0 0x7f9c640ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:40.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.715+0000 7f9c62a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c640ccad0 0x7f9c64154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:40.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.715+0000 7f9c63400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c64159ca0 0x7f9c640ca110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59792/0 (socket says 172.21.15.106:59792) 2024-08-17T02:28:40.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.715+0000 7f9c63400640 1 -- 172.21.15.106:0/1590014175 learned_addr learned my addr 172.21.15.106:0/1590014175 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:40.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.715+0000 7f9c62000640 1 --2- 172.21.15.106:0/1590014175 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c640ceb40 0x7f9c640c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:40.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.715+0000 7f9c63400640 1 -- 172.21.15.106:0/1590014175 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c640ceb40 msgr2=0x7f9c640c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:40.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.715+0000 7f9c63400640 1 --2- 172.21.15.106:0/1590014175 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c640ceb40 0x7f9c640c7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.715+0000 7f9c63400640 1 -- 172.21.15.106:0/1590014175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c640ccad0 msgr2=0x7f9c64154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:40.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.715+0000 7f9c63400640 1 --2- 172.21.15.106:0/1590014175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c640ccad0 0x7f9c64154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.715+0000 7f9c63400640 1 -- 172.21.15.106:0/1590014175 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c50009390 con 0x7f9c64159ca0 2024-08-17T02:28:40.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.715+0000 7f9c63400640 1 --2- 172.21.15.106:0/1590014175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c64159ca0 0x7f9c640ca110 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00c890 tx=0x7f9c5c001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:40.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.715+0000 7f9c5a000640 1 -- 172.21.15.106:0/1590014175 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c00ce80 con 0x7f9c64159ca0 2024-08-17T02:28:40.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.715+0000 7f9c5a000640 1 -- 172.21.15.106:0/1590014175 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5c00a850 con 0x7f9c64159ca0 2024-08-17T02:28:40.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.715+0000 7f9c5a000640 1 -- 172.21.15.106:0/1590014175 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c00ac10 con 0x7f9c64159ca0 2024-08-17T02:28:40.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.716+0000 7f9c63e00640 1 -- 172.21.15.106:0/1590014175 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c640c7ac0 con 0x7f9c64159ca0 2024-08-17T02:28:40.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.716+0000 7f9c63e00640 1 -- 172.21.15.106:0/1590014175 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c640c8c90 con 0x7f9c64159ca0 2024-08-17T02:28:40.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.717+0000 7f9c63e00640 1 -- 172.21.15.106:0/1590014175 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c64071050 con 0x7f9c64159ca0 2024-08-17T02:28:40.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.717+0000 7f9c5a000640 1 -- 172.21.15.106:0/1590014175 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9c5c003030 con 0x7f9c64159ca0 2024-08-17T02:28:40.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.718+0000 7f9c5a000640 1 --2- 172.21.15.106:0/1590014175 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9c44065150 0x7f9c44067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:40.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.718+0000 7f9c5a000640 1 -- 172.21.15.106:0/1590014175 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9c5c0822f0 con 0x7f9c64159ca0 2024-08-17T02:28:40.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.718+0000 7f9c62a00640 1 --2- 172.21.15.106:0/1590014175 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9c44065150 0x7f9c44067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:40.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.719+0000 7f9c62a00640 1 --2- 172.21.15.106:0/1590014175 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9c44065150 0x7f9c44067600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9c54001200 tx=0x7f9c54009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:40.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.722+0000 7f9c5a000640 1 -- 172.21.15.106:0/1590014175 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9c5c050460 con 0x7f9c64159ca0 2024-08-17T02:28:40.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.898+0000 7f9c63e00640 1 -- 172.21.15.106:0/1590014175 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c64070430 con 0x7f9c64159ca0 2024-08-17T02:28:40.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.899+0000 7f9c5a000640 1 -- 172.21.15.106:0/1590014175 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f9c5c053a80 con 0x7f9c64159ca0 2024-08-17T02:28:40.899 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:40.899 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":31,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:28:39.907944+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:37.880632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:38.897913+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:40.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.901+0000 7f9c63e00640 1 -- 172.21.15.106:0/1590014175 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9c44065150 msgr2=0x7f9c44067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:40.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.901+0000 7f9c63e00640 1 --2- 172.21.15.106:0/1590014175 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9c44065150 0x7f9c44067600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9c54001200 tx=0x7f9c54009040 comp rx=0 tx=0).stop 2024-08-17T02:28:40.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.901+0000 7f9c63e00640 1 -- 172.21.15.106:0/1590014175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c64159ca0 msgr2=0x7f9c640ca110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:40.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.901+0000 7f9c63e00640 1 --2- 172.21.15.106:0/1590014175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c64159ca0 0x7f9c640ca110 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00c890 tx=0x7f9c5c001690 comp rx=0 tx=0).stop 2024-08-17T02:28:40.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.901+0000 7f9c63e00640 1 -- 172.21.15.106:0/1590014175 shutdown_connections 2024-08-17T02:28:40.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.901+0000 7f9c63e00640 1 --2- 172.21.15.106:0/1590014175 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9c44065150 0x7f9c44067600 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.901+0000 7f9c63e00640 1 --2- 172.21.15.106:0/1590014175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c64159ca0 0x7f9c640ca110 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.901+0000 7f9c63e00640 1 --2- 172.21.15.106:0/1590014175 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9c640ceb40 0x7f9c640c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.901+0000 7f9c63e00640 1 --2- 172.21.15.106:0/1590014175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c640ccad0 0x7f9c64154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.901+0000 7f9c63e00640 1 -- 172.21.15.106:0/1590014175 >> 172.21.15.106:0/1590014175 conn(0x7f9c64098e00 msgr2=0x7f9c64156f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:40.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.901+0000 7f9c63e00640 1 -- 172.21.15.106:0/1590014175 shutdown_connections 2024-08-17T02:28:40.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:40.901+0000 7f9c63e00640 1 -- 172.21.15.106:0/1590014175 wait complete. 2024-08-17T02:28:40.918 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:41.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.064+0000 7fde61200640 1 Processor -- start 2024-08-17T02:28:41.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.064+0000 7fde61200640 1 -- start start 2024-08-17T02:28:41.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.065+0000 7fde61200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fde5c0ceb40 0x7fde5c0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:41.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.065+0000 7fde61200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5c0ccf30 con 0x7fde5c0ccad0 2024-08-17T02:28:41.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.065+0000 7fde61200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5c0cadc0 con 0x7fde5c159ca0 2024-08-17T02:28:41.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.065+0000 7fde61200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5c0cd6e0 con 0x7fde5c0ceb40 2024-08-17T02:28:41.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.065+0000 7fde5be00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fde5c0ccad0 0x7fde5c162860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:52026/0 (socket says 172.21.15.106:52026) 2024-08-17T02:28:41.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.065+0000 7fde5be00640 1 -- 172.21.15.106:0/2988420385 learned_addr learned my addr 172.21.15.106:0/2988420385 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:41.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.065+0000 7fde5b400640 1 --1- 172.21.15.106:0/2988420385 >> v1:172.21.15.171:6789/0 conn(0x7fde5c159ca0 0x7fde5c0ca360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:46578/0 (socket says 172.21.15.106:46578) 2024-08-17T02:28:41.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.065+0000 7fde5aa00640 1 --2- 172.21.15.106:0/2988420385 >> v2:172.21.15.171:3300/0 conn(0x7fde5c0ceb40 0x7fde5c0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:41.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.066+0000 7fde5a000640 1 -- 172.21.15.106:0/2988420385 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426673590 0 0) 0x7fde5c0cadc0 con 0x7fde5c159ca0 2024-08-17T02:28:41.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.066+0000 7fde5a000640 1 -- 172.21.15.106:0/2988420385 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde400034e0 con 0x7fde5c159ca0 2024-08-17T02:28:41.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.066+0000 7fde5a000640 1 -- 172.21.15.106:0/2988420385 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192989126 0 0) 0x7fde5c0ccf30 con 0x7fde5c0ccad0 2024-08-17T02:28:41.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.066+0000 7fde5a000640 1 -- 172.21.15.106:0/2988420385 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde5c0cadc0 con 0x7fde5c0ccad0 2024-08-17T02:28:41.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.066+0000 7fde5aa00640 1 -- 172.21.15.106:0/2988420385 >> v1:172.21.15.171:6789/0 conn(0x7fde5c159ca0 legacy=0x7fde5c0ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.066+0000 7fde5aa00640 1 -- 172.21.15.106:0/2988420385 >> v1:172.21.15.106:6789/0 conn(0x7fde5c0ccad0 legacy=0x7fde5c162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.066+0000 7fde5aa00640 1 -- 172.21.15.106:0/2988420385 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c0cb060 con 0x7fde5c0ceb40 2024-08-17T02:28:41.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.067+0000 7fde5aa00640 1 --2- 172.21.15.106:0/2988420385 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde5c0ceb40 0x7fde5c0cc590 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fde48009850 tx=0x7fde480090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9db8f4c13cf2265 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:41.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.067+0000 7fde5a000640 1 -- 172.21.15.106:0/2988420385 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4802ae20 con 0x7fde5c0ceb40 2024-08-17T02:28:41.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.067+0000 7fde5a000640 1 -- 172.21.15.106:0/2988420385 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde48032440 con 0x7fde5c0ceb40 2024-08-17T02:28:41.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.067+0000 7fde5a000640 1 -- 172.21.15.106:0/2988420385 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde480327c0 con 0x7fde5c0ceb40 2024-08-17T02:28:41.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.068+0000 7fde61200640 1 -- 172.21.15.106:0/2988420385 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde5c0ceb40 msgr2=0x7fde5c0cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.068+0000 7fde61200640 1 --2- 172.21.15.106:0/2988420385 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde5c0ceb40 0x7fde5c0cc590 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fde48009850 tx=0x7fde480090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.068+0000 7fde61200640 1 -- 172.21.15.106:0/2988420385 shutdown_connections 2024-08-17T02:28:41.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.068+0000 7fde61200640 1 --2- 172.21.15.106:0/2988420385 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde5c0ceb40 0x7fde5c0cc590 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.068+0000 7fde61200640 1 -- 172.21.15.106:0/2988420385 >> 172.21.15.106:0/2988420385 conn(0x7fde5c098e00 msgr2=0x7fde5c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:41.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.068+0000 7fde61200640 1 -- 172.21.15.106:0/2988420385 shutdown_connections 2024-08-17T02:28:41.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.068+0000 7fde61200640 1 -- 172.21.15.106:0/2988420385 wait complete. 2024-08-17T02:28:41.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.069+0000 7fde61200640 1 Processor -- start 2024-08-17T02:28:41.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.069+0000 7fde61200640 1 -- start start 2024-08-17T02:28:41.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.070+0000 7fde61200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde5c0ccad0 0x7fde5c0c5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:41.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.070+0000 7fde61200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde5c0ceb40 0x7fde5c168ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:41.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.070+0000 7fde61200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde5c159ca0 0x7fde5c14a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:41.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.070+0000 7fde61200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c1498b0 con 0x7fde5c0ccad0 2024-08-17T02:28:41.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.070+0000 7fde61200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c14be40 con 0x7fde5c159ca0 2024-08-17T02:28:41.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.070+0000 7fde61200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c14b230 con 0x7fde5c0ceb40 2024-08-17T02:28:41.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.070+0000 7fde5b400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde5c0ccad0 0x7fde5c0c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:41.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.071+0000 7fde5b400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde5c0ccad0 0x7fde5c0c5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59796/0 (socket says 172.21.15.106:59796) 2024-08-17T02:28:41.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.071+0000 7fde5b400640 1 -- 172.21.15.106:0/3377761981 learned_addr learned my addr 172.21.15.106:0/3377761981 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:41.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.071+0000 7fde5be00640 1 --2- 172.21.15.106:0/3377761981 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde5c159ca0 0x7fde5c14a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:41.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.071+0000 7fde5aa00640 1 --2- 172.21.15.106:0/3377761981 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde5c0ceb40 0x7fde5c168ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:41.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.071+0000 7fde5b400640 1 -- 172.21.15.106:0/3377761981 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde5c0ceb40 msgr2=0x7fde5c168ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.071+0000 7fde5b400640 1 --2- 172.21.15.106:0/3377761981 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde5c0ceb40 0x7fde5c168ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.071+0000 7fde5b400640 1 -- 172.21.15.106:0/3377761981 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde5c159ca0 msgr2=0x7fde5c14a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.071+0000 7fde5b400640 1 --2- 172.21.15.106:0/3377761981 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde5c159ca0 0x7fde5c14a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.071+0000 7fde5b400640 1 -- 172.21.15.106:0/3377761981 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde48009390 con 0x7fde5c0ccad0 2024-08-17T02:28:41.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.071+0000 7fde5b400640 1 --2- 172.21.15.106:0/3377761981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde5c0ccad0 0x7fde5c0c5090 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fde4c00c590 tx=0x7fde4c007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:41.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.071+0000 7fde52a00640 1 -- 172.21.15.106:0/3377761981 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c0073b0 con 0x7fde5c0ccad0 2024-08-17T02:28:41.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.072+0000 7fde52a00640 1 -- 172.21.15.106:0/3377761981 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4c007530 con 0x7fde5c0ccad0 2024-08-17T02:28:41.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.072+0000 7fde52a00640 1 -- 172.21.15.106:0/3377761981 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c0049f0 con 0x7fde5c0ccad0 2024-08-17T02:28:41.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.072+0000 7fde61200640 1 -- 172.21.15.106:0/3377761981 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5c14b510 con 0x7fde5c0ccad0 2024-08-17T02:28:41.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.072+0000 7fde61200640 1 -- 172.21.15.106:0/3377761981 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5c14bad0 con 0x7fde5c0ccad0 2024-08-17T02:28:41.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.073+0000 7fde61200640 1 -- 172.21.15.106:0/3377761981 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5c071050 con 0x7fde5c0ccad0 2024-08-17T02:28:41.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.073+0000 7fde52a00640 1 -- 172.21.15.106:0/3377761981 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fde4c013400 con 0x7fde5c0ccad0 2024-08-17T02:28:41.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.074+0000 7fde52a00640 1 --2- 172.21.15.106:0/3377761981 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fde3c065150 0x7fde3c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:41.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.074+0000 7fde52a00640 1 -- 172.21.15.106:0/3377761981 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fde4c081ce0 con 0x7fde5c0ccad0 2024-08-17T02:28:41.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.074+0000 7fde5aa00640 1 --2- 172.21.15.106:0/3377761981 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fde3c065150 0x7fde3c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:41.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.075+0000 7fde5aa00640 1 --2- 172.21.15.106:0/3377761981 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fde3c065150 0x7fde3c067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fde48034000 tx=0x7fde48032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:41.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.078+0000 7fde52a00640 1 -- 172.21.15.106:0/3377761981 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fde4c04fdb0 con 0x7fde5c0ccad0 2024-08-17T02:28:41.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.249+0000 7fde61200640 1 -- 172.21.15.106:0/3377761981 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde5c0650a0 con 0x7fde5c0ccad0 2024-08-17T02:28:41.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.250+0000 7fde52a00640 1 -- 172.21.15.106:0/3377761981 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15411 (secure 0 0 0) 0x7fde4c0533d0 con 0x7fde5c0ccad0 2024-08-17T02:28:41.250 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:41.250 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":31,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:28:39.907944+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:37.880632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:38.897913+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:41.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.252+0000 7fde61200640 1 -- 172.21.15.106:0/3377761981 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fde3c065150 msgr2=0x7fde3c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.252+0000 7fde61200640 1 --2- 172.21.15.106:0/3377761981 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fde3c065150 0x7fde3c067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fde48034000 tx=0x7fde48032000 comp rx=0 tx=0).stop 2024-08-17T02:28:41.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.252+0000 7fde61200640 1 -- 172.21.15.106:0/3377761981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde5c0ccad0 msgr2=0x7fde5c0c5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.252+0000 7fde61200640 1 --2- 172.21.15.106:0/3377761981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde5c0ccad0 0x7fde5c0c5090 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fde4c00c590 tx=0x7fde4c007d90 comp rx=0 tx=0).stop 2024-08-17T02:28:41.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.252+0000 7fde61200640 1 -- 172.21.15.106:0/3377761981 shutdown_connections 2024-08-17T02:28:41.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.252+0000 7fde61200640 1 --2- 172.21.15.106:0/3377761981 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde5c159ca0 0x7fde5c14a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.252+0000 7fde61200640 1 --2- 172.21.15.106:0/3377761981 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde5c0ceb40 0x7fde5c168ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.252+0000 7fde61200640 1 --2- 172.21.15.106:0/3377761981 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fde3c065150 0x7fde3c067600 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.252+0000 7fde61200640 1 --2- 172.21.15.106:0/3377761981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde5c0ccad0 0x7fde5c0c5090 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.252+0000 7fde61200640 1 -- 172.21.15.106:0/3377761981 >> 172.21.15.106:0/3377761981 conn(0x7fde5c098e00 msgr2=0x7fde5c156120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:41.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.252+0000 7fde61200640 1 -- 172.21.15.106:0/3377761981 shutdown_connections 2024-08-17T02:28:41.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.252+0000 7fde61200640 1 -- 172.21.15.106:0/3377761981 wait complete. 2024-08-17T02:28:41.268 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:28:41.336 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:41.340 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:41.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.421+0000 7fdb77400640 1 Processor -- start 2024-08-17T02:28:41.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.421+0000 7fdb77400640 1 -- start start 2024-08-17T02:28:41.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.422+0000 7fdb77400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdb70156c50 0x7fdb700c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:41.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.422+0000 7fdb77400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb700ab130 con 0x7fdb700adcf0 2024-08-17T02:28:41.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.422+0000 7fdb77400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb700ae5a0 con 0x7fdb700c8bd0 2024-08-17T02:28:41.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.422+0000 7fdb77400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb700ae2c0 con 0x7fdb70156c50 2024-08-17T02:28:41.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.422+0000 7fdb74a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdb70156c50 0x7fdb700c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:41.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.422+0000 7fdb6fe00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fdb700adcf0 0x7fdb700ab5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:52032/0 (socket says 172.21.15.106:52032) 2024-08-17T02:28:41.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.422+0000 7fdb74a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdb70156c50 0x7fdb700c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59802/0 (socket says 172.21.15.106:59802) 2024-08-17T02:28:41.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.422+0000 7fdb6fe00640 1 -- 172.21.15.106:0/2250417233 learned_addr learned my addr 172.21.15.106:0/2250417233 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:41.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.423+0000 7fdb74a00640 1 -- 172.21.15.106:0/2250417233 >> v1:172.21.15.171:6789/0 conn(0x7fdb700c8bd0 legacy=0x7fdb700c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.423+0000 7fdb74a00640 1 -- 172.21.15.106:0/2250417233 >> v1:172.21.15.106:6789/0 conn(0x7fdb700adcf0 legacy=0x7fdb700ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.423+0000 7fdb74a00640 1 -- 172.21.15.106:0/2250417233 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb700aaae0 con 0x7fdb70156c50 2024-08-17T02:28:41.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.423+0000 7fdb6f400640 1 -- 172.21.15.106:0/2250417233 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3176982146 0 0) 0x7fdb700ab130 con 0x7fdb700adcf0 2024-08-17T02:28:41.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.424+0000 7fdb74a00640 1 --2- 172.21.15.106:0/2250417233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb70156c50 0x7fdb700c7cf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdb64009850 tx=0x7fdb640090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc4482341a9711c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:41.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.424+0000 7fdb6f400640 1 -- 172.21.15.106:0/2250417233 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6402ad00 con 0x7fdb70156c50 2024-08-17T02:28:41.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.424+0000 7fdb6f400640 1 -- 172.21.15.106:0/2250417233 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6402ae60 con 0x7fdb70156c50 2024-08-17T02:28:41.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.424+0000 7fdb6f400640 1 -- 172.21.15.106:0/2250417233 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb64032670 con 0x7fdb70156c50 2024-08-17T02:28:41.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.425+0000 7fdb77400640 1 -- 172.21.15.106:0/2250417233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb70156c50 msgr2=0x7fdb700c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.425+0000 7fdb77400640 1 --2- 172.21.15.106:0/2250417233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb70156c50 0x7fdb700c7cf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdb64009850 tx=0x7fdb640090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.425+0000 7fdb77400640 1 -- 172.21.15.106:0/2250417233 shutdown_connections 2024-08-17T02:28:41.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.425+0000 7fdb77400640 1 --2- 172.21.15.106:0/2250417233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb70156c50 0x7fdb700c7cf0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.425+0000 7fdb77400640 1 -- 172.21.15.106:0/2250417233 >> 172.21.15.106:0/2250417233 conn(0x7fdb70067750 msgr2=0x7fdb700c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:41.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.425+0000 7fdb77400640 1 -- 172.21.15.106:0/2250417233 shutdown_connections 2024-08-17T02:28:41.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.425+0000 7fdb77400640 1 -- 172.21.15.106:0/2250417233 wait complete. 2024-08-17T02:28:41.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.426+0000 7fdb77400640 1 Processor -- start 2024-08-17T02:28:41.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.426+0000 7fdb77400640 1 -- start start 2024-08-17T02:28:41.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.427+0000 7fdb77400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb700adcf0 0x7fdb700a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:41.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.427+0000 7fdb77400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb700c8bd0 0x7fdb70158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:41.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.427+0000 7fdb77400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdb70156c50 0x7fdb7013d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:41.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.427+0000 7fdb77400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb70167dd0 con 0x7fdb700c8bd0 2024-08-17T02:28:41.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.427+0000 7fdb77400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb70159300 con 0x7fdb700adcf0 2024-08-17T02:28:41.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.427+0000 7fdb77400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb70158a60 con 0x7fdb70156c50 2024-08-17T02:28:41.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.427+0000 7fdb6fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb700c8bd0 0x7fdb70158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:41.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.427+0000 7fdb6fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb700c8bd0 0x7fdb70158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59818/0 (socket says 172.21.15.106:59818) 2024-08-17T02:28:41.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.427+0000 7fdb6fe00640 1 -- 172.21.15.106:0/172100046 learned_addr learned my addr 172.21.15.106:0/172100046 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:41.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.428+0000 7fdb74a00640 1 --2- 172.21.15.106:0/172100046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb700adcf0 0x7fdb700a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:41.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.428+0000 7fdb6fe00640 1 -- 172.21.15.106:0/172100046 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdb70156c50 msgr2=0x7fdb7013d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.428+0000 7fdb6fe00640 1 --2- 172.21.15.106:0/172100046 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdb70156c50 0x7fdb7013d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.428+0000 7fdb6fe00640 1 -- 172.21.15.106:0/172100046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb700adcf0 msgr2=0x7fdb700a5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.428+0000 7fdb6fe00640 1 --2- 172.21.15.106:0/172100046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb700adcf0 0x7fdb700a5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.428+0000 7fdb6fe00640 1 -- 172.21.15.106:0/172100046 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb64009390 con 0x7fdb700c8bd0 2024-08-17T02:28:41.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.428+0000 7fdb6fe00640 1 --2- 172.21.15.106:0/172100046 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb700c8bd0 0x7fdb70158200 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c00c610 tx=0x7fdb5c007d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:41.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.428+0000 7fdb63e00640 1 -- 172.21.15.106:0/172100046 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c005aa0 con 0x7fdb700c8bd0 2024-08-17T02:28:41.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.428+0000 7fdb63e00640 1 -- 172.21.15.106:0/172100046 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c005c00 con 0x7fdb700c8bd0 2024-08-17T02:28:41.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.428+0000 7fdb77400640 1 -- 172.21.15.106:0/172100046 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb70158d40 con 0x7fdb700c8bd0 2024-08-17T02:28:41.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.428+0000 7fdb63e00640 1 -- 172.21.15.106:0/172100046 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c0070f0 con 0x7fdb700c8bd0 2024-08-17T02:28:41.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.429+0000 7fdb77400640 1 -- 172.21.15.106:0/172100046 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb70158740 con 0x7fdb700c8bd0 2024-08-17T02:28:41.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.430+0000 7fdb77400640 1 -- 172.21.15.106:0/172100046 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb70167f40 con 0x7fdb700c8bd0 2024-08-17T02:28:41.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.430+0000 7fdb63e00640 1 -- 172.21.15.106:0/172100046 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdb5c007500 con 0x7fdb700c8bd0 2024-08-17T02:28:41.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.431+0000 7fdb63e00640 1 --2- 172.21.15.106:0/172100046 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fdb50065150 0x7fdb50067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:41.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.431+0000 7fdb63e00640 1 -- 172.21.15.106:0/172100046 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdb5c081e90 con 0x7fdb700c8bd0 2024-08-17T02:28:41.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.431+0000 7fdb74a00640 1 --2- 172.21.15.106:0/172100046 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fdb50065150 0x7fdb50067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:41.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.432+0000 7fdb74a00640 1 --2- 172.21.15.106:0/172100046 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fdb50065150 0x7fdb50067600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdb64034000 tx=0x7fdb64032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:41.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.435+0000 7fdb63e00640 1 -- 172.21.15.106:0/172100046 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdb70167f40 con 0x7fdb700c8bd0 2024-08-17T02:28:41.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:41.646+0000 7fdb77400640 1 -- 172.21.15.106:0/172100046 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdb70167f10 con 0x7fdb700c8bd0 2024-08-17T02:28:42.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.540+0000 7fdb63e00640 1 -- 172.21.15.106:0/172100046 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdb5c04ffd0 con 0x7fdb700c8bd0 2024-08-17T02:28:42.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.542+0000 7fdb77400640 1 -- 172.21.15.106:0/172100046 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fdb50065150 msgr2=0x7fdb50067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:42.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.542+0000 7fdb77400640 1 --2- 172.21.15.106:0/172100046 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fdb50065150 0x7fdb50067600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdb64034000 tx=0x7fdb64032000 comp rx=0 tx=0).stop 2024-08-17T02:28:42.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.542+0000 7fdb77400640 1 -- 172.21.15.106:0/172100046 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb700c8bd0 msgr2=0x7fdb70158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:42.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.542+0000 7fdb77400640 1 --2- 172.21.15.106:0/172100046 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb700c8bd0 0x7fdb70158200 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c00c610 tx=0x7fdb5c007d00 comp rx=0 tx=0).stop 2024-08-17T02:28:42.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.543+0000 7fdb77400640 1 -- 172.21.15.106:0/172100046 shutdown_connections 2024-08-17T02:28:42.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.543+0000 7fdb77400640 1 --2- 172.21.15.106:0/172100046 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdb70156c50 0x7fdb7013d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.543+0000 7fdb77400640 1 --2- 172.21.15.106:0/172100046 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fdb50065150 0x7fdb50067600 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.543+0000 7fdb77400640 1 --2- 172.21.15.106:0/172100046 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb700c8bd0 0x7fdb70158200 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.543+0000 7fdb77400640 1 --2- 172.21.15.106:0/172100046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb700adcf0 0x7fdb700a5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.543+0000 7fdb77400640 1 -- 172.21.15.106:0/172100046 >> 172.21.15.106:0/172100046 conn(0x7fdb70067750 msgr2=0x7fdb70155ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:42.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.543+0000 7fdb77400640 1 -- 172.21.15.106:0/172100046 shutdown_connections 2024-08-17T02:28:42.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.543+0000 7fdb77400640 1 -- 172.21.15.106:0/172100046 wait complete. 2024-08-17T02:28:42.560 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:28:42.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.753+0000 7fce09200640 1 Processor -- start 2024-08-17T02:28:42.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.753+0000 7fce09200640 1 -- start start 2024-08-17T02:28:42.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.754+0000 7fce09200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fce04155a80 0x7fce0406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:42.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.754+0000 7fce09200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce040c92e0 0x7fce040aea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:42.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.754+0000 7fce09200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce041598f0 con 0x7fce040c7db0 2024-08-17T02:28:42.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.754+0000 7fce09200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce04159bd0 con 0x7fce04155a80 2024-08-17T02:28:42.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.754+0000 7fce09200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce04159eb0 con 0x7fce040c92e0 2024-08-17T02:28:42.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.755+0000 7fce02800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce040c92e0 0x7fce040aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:42.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.755+0000 7fce01e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fce04155a80 0x7fce0406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:42.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.755+0000 7fce02800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce040c92e0 0x7fce040aea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:37640/0 (socket says 172.21.15.106:37640) 2024-08-17T02:28:42.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.755+0000 7fce02800640 1 -- 172.21.15.106:0/2886428511 learned_addr learned my addr 172.21.15.106:0/2886428511 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:42.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.755+0000 7fce01e00640 1 --2- 172.21.15.106:0/2886428511 >> v2:172.21.15.171:3300/0 conn(0x7fce04155a80 0x7fce0406dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:44752/0 (socket says 172.21.15.106:44752) 2024-08-17T02:28:42.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.755+0000 7fce00a00640 1 -- 172.21.15.106:0/2886428511 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3952839650 0 0) 0x7fce041598f0 con 0x7fce040c7db0 2024-08-17T02:28:42.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.755+0000 7fce00a00640 1 -- 172.21.15.106:0/2886428511 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcde80034e0 con 0x7fce040c7db0 2024-08-17T02:28:42.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.755+0000 7fce02800640 1 -- 172.21.15.106:0/2886428511 >> v2:172.21.15.171:3300/0 conn(0x7fce04155a80 msgr2=0x7fce0406dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:42.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.755+0000 7fce02800640 1 --2- 172.21.15.106:0/2886428511 >> v2:172.21.15.171:3300/0 conn(0x7fce04155a80 0x7fce0406dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.755+0000 7fce02800640 1 -- 172.21.15.106:0/2886428511 >> v1:172.21.15.171:6789/0 conn(0x7fce040c7db0 legacy=0x7fce040c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:42.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.755+0000 7fce02800640 1 -- 172.21.15.106:0/2886428511 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0415a190 con 0x7fce040c92e0 2024-08-17T02:28:42.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.755+0000 7fce01e00640 1 --2- 172.21.15.106:0/2886428511 >> v2:172.21.15.171:3300/0 conn(0x7fce04155a80 0x7fce0406dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:42.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.756+0000 7fce02800640 1 --2- 172.21.15.106:0/2886428511 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce040c92e0 0x7fce040aea40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc009f20 tx=0x7fcdfc009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fe37c26604a5b76 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:42.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.757+0000 7fce00a00640 1 -- 172.21.15.106:0/2886428511 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc032450 con 0x7fce040c92e0 2024-08-17T02:28:42.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.757+0000 7fce00a00640 1 -- 172.21.15.106:0/2886428511 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdfc0325b0 con 0x7fce040c92e0 2024-08-17T02:28:42.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.757+0000 7fce00a00640 1 -- 172.21.15.106:0/2886428511 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc032970 con 0x7fce040c92e0 2024-08-17T02:28:42.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.757+0000 7fce09200640 1 -- 172.21.15.106:0/2886428511 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce040c92e0 msgr2=0x7fce040aea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:42.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.757+0000 7fce09200640 1 --2- 172.21.15.106:0/2886428511 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce040c92e0 0x7fce040aea40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc009f20 tx=0x7fcdfc009840 comp rx=0 tx=0).stop 2024-08-17T02:28:42.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.757+0000 7fce09200640 1 -- 172.21.15.106:0/2886428511 shutdown_connections 2024-08-17T02:28:42.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.757+0000 7fce09200640 1 --2- 172.21.15.106:0/2886428511 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce040c92e0 0x7fce040aea40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.757+0000 7fce09200640 1 --2- 172.21.15.106:0/2886428511 >> v2:172.21.15.171:3300/0 conn(0x7fce04155a80 0x7fce0406dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.757+0000 7fce09200640 1 -- 172.21.15.106:0/2886428511 >> 172.21.15.106:0/2886428511 conn(0x7fce04067750 msgr2=0x7fce040c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:42.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.757+0000 7fce09200640 1 -- 172.21.15.106:0/2886428511 shutdown_connections 2024-08-17T02:28:42.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.757+0000 7fce09200640 1 -- 172.21.15.106:0/2886428511 wait complete. 2024-08-17T02:28:42.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.759+0000 7fce09200640 1 Processor -- start 2024-08-17T02:28:42.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.759+0000 7fce09200640 1 -- start start 2024-08-17T02:28:42.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.760+0000 7fce09200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce040c7db0 0x7fce0414e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:42.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.760+0000 7fce09200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce040c92e0 0x7fce0416c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:42.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.760+0000 7fce09200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce04155a80 0x7fce04146090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:42.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.760+0000 7fce09200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0414eac0 con 0x7fce040c7db0 2024-08-17T02:28:42.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.760+0000 7fce09200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0414eda0 con 0x7fce04155a80 2024-08-17T02:28:42.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.760+0000 7fce09200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0414f080 con 0x7fce040c92e0 2024-08-17T02:28:42.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.760+0000 7fce01e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce040c7db0 0x7fce0414e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:42.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.760+0000 7fce01e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce040c7db0 0x7fce0414e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59834/0 (socket says 172.21.15.106:59834) 2024-08-17T02:28:42.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.760+0000 7fce01e00640 1 -- 172.21.15.106:0/4203484185 learned_addr learned my addr 172.21.15.106:0/4203484185 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:42.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.760+0000 7fce01400640 1 --2- 172.21.15.106:0/4203484185 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce040c92e0 0x7fce0416c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:42.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.760+0000 7fce02800640 1 --2- 172.21.15.106:0/4203484185 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce04155a80 0x7fce04146090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:42.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.760+0000 7fce01e00640 1 -- 172.21.15.106:0/4203484185 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce040c92e0 msgr2=0x7fce0416c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:42.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.760+0000 7fce01e00640 1 --2- 172.21.15.106:0/4203484185 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce040c92e0 0x7fce0416c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.760+0000 7fce01e00640 1 -- 172.21.15.106:0/4203484185 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce04155a80 msgr2=0x7fce04146090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:42.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.760+0000 7fce01e00640 1 --2- 172.21.15.106:0/4203484185 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce04155a80 0x7fce04146090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:42.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.760+0000 7fce01e00640 1 -- 172.21.15.106:0/4203484185 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf4009390 con 0x7fce040c7db0 2024-08-17T02:28:42.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.760+0000 7fce02800640 1 --2- 172.21.15.106:0/4203484185 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce04155a80 0x7fce04146090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:42.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.761+0000 7fce01e00640 1 --2- 172.21.15.106:0/4203484185 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce040c7db0 0x7fce0414e150 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcdf400ea70 tx=0x7fcdf40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:42.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.761+0000 7fcdf9600640 1 -- 172.21.15.106:0/4203484185 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf400caa0 con 0x7fce040c7db0 2024-08-17T02:28:42.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.761+0000 7fcdf9600640 1 -- 172.21.15.106:0/4203484185 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf400cc00 con 0x7fce040c7db0 2024-08-17T02:28:42.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.761+0000 7fcdf9600640 1 -- 172.21.15.106:0/4203484185 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4013470 con 0x7fce040c7db0 2024-08-17T02:28:42.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.761+0000 7fce09200640 1 -- 172.21.15.106:0/4203484185 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdfc009ae0 con 0x7fce040c7db0 2024-08-17T02:28:42.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.761+0000 7fce09200640 1 -- 172.21.15.106:0/4203484185 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce04068aa0 con 0x7fce040c7db0 2024-08-17T02:28:42.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.762+0000 7fce09200640 1 -- 172.21.15.106:0/4203484185 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce04071050 con 0x7fce040c7db0 2024-08-17T02:28:42.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.763+0000 7fcdf9600640 1 -- 172.21.15.106:0/4203484185 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcdf4013820 con 0x7fce040c7db0 2024-08-17T02:28:42.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.764+0000 7fcdf9600640 1 --2- 172.21.15.106:0/4203484185 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcde4065150 0x7fcde4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:42.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.764+0000 7fcdf9600640 1 -- 172.21.15.106:0/4203484185 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcdf4082720 con 0x7fce040c7db0 2024-08-17T02:28:42.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.764+0000 7fce01400640 1 --2- 172.21.15.106:0/4203484185 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcde4065150 0x7fcde4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:42.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.765+0000 7fce01400640 1 --2- 172.21.15.106:0/4203484185 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcde4065150 0x7fcde4067600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fce04158e50 tx=0x7fcdf0007ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:42.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.768+0000 7fcdf9600640 1 -- 172.21.15.106:0/4203484185 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcdf4050890 con 0x7fce040c7db0 2024-08-17T02:28:42.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:42.975+0000 7fce09200640 1 -- 172.21.15.106:0/4203484185 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fce0406aa10 con 0x7fce040c7db0 2024-08-17T02:28:43.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.542+0000 7fcdf9600640 1 -- 172.21.15.106:0/4203484185 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcdf40170c0 con 0x7fce040c7db0 2024-08-17T02:28:43.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.544+0000 7fce09200640 1 -- 172.21.15.106:0/4203484185 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcde4065150 msgr2=0x7fcde4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.544+0000 7fce09200640 1 --2- 172.21.15.106:0/4203484185 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcde4065150 0x7fcde4067600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fce04158e50 tx=0x7fcdf0007ca0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.544+0000 7fce09200640 1 -- 172.21.15.106:0/4203484185 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce040c7db0 msgr2=0x7fce0414e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.544+0000 7fce09200640 1 --2- 172.21.15.106:0/4203484185 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce040c7db0 0x7fce0414e150 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcdf400ea70 tx=0x7fcdf40090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.544+0000 7fce09200640 1 -- 172.21.15.106:0/4203484185 shutdown_connections 2024-08-17T02:28:43.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.544+0000 7fce09200640 1 --2- 172.21.15.106:0/4203484185 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fce04155a80 0x7fce04146090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.544+0000 7fce09200640 1 --2- 172.21.15.106:0/4203484185 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fce040c92e0 0x7fce0416c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.544+0000 7fce09200640 1 --2- 172.21.15.106:0/4203484185 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcde4065150 0x7fcde4067600 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.544+0000 7fce09200640 1 --2- 172.21.15.106:0/4203484185 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce040c7db0 0x7fce0414e150 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.544+0000 7fce09200640 1 -- 172.21.15.106:0/4203484185 >> 172.21.15.106:0/4203484185 conn(0x7fce04067750 msgr2=0x7fce040aa310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:43.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.545+0000 7fce09200640 1 -- 172.21.15.106:0/4203484185 shutdown_connections 2024-08-17T02:28:43.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.545+0000 7fce09200640 1 -- 172.21.15.106:0/4203484185 wait complete. 2024-08-17T02:28:43.561 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:43.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.709+0000 7f6ca1a00640 1 Processor -- start 2024-08-17T02:28:43.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.709+0000 7f6ca1a00640 1 -- start start 2024-08-17T02:28:43.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.710+0000 7f6ca1a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6c9c155180 0x7f6c9c0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.711+0000 7f6ca1a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c9c155550 0x7f6c9c0ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.711+0000 7f6ca1a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c9c0afc10 con 0x7f6c9c06e080 2024-08-17T02:28:43.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.711+0000 7f6ca1a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c9c0ae5b0 con 0x7f6c9c155180 2024-08-17T02:28:43.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.711+0000 7f6ca1a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c0af000 con 0x7f6c9c155550 2024-08-17T02:28:43.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.711+0000 7f6c9b400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6c9c06e080 0x7f6c9c06e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:52034/0 (socket says 172.21.15.106:52034) 2024-08-17T02:28:43.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.711+0000 7f6c9b400640 1 -- 172.21.15.106:0/2220765230 learned_addr learned my addr 172.21.15.106:0/2220765230 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:43.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.711+0000 7f6c9aa00640 1 --2- 172.21.15.106:0/2220765230 >> v2:172.21.15.171:3300/0 conn(0x7f6c9c155180 0x7f6c9c0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.711+0000 7f6c92000640 1 --2- 172.21.15.106:0/2220765230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c9c155550 0x7f6c9c0ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.711+0000 7f6c9a000640 1 -- 172.21.15.106:0/2220765230 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3469589711 0 0) 0x7f6c9c0afc10 con 0x7f6c9c06e080 2024-08-17T02:28:43.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.711+0000 7f6c9a000640 1 -- 172.21.15.106:0/2220765230 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c800034e0 con 0x7f6c9c06e080 2024-08-17T02:28:43.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.712+0000 7f6c9a000640 1 -- 172.21.15.106:0/2220765230 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3098496463 0 0) 0x7f6c800034e0 con 0x7f6c9c06e080 2024-08-17T02:28:43.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.712+0000 7f6c9a000640 1 -- 172.21.15.106:0/2220765230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c9c155550 msgr2=0x7f6c9c0ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:43.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.712+0000 7f6c9a000640 1 --2- 172.21.15.106:0/2220765230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c9c155550 0x7f6c9c0ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.712+0000 7f6c9a000640 1 -- 172.21.15.106:0/2220765230 >> v2:172.21.15.171:3300/0 conn(0x7f6c9c155180 msgr2=0x7f6c9c0aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:43.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.712+0000 7f6c9a000640 1 --2- 172.21.15.106:0/2220765230 >> v2:172.21.15.171:3300/0 conn(0x7f6c9c155180 0x7f6c9c0aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.712+0000 7f6c9a000640 1 -- 172.21.15.106:0/2220765230 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9c0af2e0 con 0x7f6c9c06e080 2024-08-17T02:28:43.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.712+0000 7f6c9a000640 1 -- 172.21.15.106:0/2220765230 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7f6c940017f0 con 0x7f6c9c06e080 2024-08-17T02:28:43.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.712+0000 7f6c9a000640 1 -- 172.21.15.106:0/2220765230 >> v1:172.21.15.106:6789/0 conn(0x7f6c9c06e080 legacy=0x7f6c9c06e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.712+0000 7f6c9a000640 1 --2- 172.21.15.106:0/2220765230 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c80003a50 0x7f6c80003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.712+0000 7f6c9a000640 1 --2- 172.21.15.106:0/2220765230 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c80004780 0x7f6c80004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.712+0000 7f6c9a000640 1 --2- 172.21.15.106:0/2220765230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c9c155550 0x7f6c80005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.712+0000 7f6c9a000640 1 -- 172.21.15.106:0/2220765230 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c0ae5b0 con 0x7f6c80003a50 2024-08-17T02:28:43.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.712+0000 7f6c9a000640 1 -- 172.21.15.106:0/2220765230 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c0af000 con 0x7f6c80004780 2024-08-17T02:28:43.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.712+0000 7f6c9a000640 1 -- 172.21.15.106:0/2220765230 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8000bab0 con 0x7f6c9c155550 2024-08-17T02:28:43.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.712+0000 7f6c9aa00640 1 --2- 172.21.15.106:0/2220765230 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c80003a50 0x7f6c80003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.712+0000 7f6c92000640 1 --2- 172.21.15.106:0/2220765230 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c80004780 0x7f6c80004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.712+0000 7f6c9b400640 1 --2- 172.21.15.106:0/2220765230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c9c155550 0x7f6c80005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.712+0000 7f6c9aa00640 1 -- 172.21.15.106:0/2220765230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c9c155550 msgr2=0x7f6c80005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:43.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.712+0000 7f6c9aa00640 1 --2- 172.21.15.106:0/2220765230 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c9c155550 0x7f6c80005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.712+0000 7f6c9aa00640 1 -- 172.21.15.106:0/2220765230 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c80004780 msgr2=0x7f6c80004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:43.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.712+0000 7f6c9aa00640 1 --2- 172.21.15.106:0/2220765230 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c80004780 0x7f6c80004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.713+0000 7f6c9aa00640 1 -- 172.21.15.106:0/2220765230 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c800034e0 con 0x7f6c80003a50 2024-08-17T02:28:43.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.713+0000 7f6c9aa00640 1 --2- 172.21.15.106:0/2220765230 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c80003a50 0x7f6c80003e60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c009b70 tx=0x7f6c8c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709fdb1b5b562438 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:43.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.714+0000 7f6c9a000640 1 -- 172.21.15.106:0/2220765230 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c031400 con 0x7f6c80003a50 2024-08-17T02:28:43.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.714+0000 7f6c9a000640 1 -- 172.21.15.106:0/2220765230 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8c02d050 con 0x7f6c80003a50 2024-08-17T02:28:43.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.714+0000 7f6c9a000640 1 -- 172.21.15.106:0/2220765230 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c031790 con 0x7f6c80003a50 2024-08-17T02:28:43.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.714+0000 7f6ca1a00640 1 -- 172.21.15.106:0/2220765230 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c80003a50 msgr2=0x7f6c80003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.714+0000 7f6ca1a00640 1 --2- 172.21.15.106:0/2220765230 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c80003a50 0x7f6c80003e60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c009b70 tx=0x7f6c8c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.714+0000 7f6c9b400640 1 -- 172.21.15.106:0/2220765230 reap_dead start 2024-08-17T02:28:43.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.714+0000 7f6ca1a00640 1 -- 172.21.15.106:0/2220765230 shutdown_connections 2024-08-17T02:28:43.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.714+0000 7f6ca1a00640 1 -- 172.21.15.106:0/2220765230 >> 172.21.15.106:0/2220765230 conn(0x7f6c9c0cb9b0 msgr2=0x7f6c9c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:43.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.714+0000 7f6ca1a00640 1 -- 172.21.15.106:0/2220765230 shutdown_connections 2024-08-17T02:28:43.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.714+0000 7f6ca1a00640 1 -- 172.21.15.106:0/2220765230 wait complete. 2024-08-17T02:28:43.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.716+0000 7f6ca1a00640 1 Processor -- start 2024-08-17T02:28:43.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.716+0000 7f6ca1a00640 1 -- start start 2024-08-17T02:28:43.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.717+0000 7f6ca1a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c80003a50 0x7f6c9c168c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.717+0000 7f6ca1a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c9c169190 0x7f6c9c1590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.717+0000 7f6ca1a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c9c1595f0 0x7f6c9c15e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.717+0000 7f6ca1a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c15ddd0 con 0x7f6c9c1595f0 2024-08-17T02:28:43.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.717+0000 7f6ca1a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c15d1c0 con 0x7f6c9c169190 2024-08-17T02:28:43.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.717+0000 7f6ca1a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c15d4a0 con 0x7f6c80003a50 2024-08-17T02:28:43.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.717+0000 7f6c9b400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c9c1595f0 0x7f6c9c15e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.717+0000 7f6c9b400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c9c1595f0 0x7f6c9c15e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59852/0 (socket says 172.21.15.106:59852) 2024-08-17T02:28:43.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.717+0000 7f6c9b400640 1 -- 172.21.15.106:0/1288587128 learned_addr learned my addr 172.21.15.106:0/1288587128 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:43.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.717+0000 7f6c92000640 1 --2- 172.21.15.106:0/1288587128 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c9c169190 0x7f6c9c1590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.717+0000 7f6c9aa00640 1 --2- 172.21.15.106:0/1288587128 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c80003a50 0x7f6c9c168c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.718+0000 7f6c9b400640 1 -- 172.21.15.106:0/1288587128 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c80003a50 msgr2=0x7f6c9c168c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.718+0000 7f6c9b400640 1 --2- 172.21.15.106:0/1288587128 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c80003a50 0x7f6c9c168c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.718+0000 7f6c9b400640 1 -- 172.21.15.106:0/1288587128 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c9c169190 msgr2=0x7f6c9c1590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.718+0000 7f6c9b400640 1 --2- 172.21.15.106:0/1288587128 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c9c169190 0x7f6c9c1590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.718+0000 7f6c9b400640 1 -- 172.21.15.106:0/1288587128 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9c15d780 con 0x7f6c9c1595f0 2024-08-17T02:28:43.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.718+0000 7f6c9aa00640 1 --2- 172.21.15.106:0/1288587128 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c80003a50 0x7f6c9c168c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:43.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.718+0000 7f6c9b400640 1 --2- 172.21.15.106:0/1288587128 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c9c1595f0 0x7f6c9c15e260 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c155920 tx=0x7f6c94002140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:43.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.718+0000 7f6c92a00640 1 -- 172.21.15.106:0/1288587128 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9400a6f0 con 0x7f6c9c1595f0 2024-08-17T02:28:43.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.718+0000 7f6c92a00640 1 -- 172.21.15.106:0/1288587128 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9400a850 con 0x7f6c9c1595f0 2024-08-17T02:28:43.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.718+0000 7f6c92a00640 1 -- 172.21.15.106:0/1288587128 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9400ac10 con 0x7f6c9c1595f0 2024-08-17T02:28:43.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.718+0000 7f6ca1a00640 1 -- 172.21.15.106:0/1288587128 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c9c15da60 con 0x7f6c9c1595f0 2024-08-17T02:28:43.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.718+0000 7f6ca1a00640 1 -- 172.21.15.106:0/1288587128 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c9c15e940 con 0x7f6c9c1595f0 2024-08-17T02:28:43.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.719+0000 7f6ca1a00640 1 -- 172.21.15.106:0/1288587128 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c9c15df80 con 0x7f6c9c1595f0 2024-08-17T02:28:43.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.720+0000 7f6c92a00640 1 -- 172.21.15.106:0/1288587128 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6c9401c400 con 0x7f6c9c1595f0 2024-08-17T02:28:43.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.721+0000 7f6c92a00640 1 --2- 172.21.15.106:0/1288587128 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6c78065150 0x7f6c78067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.721+0000 7f6c92a00640 1 -- 172.21.15.106:0/1288587128 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6c94082820 con 0x7f6c9c1595f0 2024-08-17T02:28:43.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.721+0000 7f6c9aa00640 1 --2- 172.21.15.106:0/1288587128 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6c78065150 0x7f6c78067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.722+0000 7f6c9aa00640 1 --2- 172.21.15.106:0/1288587128 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6c78065150 0x7f6c78067600 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c034000 tx=0x7f6c8c035000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:43.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.725+0000 7f6c92a00640 1 -- 172.21.15.106:0/1288587128 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6c9c15df80 con 0x7f6c9c1595f0 2024-08-17T02:28:43.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.931+0000 7f6ca1a00640 1 -- 172.21.15.106:0/1288587128 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c9c15eb60 con 0x7f6c9c1595f0 2024-08-17T02:28:43.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.931+0000 7f6c92a00640 1 -- 172.21.15.106:0/1288587128 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f6c94017090 con 0x7f6c9c1595f0 2024-08-17T02:28:43.932 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:43.932 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4900,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1137148711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1137148711},{"type":"v1","addr":"172.21.15.106:6836","nonce":1137148711}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4903,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3136131297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":3136131297},{"type":"v1","addr":"172.21.15.106:6837","nonce":3136131297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/3251295288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6833","nonce":3251295288},{"type":"v1","addr":"172.21.15.171:6835","nonce":3251295288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:39.908382+0000","modified":"2024-08-17T02:28:43.540030+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6834/754665763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":754665763},{"type":"v1","addr":"172.21.15.171:6834","nonce":754665763}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:28:43.932 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 17 2024-08-17T02:28:43.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.933+0000 7f6ca1a00640 1 -- 172.21.15.106:0/1288587128 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6c78065150 msgr2=0x7f6c78067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.933+0000 7f6ca1a00640 1 --2- 172.21.15.106:0/1288587128 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6c78065150 0x7f6c78067600 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c034000 tx=0x7f6c8c035000 comp rx=0 tx=0).stop 2024-08-17T02:28:43.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.933+0000 7f6ca1a00640 1 -- 172.21.15.106:0/1288587128 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c9c1595f0 msgr2=0x7f6c9c15e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.933+0000 7f6ca1a00640 1 --2- 172.21.15.106:0/1288587128 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c9c1595f0 0x7f6c9c15e260 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c155920 tx=0x7f6c94002140 comp rx=0 tx=0).stop 2024-08-17T02:28:43.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.933+0000 7f6ca1a00640 1 -- 172.21.15.106:0/1288587128 shutdown_connections 2024-08-17T02:28:43.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.933+0000 7f6ca1a00640 1 --2- 172.21.15.106:0/1288587128 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6c78065150 0x7f6c78067600 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.933+0000 7f6ca1a00640 1 --2- 172.21.15.106:0/1288587128 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c9c1595f0 0x7f6c9c15e260 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.933+0000 7f6ca1a00640 1 --2- 172.21.15.106:0/1288587128 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c9c169190 0x7f6c9c1590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.933+0000 7f6ca1a00640 1 --2- 172.21.15.106:0/1288587128 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6c80003a50 0x7f6c9c168c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.933+0000 7f6ca1a00640 1 -- 172.21.15.106:0/1288587128 >> 172.21.15.106:0/1288587128 conn(0x7f6c9c0cb9b0 msgr2=0x7f6c9c0687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:43.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.933+0000 7f6ca1a00640 1 -- 172.21.15.106:0/1288587128 shutdown_connections 2024-08-17T02:28:43.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:43.934+0000 7f6ca1a00640 1 -- 172.21.15.106:0/1288587128 wait complete. 2024-08-17T02:28:43.950 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:44.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.097+0000 7f2233400640 1 Processor -- start 2024-08-17T02:28:44.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.097+0000 7f2233400640 1 -- start start 2024-08-17T02:28:44.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.098+0000 7f2233400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f222c155550 0x7f222c0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.098+0000 7f2233400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f222c06e080 0x7f222c06e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.098+0000 7f2233400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222c0afc10 con 0x7f222c155180 2024-08-17T02:28:44.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.098+0000 7f2233400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f222c06ea00 con 0x7f222c06e080 2024-08-17T02:28:44.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.098+0000 7f2233400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f222c0af000 con 0x7f222c155550 2024-08-17T02:28:44.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.098+0000 7f2231400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f222c06e080 0x7f222c06e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.099+0000 7f2231400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f222c06e080 0x7f222c06e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59858/0 (socket says 172.21.15.106:59858) 2024-08-17T02:28:44.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.099+0000 7f2231400640 1 -- 172.21.15.106:0/2280408933 learned_addr learned my addr 172.21.15.106:0/2280408933 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:44.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.099+0000 7f222be00640 1 --2- 172.21.15.106:0/2280408933 >> v2:172.21.15.171:3300/0 conn(0x7f222c155550 0x7f222c0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.099+0000 7f2231400640 1 -- 172.21.15.106:0/2280408933 >> v2:172.21.15.171:3300/0 conn(0x7f222c155550 msgr2=0x7f222c0aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:44.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.099+0000 7f2231400640 1 --2- 172.21.15.106:0/2280408933 >> v2:172.21.15.171:3300/0 conn(0x7f222c155550 0x7f222c0aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.099+0000 7f2231400640 1 -- 172.21.15.106:0/2280408933 >> v1:172.21.15.171:6789/0 conn(0x7f222c155180 legacy=0x7f222c0ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:44.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.099+0000 7f2231400640 1 -- 172.21.15.106:0/2280408933 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222c0af2e0 con 0x7f222c06e080 2024-08-17T02:28:44.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.100+0000 7f2231400640 1 --2- 172.21.15.106:0/2280408933 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f222c06e080 0x7f222c06e4c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f222c06c770 tx=0x7f2224009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c168b98482ecda server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:44.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.100+0000 7f222b400640 1 -- 172.21.15.106:0/2280408933 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2224033480 con 0x7f222c06e080 2024-08-17T02:28:44.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.100+0000 7f222b400640 1 -- 172.21.15.106:0/2280408933 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22240335e0 con 0x7f222c06e080 2024-08-17T02:28:44.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.100+0000 7f222b400640 1 -- 172.21.15.106:0/2280408933 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22240339c0 con 0x7f222c06e080 2024-08-17T02:28:44.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.101+0000 7f2233400640 1 -- 172.21.15.106:0/2280408933 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f222c06e080 msgr2=0x7f222c06e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.101+0000 7f2233400640 1 --2- 172.21.15.106:0/2280408933 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f222c06e080 0x7f222c06e4c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f222c06c770 tx=0x7f2224009840 comp rx=0 tx=0).stop 2024-08-17T02:28:44.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.101+0000 7f2233400640 1 -- 172.21.15.106:0/2280408933 shutdown_connections 2024-08-17T02:28:44.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.101+0000 7f2233400640 1 --2- 172.21.15.106:0/2280408933 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f222c06e080 0x7f222c06e4c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.101+0000 7f2233400640 1 --2- 172.21.15.106:0/2280408933 >> v2:172.21.15.171:3300/0 conn(0x7f222c155550 0x7f222c0aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.101+0000 7f2233400640 1 -- 172.21.15.106:0/2280408933 >> 172.21.15.106:0/2280408933 conn(0x7f222c0cb9b0 msgr2=0x7f222c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:44.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.101+0000 7f2233400640 1 -- 172.21.15.106:0/2280408933 shutdown_connections 2024-08-17T02:28:44.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.101+0000 7f2233400640 1 -- 172.21.15.106:0/2280408933 wait complete. 2024-08-17T02:28:44.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.102+0000 7f2233400640 1 Processor -- start 2024-08-17T02:28:44.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.103+0000 7f2233400640 1 -- start start 2024-08-17T02:28:44.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.103+0000 7f2233400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f222c06e080 0x7f222c0abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.103+0000 7f2233400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f222c155180 0x7f222c13f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.103+0000 7f2233400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f222c155550 0x7f222c152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.103+0000 7f2233400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c0aae10 con 0x7f222c155550 2024-08-17T02:28:44.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.103+0000 7f2233400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c0ab0f0 con 0x7f222c155180 2024-08-17T02:28:44.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.103+0000 7f2233400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222c0ab3d0 con 0x7f222c06e080 2024-08-17T02:28:44.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.104+0000 7f2231400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f222c155550 0x7f222c152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.104+0000 7f2231400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f222c155550 0x7f222c152020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59868/0 (socket says 172.21.15.106:59868) 2024-08-17T02:28:44.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.104+0000 7f2231400640 1 -- 172.21.15.106:0/476348623 learned_addr learned my addr 172.21.15.106:0/476348623 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:44.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.104+0000 7f222be00640 1 --2- 172.21.15.106:0/476348623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f222c155180 0x7f222c13f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.104+0000 7f2230a00640 1 --2- 172.21.15.106:0/476348623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f222c06e080 0x7f222c0abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.104+0000 7f2231400640 1 -- 172.21.15.106:0/476348623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f222c06e080 msgr2=0x7f222c0abeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.104+0000 7f2231400640 1 --2- 172.21.15.106:0/476348623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f222c06e080 0x7f222c0abeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.104+0000 7f2231400640 1 -- 172.21.15.106:0/476348623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f222c155180 msgr2=0x7f222c13f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.104+0000 7f2231400640 1 --2- 172.21.15.106:0/476348623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f222c155180 0x7f222c13f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.104+0000 7f2231400640 1 -- 172.21.15.106:0/476348623 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2224009ae0 con 0x7f222c155550 2024-08-17T02:28:44.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.104+0000 7f222be00640 1 --2- 172.21.15.106:0/476348623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f222c155180 0x7f222c13f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:44.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.104+0000 7f2231400640 1 --2- 172.21.15.106:0/476348623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f222c155550 0x7f222c152020 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2224009ab0 tx=0x7f2224038000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:44.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.105+0000 7f221fe00640 1 -- 172.21.15.106:0/476348623 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2224033480 con 0x7f222c155550 2024-08-17T02:28:44.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.105+0000 7f221fe00640 1 -- 172.21.15.106:0/476348623 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2224007c30 con 0x7f222c155550 2024-08-17T02:28:44.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.105+0000 7f221fe00640 1 -- 172.21.15.106:0/476348623 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222403d400 con 0x7f222c155550 2024-08-17T02:28:44.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.105+0000 7f2233400640 1 -- 172.21.15.106:0/476348623 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f222c0ab6b0 con 0x7f222c155550 2024-08-17T02:28:44.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.105+0000 7f2233400640 1 -- 172.21.15.106:0/476348623 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f222c13f7e0 con 0x7f222c155550 2024-08-17T02:28:44.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.106+0000 7f2233400640 1 -- 172.21.15.106:0/476348623 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f222c13f970 con 0x7f222c155550 2024-08-17T02:28:44.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.106+0000 7f221fe00640 1 -- 172.21.15.106:0/476348623 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f222403d790 con 0x7f222c155550 2024-08-17T02:28:44.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.107+0000 7f221fe00640 1 --2- 172.21.15.106:0/476348623 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f220c065150 0x7f220c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.107+0000 7f221fe00640 1 -- 172.21.15.106:0/476348623 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f22240a3a70 con 0x7f222c155550 2024-08-17T02:28:44.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.108+0000 7f2230a00640 1 --2- 172.21.15.106:0/476348623 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f220c065150 0x7f220c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.108+0000 7f2230a00640 1 --2- 172.21.15.106:0/476348623 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f220c065150 0x7f220c067600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f22200037d0 tx=0x7f2220009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:44.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.112+0000 7f221fe00640 1 -- 172.21.15.106:0/476348623 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2224071a90 con 0x7f222c155550 2024-08-17T02:28:44.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.283+0000 7f2233400640 1 -- 172.21.15.106:0/476348623 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f222c0abbb0 con 0x7f222c155550 2024-08-17T02:28:44.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.284+0000 7f221fe00640 1 -- 172.21.15.106:0/476348623 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f22240750b0 con 0x7f222c155550 2024-08-17T02:28:44.285 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:44.285 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":32,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:28:41.516847+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:37.880632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:38.897913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:44.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.286+0000 7f2233400640 1 -- 172.21.15.106:0/476348623 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f220c065150 msgr2=0x7f220c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.286+0000 7f2233400640 1 --2- 172.21.15.106:0/476348623 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f220c065150 0x7f220c067600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f22200037d0 tx=0x7f2220009040 comp rx=0 tx=0).stop 2024-08-17T02:28:44.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.286+0000 7f2233400640 1 -- 172.21.15.106:0/476348623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f222c155550 msgr2=0x7f222c152020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.286+0000 7f2233400640 1 --2- 172.21.15.106:0/476348623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f222c155550 0x7f222c152020 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2224009ab0 tx=0x7f2224038000 comp rx=0 tx=0).stop 2024-08-17T02:28:44.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.286+0000 7f2233400640 1 -- 172.21.15.106:0/476348623 shutdown_connections 2024-08-17T02:28:44.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.286+0000 7f2233400640 1 --2- 172.21.15.106:0/476348623 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f220c065150 0x7f220c067600 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.286+0000 7f2233400640 1 --2- 172.21.15.106:0/476348623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f222c155550 0x7f222c152020 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.286+0000 7f2233400640 1 --2- 172.21.15.106:0/476348623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f222c155180 0x7f222c13f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.286+0000 7f2233400640 1 --2- 172.21.15.106:0/476348623 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f222c06e080 0x7f222c0abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.286+0000 7f2233400640 1 -- 172.21.15.106:0/476348623 >> 172.21.15.106:0/476348623 conn(0x7f222c0cb9b0 msgr2=0x7f222c0ae050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:44.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.286+0000 7f2233400640 1 -- 172.21.15.106:0/476348623 shutdown_connections 2024-08-17T02:28:44.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.286+0000 7f2233400640 1 -- 172.21.15.106:0/476348623 wait complete. 2024-08-17T02:28:44.302 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:28:44.302 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:28:44.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.448+0000 7fcd2fa00640 1 Processor -- start 2024-08-17T02:28:44.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.448+0000 7fcd2fa00640 1 -- start start 2024-08-17T02:28:44.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.449+0000 7fcd2fa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcd28155a20 0x7fcd280adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.449+0000 7fcd2fa00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd2806df00 0x7fcd280ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.449+0000 7fcd2fa00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd28156670 con 0x7fcd28155df0 2024-08-17T02:28:44.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.449+0000 7fcd2fa00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd280b0350 con 0x7fcd28155a20 2024-08-17T02:28:44.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.449+0000 7fcd2fa00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2806e5e0 con 0x7fcd2806df00 2024-08-17T02:28:44.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.450+0000 7fcd2d000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcd28155a20 0x7fcd280adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.450+0000 7fcd2d000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcd28155a20 0x7fcd280adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59878/0 (socket says 172.21.15.106:59878) 2024-08-17T02:28:44.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.450+0000 7fcd2d000640 1 -- 172.21.15.106:0/500952405 learned_addr learned my addr 172.21.15.106:0/500952405 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:44.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.450+0000 7fcd2da00640 1 --2- 172.21.15.106:0/500952405 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd2806df00 0x7fcd280ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.450+0000 7fcd2d000640 1 -- 172.21.15.106:0/500952405 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd2806df00 msgr2=0x7fcd280ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:44.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.450+0000 7fcd2d000640 1 --2- 172.21.15.106:0/500952405 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd2806df00 0x7fcd280ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.450+0000 7fcd2d000640 1 -- 172.21.15.106:0/500952405 >> v1:172.21.15.171:6789/0 conn(0x7fcd28155df0 legacy=0x7fcd2806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:44.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.450+0000 7fcd2d000640 1 -- 172.21.15.106:0/500952405 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2806e8c0 con 0x7fcd28155a20 2024-08-17T02:28:44.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.451+0000 7fcd2d000640 1 --2- 172.21.15.106:0/500952405 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd28155a20 0x7fcd280adf10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcd18009910 tx=0x7fcd180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503ffe8cf1c314ac server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:44.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.451+0000 7fcd27e00640 1 -- 172.21.15.106:0/500952405 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1802adb0 con 0x7fcd28155a20 2024-08-17T02:28:44.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.451+0000 7fcd27e00640 1 -- 172.21.15.106:0/500952405 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd18032440 con 0x7fcd28155a20 2024-08-17T02:28:44.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.451+0000 7fcd27e00640 1 -- 172.21.15.106:0/500952405 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd18032820 con 0x7fcd28155a20 2024-08-17T02:28:44.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.452+0000 7fcd2fa00640 1 -- 172.21.15.106:0/500952405 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd28155a20 msgr2=0x7fcd280adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.452+0000 7fcd2fa00640 1 --2- 172.21.15.106:0/500952405 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd28155a20 0x7fcd280adf10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcd18009910 tx=0x7fcd180091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.452+0000 7fcd2fa00640 1 -- 172.21.15.106:0/500952405 shutdown_connections 2024-08-17T02:28:44.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.452+0000 7fcd2fa00640 1 --2- 172.21.15.106:0/500952405 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd2806df00 0x7fcd280ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.452+0000 7fcd2fa00640 1 --2- 172.21.15.106:0/500952405 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd28155a20 0x7fcd280adf10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.452+0000 7fcd2fa00640 1 -- 172.21.15.106:0/500952405 >> 172.21.15.106:0/500952405 conn(0x7fcd280cb9b0 msgr2=0x7fcd280cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:44.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.452+0000 7fcd2fa00640 1 -- 172.21.15.106:0/500952405 shutdown_connections 2024-08-17T02:28:44.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.452+0000 7fcd2fa00640 1 -- 172.21.15.106:0/500952405 wait complete. 2024-08-17T02:28:44.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.453+0000 7fcd2fa00640 1 Processor -- start 2024-08-17T02:28:44.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.453+0000 7fcd2fa00640 1 -- start start 2024-08-17T02:28:44.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.454+0000 7fcd2fa00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd2806df00 0x7fcd2814ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.454+0000 7fcd2fa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd28155a20 0x7fcd2814f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.454+0000 7fcd2fa00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd28155df0 0x7fcd2814a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.454+0000 7fcd2fa00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2814ba50 con 0x7fcd28155a20 2024-08-17T02:28:44.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.454+0000 7fcd2fa00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2814fa30 con 0x7fcd28155df0 2024-08-17T02:28:44.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.454+0000 7fcd2fa00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd28166be0 con 0x7fcd2806df00 2024-08-17T02:28:44.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.455+0000 7fcd1fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd28155a20 0x7fcd2814f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.455+0000 7fcd1fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd28155a20 0x7fcd2814f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59882/0 (socket says 172.21.15.106:59882) 2024-08-17T02:28:44.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.455+0000 7fcd1fe00640 1 -- 172.21.15.106:0/3066801705 learned_addr learned my addr 172.21.15.106:0/3066801705 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:44.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.455+0000 7fcd2da00640 1 --2- 172.21.15.106:0/3066801705 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd28155df0 0x7fcd2814a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.455+0000 7fcd2d000640 1 --2- 172.21.15.106:0/3066801705 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd2806df00 0x7fcd2814ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.455+0000 7fcd1fe00640 1 -- 172.21.15.106:0/3066801705 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd2806df00 msgr2=0x7fcd2814ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.455+0000 7fcd1fe00640 1 --2- 172.21.15.106:0/3066801705 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd2806df00 0x7fcd2814ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.455+0000 7fcd1fe00640 1 -- 172.21.15.106:0/3066801705 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd28155df0 msgr2=0x7fcd2814a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.455+0000 7fcd1fe00640 1 --2- 172.21.15.106:0/3066801705 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd28155df0 0x7fcd2814a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.455+0000 7fcd1fe00640 1 -- 172.21.15.106:0/3066801705 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd18009450 con 0x7fcd28155a20 2024-08-17T02:28:44.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.455+0000 7fcd1fe00640 1 --2- 172.21.15.106:0/3066801705 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd28155a20 0x7fcd2814f110 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcd1000b4c0 tx=0x7fcd10009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:44.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.455+0000 7fcd24c00640 1 -- 172.21.15.106:0/3066801705 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1000f510 con 0x7fcd28155a20 2024-08-17T02:28:44.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.455+0000 7fcd24c00640 1 -- 172.21.15.106:0/3066801705 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1000f670 con 0x7fcd28155a20 2024-08-17T02:28:44.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.455+0000 7fcd24c00640 1 -- 172.21.15.106:0/3066801705 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1000fa30 con 0x7fcd28155a20 2024-08-17T02:28:44.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.455+0000 7fcd2fa00640 1 -- 172.21.15.106:0/3066801705 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd28166e80 con 0x7fcd28155a20 2024-08-17T02:28:44.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.456+0000 7fcd2fa00640 1 -- 172.21.15.106:0/3066801705 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2814b490 con 0x7fcd28155a20 2024-08-17T02:28:44.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.457+0000 7fcd2fa00640 1 -- 172.21.15.106:0/3066801705 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd28064db0 con 0x7fcd28155a20 2024-08-17T02:28:44.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.457+0000 7fcd24c00640 1 -- 172.21.15.106:0/3066801705 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcd1001a400 con 0x7fcd28155a20 2024-08-17T02:28:44.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.458+0000 7fcd24c00640 1 --2- 172.21.15.106:0/3066801705 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcd04065150 0x7fcd04067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.459+0000 7fcd24c00640 1 -- 172.21.15.106:0/3066801705 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcd10081fd0 con 0x7fcd28155a20 2024-08-17T02:28:44.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.459+0000 7fcd2d000640 1 --2- 172.21.15.106:0/3066801705 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcd04065150 0x7fcd04067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.459+0000 7fcd2d000640 1 --2- 172.21.15.106:0/3066801705 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcd04065150 0x7fcd04067600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcd18034000 tx=0x7fcd18032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:44.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.462+0000 7fcd24c00640 1 -- 172.21.15.106:0/3066801705 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcd10050070 con 0x7fcd28155a20 2024-08-17T02:28:44.487 INFO:tasks.ceph.mds.b.smithi171.stderr:2024-08-17T02:28:44.487+0000 7f069ae00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:28:44.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.631+0000 7fcd2fa00640 1 -- 172.21.15.106:0/3066801705 --> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcd2806d3a0 con 0x7fcd04065150 2024-08-17T02:28:44.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.640+0000 7fcd24c00640 1 -- 172.21.15.106:0/3066801705 <== mgr.4107 v2:172.21.15.106:6832/36860 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288843 (secure 0 0 0) 0x7fcd2806d3a0 con 0x7fcd04065150 2024-08-17T02:28:44.644 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:44.645 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-08-17T02:28:44.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.643+0000 7fcd2fa00640 1 -- 172.21.15.106:0/3066801705 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcd04065150 msgr2=0x7fcd04067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.643+0000 7fcd2fa00640 1 --2- 172.21.15.106:0/3066801705 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcd04065150 0x7fcd04067600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcd18034000 tx=0x7fcd18032000 comp rx=0 tx=0).stop 2024-08-17T02:28:44.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.643+0000 7fcd2fa00640 1 -- 172.21.15.106:0/3066801705 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd28155a20 msgr2=0x7fcd2814f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.643+0000 7fcd2fa00640 1 --2- 172.21.15.106:0/3066801705 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd28155a20 0x7fcd2814f110 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcd1000b4c0 tx=0x7fcd10009060 comp rx=0 tx=0).stop 2024-08-17T02:28:44.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.643+0000 7fcd2fa00640 1 -- 172.21.15.106:0/3066801705 shutdown_connections 2024-08-17T02:28:44.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.643+0000 7fcd2fa00640 1 --2- 172.21.15.106:0/3066801705 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd28155df0 0x7fcd2814a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.643+0000 7fcd2fa00640 1 --2- 172.21.15.106:0/3066801705 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcd04065150 0x7fcd04067600 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.643+0000 7fcd2fa00640 1 --2- 172.21.15.106:0/3066801705 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd28155a20 0x7fcd2814f110 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.643+0000 7fcd2fa00640 1 --2- 172.21.15.106:0/3066801705 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcd2806df00 0x7fcd2814ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.643+0000 7fcd2fa00640 1 -- 172.21.15.106:0/3066801705 >> 172.21.15.106:0/3066801705 conn(0x7fcd280cb9b0 msgr2=0x7fcd280687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:44.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.643+0000 7fcd2fa00640 1 -- 172.21.15.106:0/3066801705 shutdown_connections 2024-08-17T02:28:44.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.644+0000 7fcd2fa00640 1 -- 172.21.15.106:0/3066801705 wait complete. 2024-08-17T02:28:44.660 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-08-17T02:28:43.885856+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382880,"kb_used_data":4016,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752591840,"statfs":{"total":773094113280,"available":770654044160,"internally_reserved":0,"allocated":4112384,"data_stored":2293868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.392946"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.546289+0000","last_change":"2024-08-17T02:28:40.538350+0000","last_active":"2024-08-17T02:28:40.546289+0000","last_peered":"2024-08-17T02:28:40.546289+0000","last_clean":"2024-08-17T02:28:40.546289+0000","last_became_active":"2024-08-17T02:28:40.538058+0000","last_became_peered":"2024-08-17T02:28:40.538058+0000","last_unstale":"2024-08-17T02:28:40.546289+0000","last_undegraded":"2024-08-17T02:28:40.546289+0000","last_fullsized":"2024-08-17T02:28:40.546289+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:32:27.622020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.534616+0000","last_change":"2024-08-17T02:28:40.530157+0000","last_active":"2024-08-17T02:28:40.534616+0000","last_peered":"2024-08-17T02:28:40.534616+0000","last_clean":"2024-08-17T02:28:40.534616+0000","last_became_active":"2024-08-17T02:28:40.529773+0000","last_became_peered":"2024-08-17T02:28:40.529773+0000","last_unstale":"2024-08-17T02:28:40.534616+0000","last_undegraded":"2024-08-17T02:28:40.534616+0000","last_fullsized":"2024-08-17T02:28:40.534616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:27:23.294901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.535042+0000","last_change":"2024-08-17T02:28:40.523201+0000","last_active":"2024-08-17T02:28:40.535042+0000","last_peered":"2024-08-17T02:28:40.535042+0000","last_clean":"2024-08-17T02:28:40.535042+0000","last_became_active":"2024-08-17T02:28:40.522937+0000","last_became_peered":"2024-08-17T02:28:40.522937+0000","last_unstale":"2024-08-17T02:28:40.535042+0000","last_undegraded":"2024-08-17T02:28:40.535042+0000","last_fullsized":"2024-08-17T02:28:40.535042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:50:30.415273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.535022+0000","last_change":"2024-08-17T02:28:40.529359+0000","last_active":"2024-08-17T02:28:40.535022+0000","last_peered":"2024-08-17T02:28:40.535022+0000","last_clean":"2024-08-17T02:28:40.535022+0000","last_became_active":"2024-08-17T02:28:40.527719+0000","last_became_peered":"2024-08-17T02:28:40.527719+0000","last_unstale":"2024-08-17T02:28:40.535022+0000","last_undegraded":"2024-08-17T02:28:40.535022+0000","last_fullsized":"2024-08-17T02:28:40.535022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:05.540034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.541840+0000","last_change":"2024-08-17T02:28:40.538524+0000","last_active":"2024-08-17T02:28:40.541840+0000","last_peered":"2024-08-17T02:28:40.541840+0000","last_clean":"2024-08-17T02:28:40.541840+0000","last_became_active":"2024-08-17T02:28:40.538266+0000","last_became_peered":"2024-08-17T02:28:40.538266+0000","last_unstale":"2024-08-17T02:28:40.541840+0000","last_undegraded":"2024-08-17T02:28:40.541840+0000","last_fullsized":"2024-08-17T02:28:40.541840+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:47:58.359450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.534183+0000","last_change":"2024-08-17T02:28:40.525634+0000","last_active":"2024-08-17T02:28:40.534183+0000","last_peered":"2024-08-17T02:28:40.534183+0000","last_clean":"2024-08-17T02:28:40.534183+0000","last_became_active":"2024-08-17T02:28:40.525325+0000","last_became_peered":"2024-08-17T02:28:40.525325+0000","last_unstale":"2024-08-17T02:28:40.534183+0000","last_undegraded":"2024-08-17T02:28:40.534183+0000","last_fullsized":"2024-08-17T02:28:40.534183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:18.022788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.535780+0000","last_change":"2024-08-17T02:28:40.533852+0000","last_active":"2024-08-17T02:28:40.535780+0000","last_peered":"2024-08-17T02:28:40.535780+0000","last_clean":"2024-08-17T02:28:40.535780+0000","last_became_active":"2024-08-17T02:28:40.533540+0000","last_became_peered":"2024-08-17T02:28:40.533540+0000","last_unstale":"2024-08-17T02:28:40.535780+0000","last_undegraded":"2024-08-17T02:28:40.535780+0000","last_fullsized":"2024-08-17T02:28:40.535780+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:12:27.152981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.548586+0000","last_change":"2024-08-17T02:28:40.545258+0000","last_active":"2024-08-17T02:28:40.548586+0000","last_peered":"2024-08-17T02:28:40.548586+0000","last_clean":"2024-08-17T02:28:40.548586+0000","last_became_active":"2024-08-17T02:28:40.544973+0000","last_became_peered":"2024-08-17T02:28:40.544973+0000","last_unstale":"2024-08-17T02:28:40.548586+0000","last_undegraded":"2024-08-17T02:28:40.548586+0000","last_fullsized":"2024-08-17T02:28:40.548586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:05.540034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.538986+0000","last_change":"2024-08-17T02:28:40.528376+0000","last_active":"2024-08-17T02:28:40.538986+0000","last_peered":"2024-08-17T02:28:40.538986+0000","last_clean":"2024-08-17T02:28:40.538986+0000","last_became_active":"2024-08-17T02:28:40.528137+0000","last_became_peered":"2024-08-17T02:28:40.528137+0000","last_unstale":"2024-08-17T02:28:40.538986+0000","last_undegraded":"2024-08-17T02:28:40.538986+0000","last_fullsized":"2024-08-17T02:28:40.538986+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:52:23.690788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.535052+0000","last_change":"2024-08-17T02:28:40.530302+0000","last_active":"2024-08-17T02:28:40.535052+0000","last_peered":"2024-08-17T02:28:40.535052+0000","last_clean":"2024-08-17T02:28:40.535052+0000","last_became_active":"2024-08-17T02:28:40.530085+0000","last_became_peered":"2024-08-17T02:28:40.530085+0000","last_unstale":"2024-08-17T02:28:40.535052+0000","last_undegraded":"2024-08-17T02:28:40.535052+0000","last_fullsized":"2024-08-17T02:28:40.535052+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:49:13.850770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.533269+0000","last_change":"2024-08-17T02:28:40.527406+0000","last_active":"2024-08-17T02:28:40.533269+0000","last_peered":"2024-08-17T02:28:40.533269+0000","last_clean":"2024-08-17T02:28:40.533269+0000","last_became_active":"2024-08-17T02:28:40.526627+0000","last_became_peered":"2024-08-17T02:28:40.526627+0000","last_unstale":"2024-08-17T02:28:40.533269+0000","last_undegraded":"2024-08-17T02:28:40.533269+0000","last_fullsized":"2024-08-17T02:28:40.533269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:43:00.460758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.535228+0000","last_change":"2024-08-17T02:28:40.528358+0000","last_active":"2024-08-17T02:28:40.535228+0000","last_peered":"2024-08-17T02:28:40.535228+0000","last_clean":"2024-08-17T02:28:40.535228+0000","last_became_active":"2024-08-17T02:28:40.527830+0000","last_became_peered":"2024-08-17T02:28:40.527830+0000","last_unstale":"2024-08-17T02:28:40.535228+0000","last_undegraded":"2024-08-17T02:28:40.535228+0000","last_fullsized":"2024-08-17T02:28:40.535228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:27:23.294901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.544371+0000","last_change":"2024-08-17T02:28:40.541514+0000","last_active":"2024-08-17T02:28:40.544371+0000","last_peered":"2024-08-17T02:28:40.544371+0000","last_clean":"2024-08-17T02:28:40.544371+0000","last_became_active":"2024-08-17T02:28:40.539684+0000","last_became_peered":"2024-08-17T02:28:40.539684+0000","last_unstale":"2024-08-17T02:28:40.544371+0000","last_undegraded":"2024-08-17T02:28:40.544371+0000","last_fullsized":"2024-08-17T02:28:40.544371+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:32:27.622020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.536605+0000","last_change":"2024-08-17T02:28:40.535116+0000","last_active":"2024-08-17T02:28:40.536605+0000","last_peered":"2024-08-17T02:28:40.536605+0000","last_clean":"2024-08-17T02:28:40.536605+0000","last_became_active":"2024-08-17T02:28:40.528062+0000","last_became_peered":"2024-08-17T02:28:40.528062+0000","last_unstale":"2024-08-17T02:28:40.536605+0000","last_undegraded":"2024-08-17T02:28:40.536605+0000","last_fullsized":"2024-08-17T02:28:40.536605+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:28.034779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.535490+0000","last_change":"2024-08-17T02:28:40.529700+0000","last_active":"2024-08-17T02:28:40.535490+0000","last_peered":"2024-08-17T02:28:40.535490+0000","last_clean":"2024-08-17T02:28:40.535490+0000","last_became_active":"2024-08-17T02:28:40.528834+0000","last_became_peered":"2024-08-17T02:28:40.528834+0000","last_unstale":"2024-08-17T02:28:40.535490+0000","last_undegraded":"2024-08-17T02:28:40.535490+0000","last_fullsized":"2024-08-17T02:28:40.535490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:18.022788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.548457+0000","last_change":"2024-08-17T02:28:40.541892+0000","last_active":"2024-08-17T02:28:40.548457+0000","last_peered":"2024-08-17T02:28:40.548457+0000","last_clean":"2024-08-17T02:28:40.548457+0000","last_became_active":"2024-08-17T02:28:40.540813+0000","last_became_peered":"2024-08-17T02:28:40.540813+0000","last_unstale":"2024-08-17T02:28:40.548457+0000","last_undegraded":"2024-08-17T02:28:40.548457+0000","last_fullsized":"2024-08-17T02:28:40.548457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:27:23.294901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.547302+0000","last_change":"2024-08-17T02:28:40.540416+0000","last_active":"2024-08-17T02:28:40.547302+0000","last_peered":"2024-08-17T02:28:40.547302+0000","last_clean":"2024-08-17T02:28:40.547302+0000","last_became_active":"2024-08-17T02:28:40.534149+0000","last_became_peered":"2024-08-17T02:28:40.534149+0000","last_unstale":"2024-08-17T02:28:40.547302+0000","last_undegraded":"2024-08-17T02:28:40.547302+0000","last_fullsized":"2024-08-17T02:28:40.547302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:18.022788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.534598+0000","last_change":"2024-08-17T02:28:40.526695+0000","last_active":"2024-08-17T02:28:40.534598+0000","last_peered":"2024-08-17T02:28:40.534598+0000","last_clean":"2024-08-17T02:28:40.534598+0000","last_became_active":"2024-08-17T02:28:40.526354+0000","last_became_peered":"2024-08-17T02:28:40.526354+0000","last_unstale":"2024-08-17T02:28:40.534598+0000","last_undegraded":"2024-08-17T02:28:40.534598+0000","last_fullsized":"2024-08-17T02:28:40.534598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:28:49.790619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.540818+0000","last_change":"2024-08-17T02:28:40.528687+0000","last_active":"2024-08-17T02:28:40.540818+0000","last_peered":"2024-08-17T02:28:40.540818+0000","last_clean":"2024-08-17T02:28:40.540818+0000","last_became_active":"2024-08-17T02:28:40.528420+0000","last_became_peered":"2024-08-17T02:28:40.528420+0000","last_unstale":"2024-08-17T02:28:40.540818+0000","last_undegraded":"2024-08-17T02:28:40.540818+0000","last_fullsized":"2024-08-17T02:28:40.540818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:50:30.415273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.544253+0000","last_change":"2024-08-17T02:28:40.538810+0000","last_active":"2024-08-17T02:28:40.544253+0000","last_peered":"2024-08-17T02:28:40.544253+0000","last_clean":"2024-08-17T02:28:40.544253+0000","last_became_active":"2024-08-17T02:28:40.538467+0000","last_became_peered":"2024-08-17T02:28:40.538467+0000","last_unstale":"2024-08-17T02:28:40.544253+0000","last_undegraded":"2024-08-17T02:28:40.544253+0000","last_fullsized":"2024-08-17T02:28:40.544253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:49:46.500534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.538768+0000","last_change":"2024-08-17T02:28:40.524951+0000","last_active":"2024-08-17T02:28:40.538768+0000","last_peered":"2024-08-17T02:28:40.538768+0000","last_clean":"2024-08-17T02:28:40.538768+0000","last_became_active":"2024-08-17T02:28:40.524707+0000","last_became_peered":"2024-08-17T02:28:40.524707+0000","last_unstale":"2024-08-17T02:28:40.538768+0000","last_undegraded":"2024-08-17T02:28:40.538768+0000","last_fullsized":"2024-08-17T02:28:40.538768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:26.872929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.540450+0000","last_change":"2024-08-17T02:28:40.532237+0000","last_active":"2024-08-17T02:28:40.540450+0000","last_peered":"2024-08-17T02:28:40.540450+0000","last_clean":"2024-08-17T02:28:40.540450+0000","last_became_active":"2024-08-17T02:28:40.531991+0000","last_became_peered":"2024-08-17T02:28:40.531991+0000","last_unstale":"2024-08-17T02:28:40.540450+0000","last_undegraded":"2024-08-17T02:28:40.540450+0000","last_fullsized":"2024-08-17T02:28:40.540450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:16:40.829492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.532202+0000","last_change":"2024-08-17T02:28:40.528256+0000","last_active":"2024-08-17T02:28:40.532202+0000","last_peered":"2024-08-17T02:28:40.532202+0000","last_clean":"2024-08-17T02:28:40.532202+0000","last_became_active":"2024-08-17T02:28:40.527993+0000","last_became_peered":"2024-08-17T02:28:40.527993+0000","last_unstale":"2024-08-17T02:28:40.532202+0000","last_undegraded":"2024-08-17T02:28:40.532202+0000","last_fullsized":"2024-08-17T02:28:40.532202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:32:27.622020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.542371+0000","last_change":"2024-08-17T02:28:40.537418+0000","last_active":"2024-08-17T02:28:40.542371+0000","last_peered":"2024-08-17T02:28:40.542371+0000","last_clean":"2024-08-17T02:28:40.542371+0000","last_became_active":"2024-08-17T02:28:40.533472+0000","last_became_peered":"2024-08-17T02:28:40.533472+0000","last_unstale":"2024-08-17T02:28:40.542371+0000","last_undegraded":"2024-08-17T02:28:40.542371+0000","last_fullsized":"2024-08-17T02:28:40.542371+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:22:21.827619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.535241+0000","last_change":"2024-08-17T02:28:40.531541+0000","last_active":"2024-08-17T02:28:40.535241+0000","last_peered":"2024-08-17T02:28:40.535241+0000","last_clean":"2024-08-17T02:28:40.535241+0000","last_became_active":"2024-08-17T02:28:40.528264+0000","last_became_peered":"2024-08-17T02:28:40.528264+0000","last_unstale":"2024-08-17T02:28:40.535241+0000","last_undegraded":"2024-08-17T02:28:40.535241+0000","last_fullsized":"2024-08-17T02:28:40.535241+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:12:27.152981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.543762+0000","last_change":"2024-08-17T02:28:40.530643+0000","last_active":"2024-08-17T02:28:40.543762+0000","last_peered":"2024-08-17T02:28:40.543762+0000","last_clean":"2024-08-17T02:28:40.543762+0000","last_became_active":"2024-08-17T02:28:40.530383+0000","last_became_peered":"2024-08-17T02:28:40.530383+0000","last_unstale":"2024-08-17T02:28:40.543762+0000","last_undegraded":"2024-08-17T02:28:40.543762+0000","last_fullsized":"2024-08-17T02:28:40.543762+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:09:04.951605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.541439+0000","last_change":"2024-08-17T02:28:40.534007+0000","last_active":"2024-08-17T02:28:40.541439+0000","last_peered":"2024-08-17T02:28:40.541439+0000","last_clean":"2024-08-17T02:28:40.541439+0000","last_became_active":"2024-08-17T02:28:40.533750+0000","last_became_peered":"2024-08-17T02:28:40.533750+0000","last_unstale":"2024-08-17T02:28:40.541439+0000","last_undegraded":"2024-08-17T02:28:40.541439+0000","last_fullsized":"2024-08-17T02:28:40.541439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:18.022788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.535112+0000","last_change":"2024-08-17T02:28:40.523831+0000","last_active":"2024-08-17T02:28:40.535112+0000","last_peered":"2024-08-17T02:28:40.535112+0000","last_clean":"2024-08-17T02:28:40.535112+0000","last_became_active":"2024-08-17T02:28:40.523586+0000","last_became_peered":"2024-08-17T02:28:40.523586+0000","last_unstale":"2024-08-17T02:28:40.535112+0000","last_undegraded":"2024-08-17T02:28:40.535112+0000","last_fullsized":"2024-08-17T02:28:40.535112+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:49:13.850770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.540636+0000","last_change":"2024-08-17T02:28:40.535994+0000","last_active":"2024-08-17T02:28:40.540636+0000","last_peered":"2024-08-17T02:28:40.540636+0000","last_clean":"2024-08-17T02:28:40.540636+0000","last_became_active":"2024-08-17T02:28:40.535738+0000","last_became_peered":"2024-08-17T02:28:40.535738+0000","last_unstale":"2024-08-17T02:28:40.540636+0000","last_undegraded":"2024-08-17T02:28:40.540636+0000","last_fullsized":"2024-08-17T02:28:40.540636+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:06:07.364340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.534995+0000","last_change":"2024-08-17T02:28:40.533608+0000","last_active":"2024-08-17T02:28:40.534995+0000","last_peered":"2024-08-17T02:28:40.534995+0000","last_clean":"2024-08-17T02:28:40.534995+0000","last_became_active":"2024-08-17T02:28:40.532530+0000","last_became_peered":"2024-08-17T02:28:40.532530+0000","last_unstale":"2024-08-17T02:28:40.534995+0000","last_undegraded":"2024-08-17T02:28:40.534995+0000","last_fullsized":"2024-08-17T02:28:40.534995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:49:13.850770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.542765+0000","last_change":"2024-08-17T02:28:40.537316+0000","last_active":"2024-08-17T02:28:40.542765+0000","last_peered":"2024-08-17T02:28:40.542765+0000","last_clean":"2024-08-17T02:28:40.542765+0000","last_became_active":"2024-08-17T02:28:40.528993+0000","last_became_peered":"2024-08-17T02:28:40.528993+0000","last_unstale":"2024-08-17T02:28:40.542765+0000","last_undegraded":"2024-08-17T02:28:40.542765+0000","last_fullsized":"2024-08-17T02:28:40.542765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:47:58.359450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.548555+0000","last_change":"2024-08-17T02:28:40.542132+0000","last_active":"2024-08-17T02:28:40.548555+0000","last_peered":"2024-08-17T02:28:40.548555+0000","last_clean":"2024-08-17T02:28:40.548555+0000","last_became_active":"2024-08-17T02:28:40.541181+0000","last_became_peered":"2024-08-17T02:28:40.541181+0000","last_unstale":"2024-08-17T02:28:40.548555+0000","last_undegraded":"2024-08-17T02:28:40.548555+0000","last_fullsized":"2024-08-17T02:28:40.548555+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:22:21.827619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.531148+0000","last_change":"2024-08-17T02:28:40.526501+0000","last_active":"2024-08-17T02:28:40.531148+0000","last_peered":"2024-08-17T02:28:40.531148+0000","last_clean":"2024-08-17T02:28:40.531148+0000","last_became_active":"2024-08-17T02:28:40.526257+0000","last_became_peered":"2024-08-17T02:28:40.526257+0000","last_unstale":"2024-08-17T02:28:40.531148+0000","last_undegraded":"2024-08-17T02:28:40.531148+0000","last_fullsized":"2024-08-17T02:28:40.531148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:34:23.586864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.550813+0000","last_change":"2024-08-17T02:28:39.520605+0000","last_active":"2024-08-17T02:28:40.550813+0000","last_peered":"2024-08-17T02:28:40.550813+0000","last_clean":"2024-08-17T02:28:40.550813+0000","last_became_active":"2024-08-17T02:28:39.520309+0000","last_became_peered":"2024-08-17T02:28:39.520309+0000","last_unstale":"2024-08-17T02:28:40.550813+0000","last_undegraded":"2024-08-17T02:28:40.550813+0000","last_fullsized":"2024-08-17T02:28:40.550813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:14:27.816420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.549580+0000","last_change":"2024-08-17T02:28:40.544057+0000","last_active":"2024-08-17T02:28:40.549580+0000","last_peered":"2024-08-17T02:28:40.549580+0000","last_clean":"2024-08-17T02:28:40.549580+0000","last_became_active":"2024-08-17T02:28:40.543112+0000","last_became_peered":"2024-08-17T02:28:40.543112+0000","last_unstale":"2024-08-17T02:28:40.549580+0000","last_undegraded":"2024-08-17T02:28:40.549580+0000","last_fullsized":"2024-08-17T02:28:40.549580+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:34:23.586864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.548787+0000","last_change":"2024-08-17T02:28:39.518592+0000","last_active":"2024-08-17T02:28:40.548787+0000","last_peered":"2024-08-17T02:28:40.548787+0000","last_clean":"2024-08-17T02:28:40.548787+0000","last_became_active":"2024-08-17T02:28:39.517612+0000","last_became_peered":"2024-08-17T02:28:39.517612+0000","last_unstale":"2024-08-17T02:28:40.548787+0000","last_undegraded":"2024-08-17T02:28:40.548787+0000","last_fullsized":"2024-08-17T02:28:40.548787+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:34:52.152840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.540668+0000","last_change":"2024-08-17T02:28:40.532666+0000","last_active":"2024-08-17T02:28:40.540668+0000","last_peered":"2024-08-17T02:28:40.540668+0000","last_clean":"2024-08-17T02:28:40.540668+0000","last_became_active":"2024-08-17T02:28:40.532240+0000","last_became_peered":"2024-08-17T02:28:40.532240+0000","last_unstale":"2024-08-17T02:28:40.540668+0000","last_undegraded":"2024-08-17T02:28:40.540668+0000","last_fullsized":"2024-08-17T02:28:40.540668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:34:23.586864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.546630+0000","last_change":"2024-08-17T02:28:39.521294+0000","last_active":"2024-08-17T02:28:40.546630+0000","last_peered":"2024-08-17T02:28:40.546630+0000","last_clean":"2024-08-17T02:28:40.546630+0000","last_became_active":"2024-08-17T02:28:39.521048+0000","last_became_peered":"2024-08-17T02:28:39.521048+0000","last_unstale":"2024-08-17T02:28:40.546630+0000","last_undegraded":"2024-08-17T02:28:40.546630+0000","last_fullsized":"2024-08-17T02:28:40.546630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:47:57.353610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.535326+0000","last_change":"2024-08-17T02:28:40.529463+0000","last_active":"2024-08-17T02:28:40.535326+0000","last_peered":"2024-08-17T02:28:40.535326+0000","last_clean":"2024-08-17T02:28:40.535326+0000","last_became_active":"2024-08-17T02:28:40.528099+0000","last_became_peered":"2024-08-17T02:28:40.528099+0000","last_unstale":"2024-08-17T02:28:40.535326+0000","last_undegraded":"2024-08-17T02:28:40.535326+0000","last_fullsized":"2024-08-17T02:28:40.535326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:27:23.294901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.548727+0000","last_change":"2024-08-17T02:28:39.521237+0000","last_active":"2024-08-17T02:28:40.548727+0000","last_peered":"2024-08-17T02:28:40.548727+0000","last_clean":"2024-08-17T02:28:40.548727+0000","last_became_active":"2024-08-17T02:28:39.520972+0000","last_became_peered":"2024-08-17T02:28:39.520972+0000","last_unstale":"2024-08-17T02:28:40.548727+0000","last_undegraded":"2024-08-17T02:28:40.548727+0000","last_fullsized":"2024-08-17T02:28:40.548727+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:10.912578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.547552+0000","last_change":"2024-08-17T02:28:40.540864+0000","last_active":"2024-08-17T02:28:40.547552+0000","last_peered":"2024-08-17T02:28:40.547552+0000","last_clean":"2024-08-17T02:28:40.547552+0000","last_became_active":"2024-08-17T02:28:40.540555+0000","last_became_peered":"2024-08-17T02:28:40.540555+0000","last_unstale":"2024-08-17T02:28:40.547552+0000","last_undegraded":"2024-08-17T02:28:40.547552+0000","last_fullsized":"2024-08-17T02:28:40.547552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:00.714390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.548427+0000","last_change":"2024-08-17T02:28:39.521624+0000","last_active":"2024-08-17T02:28:40.548427+0000","last_peered":"2024-08-17T02:28:40.548427+0000","last_clean":"2024-08-17T02:28:40.548427+0000","last_became_active":"2024-08-17T02:28:39.519671+0000","last_became_peered":"2024-08-17T02:28:39.519671+0000","last_unstale":"2024-08-17T02:28:40.548427+0000","last_undegraded":"2024-08-17T02:28:40.548427+0000","last_fullsized":"2024-08-17T02:28:40.548427+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:10.912578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.535054+0000","last_change":"2024-08-17T02:28:40.522743+0000","last_active":"2024-08-17T02:28:40.535054+0000","last_peered":"2024-08-17T02:28:40.535054+0000","last_clean":"2024-08-17T02:28:40.535054+0000","last_became_active":"2024-08-17T02:28:40.522472+0000","last_became_peered":"2024-08-17T02:28:40.522472+0000","last_unstale":"2024-08-17T02:28:40.535054+0000","last_undegraded":"2024-08-17T02:28:40.535054+0000","last_fullsized":"2024-08-17T02:28:40.535054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:12:27.152981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.548390+0000","last_change":"2024-08-17T02:28:39.514002+0000","last_active":"2024-08-17T02:28:40.548390+0000","last_peered":"2024-08-17T02:28:40.548390+0000","last_clean":"2024-08-17T02:28:40.548390+0000","last_became_active":"2024-08-17T02:28:39.513416+0000","last_became_peered":"2024-08-17T02:28:39.513416+0000","last_unstale":"2024-08-17T02:28:40.548390+0000","last_undegraded":"2024-08-17T02:28:40.548390+0000","last_fullsized":"2024-08-17T02:28:40.548390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:57:16.873631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.540397+0000","last_change":"2024-08-17T02:28:40.530560+0000","last_active":"2024-08-17T02:28:40.540397+0000","last_peered":"2024-08-17T02:28:40.540397+0000","last_clean":"2024-08-17T02:28:40.540397+0000","last_became_active":"2024-08-17T02:28:40.529618+0000","last_became_peered":"2024-08-17T02:28:40.529618+0000","last_unstale":"2024-08-17T02:28:40.540397+0000","last_undegraded":"2024-08-17T02:28:40.540397+0000","last_fullsized":"2024-08-17T02:28:40.540397+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:37.372109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.523257+0000","last_change":"2024-08-17T02:28:39.513505+0000","last_active":"2024-08-17T02:28:40.523257+0000","last_peered":"2024-08-17T02:28:40.523257+0000","last_clean":"2024-08-17T02:28:40.523257+0000","last_became_active":"2024-08-17T02:28:39.513225+0000","last_became_peered":"2024-08-17T02:28:39.513225+0000","last_unstale":"2024-08-17T02:28:40.523257+0000","last_undegraded":"2024-08-17T02:28:40.523257+0000","last_fullsized":"2024-08-17T02:28:40.523257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:32:26.616180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.524256+0000","last_change":"2024-08-17T02:28:40.520123+0000","last_active":"2024-08-17T02:28:40.524256+0000","last_peered":"2024-08-17T02:28:40.524256+0000","last_clean":"2024-08-17T02:28:40.524256+0000","last_became_active":"2024-08-17T02:28:40.517545+0000","last_became_peered":"2024-08-17T02:28:40.517545+0000","last_unstale":"2024-08-17T02:28:40.524256+0000","last_undegraded":"2024-08-17T02:28:40.524256+0000","last_fullsized":"2024-08-17T02:28:40.524256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:22:21.827619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.515245+0000","last_change":"2024-08-17T02:28:39.520014+0000","last_active":"2024-08-17T02:28:40.515245+0000","last_peered":"2024-08-17T02:28:40.515245+0000","last_clean":"2024-08-17T02:28:40.515245+0000","last_became_active":"2024-08-17T02:28:39.518708+0000","last_became_peered":"2024-08-17T02:28:39.518708+0000","last_unstale":"2024-08-17T02:28:40.515245+0000","last_undegraded":"2024-08-17T02:28:40.515245+0000","last_fullsized":"2024-08-17T02:28:40.515245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:56:37.898150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.535461+0000","last_change":"2024-08-17T02:28:40.528549+0000","last_active":"2024-08-17T02:28:40.535461+0000","last_peered":"2024-08-17T02:28:40.535461+0000","last_clean":"2024-08-17T02:28:40.535461+0000","last_became_active":"2024-08-17T02:28:40.528281+0000","last_became_peered":"2024-08-17T02:28:40.528281+0000","last_unstale":"2024-08-17T02:28:40.535461+0000","last_undegraded":"2024-08-17T02:28:40.535461+0000","last_fullsized":"2024-08-17T02:28:40.535461+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:28.034779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.533797+0000","last_change":"2024-08-17T02:28:39.519240+0000","last_active":"2024-08-17T02:28:40.533797+0000","last_peered":"2024-08-17T02:28:40.533797+0000","last_clean":"2024-08-17T02:28:40.533797+0000","last_became_active":"2024-08-17T02:28:39.519051+0000","last_became_peered":"2024-08-17T02:28:39.519051+0000","last_unstale":"2024-08-17T02:28:40.533797+0000","last_undegraded":"2024-08-17T02:28:40.533797+0000","last_fullsized":"2024-08-17T02:28:40.533797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:15:35.234765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.534430+0000","last_change":"2024-08-17T02:28:40.525531+0000","last_active":"2024-08-17T02:28:40.534430+0000","last_peered":"2024-08-17T02:28:40.534430+0000","last_clean":"2024-08-17T02:28:40.534430+0000","last_became_active":"2024-08-17T02:28:40.525295+0000","last_became_peered":"2024-08-17T02:28:40.525295+0000","last_unstale":"2024-08-17T02:28:40.534430+0000","last_undegraded":"2024-08-17T02:28:40.534430+0000","last_fullsized":"2024-08-17T02:28:40.534430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:23:13.667975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.511286+0000","last_change":"2024-08-17T02:28:39.515580+0000","last_active":"2024-08-17T02:28:40.511286+0000","last_peered":"2024-08-17T02:28:40.511286+0000","last_clean":"2024-08-17T02:28:40.511286+0000","last_became_active":"2024-08-17T02:28:39.515338+0000","last_became_peered":"2024-08-17T02:28:39.515338+0000","last_unstale":"2024-08-17T02:28:40.511286+0000","last_undegraded":"2024-08-17T02:28:40.511286+0000","last_fullsized":"2024-08-17T02:28:40.511286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:03:02.162597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.534673+0000","last_change":"2024-08-17T02:28:40.530336+0000","last_active":"2024-08-17T02:28:40.534673+0000","last_peered":"2024-08-17T02:28:40.534673+0000","last_clean":"2024-08-17T02:28:40.534673+0000","last_became_active":"2024-08-17T02:28:40.530062+0000","last_became_peered":"2024-08-17T02:28:40.530062+0000","last_unstale":"2024-08-17T02:28:40.534673+0000","last_undegraded":"2024-08-17T02:28:40.534673+0000","last_fullsized":"2024-08-17T02:28:40.534673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:43:00.460758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.548808+0000","last_change":"2024-08-17T02:28:39.518305+0000","last_active":"2024-08-17T02:28:40.548808+0000","last_peered":"2024-08-17T02:28:40.548808+0000","last_clean":"2024-08-17T02:28:40.548808+0000","last_became_active":"2024-08-17T02:28:39.518096+0000","last_became_peered":"2024-08-17T02:28:39.518096+0000","last_unstale":"2024-08-17T02:28:40.548808+0000","last_undegraded":"2024-08-17T02:28:40.548808+0000","last_fullsized":"2024-08-17T02:28:40.548808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:49:45.494694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.535023+0000","last_change":"2024-08-17T02:28:40.523157+0000","last_active":"2024-08-17T02:28:40.535023+0000","last_peered":"2024-08-17T02:28:40.535023+0000","last_clean":"2024-08-17T02:28:40.535023+0000","last_became_active":"2024-08-17T02:28:40.522533+0000","last_became_peered":"2024-08-17T02:28:40.522533+0000","last_unstale":"2024-08-17T02:28:40.535023+0000","last_undegraded":"2024-08-17T02:28:40.535023+0000","last_fullsized":"2024-08-17T02:28:40.535023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:09:04.951605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.550406+0000","last_change":"2024-08-17T02:28:39.522124+0000","last_active":"2024-08-17T02:28:40.550406+0000","last_peered":"2024-08-17T02:28:40.550406+0000","last_clean":"2024-08-17T02:28:40.550406+0000","last_became_active":"2024-08-17T02:28:39.521949+0000","last_became_peered":"2024-08-17T02:28:39.521949+0000","last_unstale":"2024-08-17T02:28:40.550406+0000","last_undegraded":"2024-08-17T02:28:40.550406+0000","last_fullsized":"2024-08-17T02:28:40.550406+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:49:45.494694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.534021+0000","last_change":"2024-08-17T02:28:40.521305+0000","last_active":"2024-08-17T02:28:40.534021+0000","last_peered":"2024-08-17T02:28:40.534021+0000","last_clean":"2024-08-17T02:28:40.534021+0000","last_became_active":"2024-08-17T02:28:40.520995+0000","last_became_peered":"2024-08-17T02:28:40.520995+0000","last_unstale":"2024-08-17T02:28:40.534021+0000","last_undegraded":"2024-08-17T02:28:40.534021+0000","last_fullsized":"2024-08-17T02:28:40.534021+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:00.714390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.550623+0000","last_change":"2024-08-17T02:28:39.521995+0000","last_active":"2024-08-17T02:28:40.550623+0000","last_peered":"2024-08-17T02:28:40.550623+0000","last_clean":"2024-08-17T02:28:40.550623+0000","last_became_active":"2024-08-17T02:28:39.520324+0000","last_became_peered":"2024-08-17T02:28:39.520324+0000","last_unstale":"2024-08-17T02:28:40.550623+0000","last_undegraded":"2024-08-17T02:28:40.550623+0000","last_fullsized":"2024-08-17T02:28:40.550623+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:01:21.739302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.534635+0000","last_change":"2024-08-17T02:28:40.530462+0000","last_active":"2024-08-17T02:28:40.534635+0000","last_peered":"2024-08-17T02:28:40.534635+0000","last_clean":"2024-08-17T02:28:40.534635+0000","last_became_active":"2024-08-17T02:28:40.530143+0000","last_became_peered":"2024-08-17T02:28:40.530143+0000","last_unstale":"2024-08-17T02:28:40.534635+0000","last_undegraded":"2024-08-17T02:28:40.534635+0000","last_fullsized":"2024-08-17T02:28:40.534635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:12:27.152981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.512903+0000","last_change":"2024-08-17T02:28:39.523218+0000","last_active":"2024-08-17T02:28:40.512903+0000","last_peered":"2024-08-17T02:28:40.512903+0000","last_clean":"2024-08-17T02:28:40.512903+0000","last_became_active":"2024-08-17T02:28:39.522642+0000","last_became_peered":"2024-08-17T02:28:39.522642+0000","last_unstale":"2024-08-17T02:28:40.512903+0000","last_undegraded":"2024-08-17T02:28:40.512903+0000","last_fullsized":"2024-08-17T02:28:40.512903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:47:57.353610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.548569+0000","last_change":"2024-08-17T02:28:40.542346+0000","last_active":"2024-08-17T02:28:40.548569+0000","last_peered":"2024-08-17T02:28:40.548569+0000","last_clean":"2024-08-17T02:28:40.548569+0000","last_became_active":"2024-08-17T02:28:40.541608+0000","last_became_peered":"2024-08-17T02:28:40.541608+0000","last_unstale":"2024-08-17T02:28:40.548569+0000","last_undegraded":"2024-08-17T02:28:40.548569+0000","last_fullsized":"2024-08-17T02:28:40.548569+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:07:31.033049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.523884+0000","last_change":"2024-08-17T02:28:39.517945+0000","last_active":"2024-08-17T02:28:40.523884+0000","last_peered":"2024-08-17T02:28:40.523884+0000","last_clean":"2024-08-17T02:28:40.523884+0000","last_became_active":"2024-08-17T02:28:39.517683+0000","last_became_peered":"2024-08-17T02:28:39.517683+0000","last_unstale":"2024-08-17T02:28:40.523884+0000","last_undegraded":"2024-08-17T02:28:40.523884+0000","last_fullsized":"2024-08-17T02:28:40.523884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:58.510911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.542253+0000","last_change":"2024-08-17T02:28:40.525424+0000","last_active":"2024-08-17T02:28:40.542253+0000","last_peered":"2024-08-17T02:28:40.542253+0000","last_clean":"2024-08-17T02:28:40.542253+0000","last_became_active":"2024-08-17T02:28:40.524146+0000","last_became_peered":"2024-08-17T02:28:40.524146+0000","last_unstale":"2024-08-17T02:28:40.542253+0000","last_undegraded":"2024-08-17T02:28:40.542253+0000","last_fullsized":"2024-08-17T02:28:40.542253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:06:07.364340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.548481+0000","last_change":"2024-08-17T02:28:39.516455+0000","last_active":"2024-08-17T02:28:40.548481+0000","last_peered":"2024-08-17T02:28:40.548481+0000","last_clean":"2024-08-17T02:28:40.548481+0000","last_became_active":"2024-08-17T02:28:39.515787+0000","last_became_peered":"2024-08-17T02:28:39.515787+0000","last_unstale":"2024-08-17T02:28:40.548481+0000","last_undegraded":"2024-08-17T02:28:40.548481+0000","last_fullsized":"2024-08-17T02:28:40.548481+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:36.713899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.540428+0000","last_change":"2024-08-17T02:28:40.531510+0000","last_active":"2024-08-17T02:28:40.540428+0000","last_peered":"2024-08-17T02:28:40.540428+0000","last_clean":"2024-08-17T02:28:40.540428+0000","last_became_active":"2024-08-17T02:28:40.531292+0000","last_became_peered":"2024-08-17T02:28:40.531292+0000","last_unstale":"2024-08-17T02:28:40.540428+0000","last_undegraded":"2024-08-17T02:28:40.540428+0000","last_fullsized":"2024-08-17T02:28:40.540428+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:45.274774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.546093+0000","last_change":"2024-08-17T02:28:39.523804+0000","last_active":"2024-08-17T02:28:40.546093+0000","last_peered":"2024-08-17T02:28:40.546093+0000","last_clean":"2024-08-17T02:28:40.546093+0000","last_became_active":"2024-08-17T02:28:39.523528+0000","last_became_peered":"2024-08-17T02:28:39.523528+0000","last_unstale":"2024-08-17T02:28:40.546093+0000","last_undegraded":"2024-08-17T02:28:40.546093+0000","last_fullsized":"2024-08-17T02:28:40.546093+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:36.713899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.530869+0000","last_change":"2024-08-17T02:28:40.522831+0000","last_active":"2024-08-17T02:28:40.530869+0000","last_peered":"2024-08-17T02:28:40.530869+0000","last_clean":"2024-08-17T02:28:40.530869+0000","last_became_active":"2024-08-17T02:28:40.522567+0000","last_became_peered":"2024-08-17T02:28:40.522567+0000","last_unstale":"2024-08-17T02:28:40.530869+0000","last_undegraded":"2024-08-17T02:28:40.530869+0000","last_fullsized":"2024-08-17T02:28:40.530869+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:05.540034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.550292+0000","last_change":"2024-08-17T02:28:39.521650+0000","last_active":"2024-08-17T02:28:40.550292+0000","last_peered":"2024-08-17T02:28:40.550292+0000","last_clean":"2024-08-17T02:28:40.550292+0000","last_became_active":"2024-08-17T02:28:39.519645+0000","last_became_peered":"2024-08-17T02:28:39.519645+0000","last_unstale":"2024-08-17T02:28:40.550292+0000","last_undegraded":"2024-08-17T02:28:40.550292+0000","last_fullsized":"2024-08-17T02:28:40.550292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:14:27.816420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.525615+0000","last_change":"2024-08-17T02:28:40.520957+0000","last_active":"2024-08-17T02:28:40.525615+0000","last_peered":"2024-08-17T02:28:40.525615+0000","last_clean":"2024-08-17T02:28:40.525615+0000","last_became_active":"2024-08-17T02:28:40.520693+0000","last_became_peered":"2024-08-17T02:28:40.520693+0000","last_unstale":"2024-08-17T02:28:40.525615+0000","last_undegraded":"2024-08-17T02:28:40.525615+0000","last_fullsized":"2024-08-17T02:28:40.525615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:28.034779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.550226+0000","last_change":"2024-08-17T02:28:39.513039+0000","last_active":"2024-08-17T02:28:40.550226+0000","last_peered":"2024-08-17T02:28:40.550226+0000","last_clean":"2024-08-17T02:28:40.550226+0000","last_became_active":"2024-08-17T02:28:39.512509+0000","last_became_peered":"2024-08-17T02:28:39.512509+0000","last_unstale":"2024-08-17T02:28:40.550226+0000","last_undegraded":"2024-08-17T02:28:40.550226+0000","last_fullsized":"2024-08-17T02:28:40.550226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:06:47.930710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.535929+0000","last_change":"2024-08-17T02:28:40.534248+0000","last_active":"2024-08-17T02:28:40.535929+0000","last_peered":"2024-08-17T02:28:40.535929+0000","last_clean":"2024-08-17T02:28:40.535929+0000","last_became_active":"2024-08-17T02:28:40.533991+0000","last_became_peered":"2024-08-17T02:28:40.533991+0000","last_unstale":"2024-08-17T02:28:40.535929+0000","last_undegraded":"2024-08-17T02:28:40.535929+0000","last_fullsized":"2024-08-17T02:28:40.535929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:26.872929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.517436+0000","last_change":"2024-08-17T02:28:39.515205+0000","last_active":"2024-08-17T02:28:40.517436+0000","last_peered":"2024-08-17T02:28:40.517436+0000","last_clean":"2024-08-17T02:28:40.517436+0000","last_became_active":"2024-08-17T02:28:39.514296+0000","last_became_peered":"2024-08-17T02:28:39.514296+0000","last_unstale":"2024-08-17T02:28:40.517436+0000","last_undegraded":"2024-08-17T02:28:40.517436+0000","last_fullsized":"2024-08-17T02:28:40.517436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:37:50.879083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.528979+0000","last_change":"2024-08-17T02:28:40.525657+0000","last_active":"2024-08-17T02:28:40.528979+0000","last_peered":"2024-08-17T02:28:40.528979+0000","last_clean":"2024-08-17T02:28:40.528979+0000","last_became_active":"2024-08-17T02:28:40.525424+0000","last_became_peered":"2024-08-17T02:28:40.525424+0000","last_unstale":"2024-08-17T02:28:40.528979+0000","last_undegraded":"2024-08-17T02:28:40.528979+0000","last_fullsized":"2024-08-17T02:28:40.528979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:16:40.829492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.548985+0000","last_change":"2024-08-17T02:28:39.513052+0000","last_active":"2024-08-17T02:28:40.548985+0000","last_peered":"2024-08-17T02:28:40.548985+0000","last_clean":"2024-08-17T02:28:40.548985+0000","last_became_active":"2024-08-17T02:28:39.512760+0000","last_became_peered":"2024-08-17T02:28:39.512760+0000","last_unstale":"2024-08-17T02:28:40.548985+0000","last_undegraded":"2024-08-17T02:28:40.548985+0000","last_fullsized":"2024-08-17T02:28:40.548985+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:08:18.318555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.528973+0000","last_change":"2024-08-17T02:28:40.527299+0000","last_active":"2024-08-17T02:28:40.528973+0000","last_peered":"2024-08-17T02:28:40.528973+0000","last_clean":"2024-08-17T02:28:40.528973+0000","last_became_active":"2024-08-17T02:28:40.527033+0000","last_became_peered":"2024-08-17T02:28:40.527033+0000","last_unstale":"2024-08-17T02:28:40.528973+0000","last_undegraded":"2024-08-17T02:28:40.528973+0000","last_fullsized":"2024-08-17T02:28:40.528973+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:15:36.240605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.525067+0000","last_change":"2024-08-17T02:28:39.525240+0000","last_active":"2024-08-17T02:28:40.525067+0000","last_peered":"2024-08-17T02:28:40.525067+0000","last_clean":"2024-08-17T02:28:40.525067+0000","last_became_active":"2024-08-17T02:28:39.525025+0000","last_became_peered":"2024-08-17T02:28:39.525025+0000","last_unstale":"2024-08-17T02:28:40.525067+0000","last_undegraded":"2024-08-17T02:28:40.525067+0000","last_fullsized":"2024-08-17T02:28:40.525067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:56:37.898150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.532030+0000","last_change":"2024-08-17T02:28:40.528259+0000","last_active":"2024-08-17T02:28:40.532030+0000","last_peered":"2024-08-17T02:28:40.532030+0000","last_clean":"2024-08-17T02:28:40.532030+0000","last_became_active":"2024-08-17T02:28:40.528054+0000","last_became_peered":"2024-08-17T02:28:40.528054+0000","last_unstale":"2024-08-17T02:28:40.532030+0000","last_undegraded":"2024-08-17T02:28:40.532030+0000","last_fullsized":"2024-08-17T02:28:40.532030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:06:07.364340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.515243+0000","last_change":"2024-08-17T02:28:39.524498+0000","last_active":"2024-08-17T02:28:40.515243+0000","last_peered":"2024-08-17T02:28:40.515243+0000","last_clean":"2024-08-17T02:28:40.515243+0000","last_became_active":"2024-08-17T02:28:39.524230+0000","last_became_peered":"2024-08-17T02:28:39.524230+0000","last_unstale":"2024-08-17T02:28:40.515243+0000","last_undegraded":"2024-08-17T02:28:40.515243+0000","last_fullsized":"2024-08-17T02:28:40.515243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:33.214446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.545189+0000","last_change":"2024-08-17T02:28:40.535690+0000","last_active":"2024-08-17T02:28:40.545189+0000","last_peered":"2024-08-17T02:28:40.545189+0000","last_clean":"2024-08-17T02:28:40.545189+0000","last_became_active":"2024-08-17T02:28:40.533178+0000","last_became_peered":"2024-08-17T02:28:40.533178+0000","last_unstale":"2024-08-17T02:28:40.545189+0000","last_undegraded":"2024-08-17T02:28:40.545189+0000","last_fullsized":"2024-08-17T02:28:40.545189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:28.034779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.512167+0000","last_change":"2024-08-17T02:28:39.511566+0000","last_active":"2024-08-17T02:28:40.512167+0000","last_peered":"2024-08-17T02:28:40.512167+0000","last_clean":"2024-08-17T02:28:40.512167+0000","last_became_active":"2024-08-17T02:28:39.511284+0000","last_became_peered":"2024-08-17T02:28:39.511284+0000","last_unstale":"2024-08-17T02:28:40.512167+0000","last_undegraded":"2024-08-17T02:28:40.512167+0000","last_fullsized":"2024-08-17T02:28:40.512167+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:15:35.234765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.544301+0000","last_change":"2024-08-17T02:28:40.538818+0000","last_active":"2024-08-17T02:28:40.544301+0000","last_peered":"2024-08-17T02:28:40.544301+0000","last_clean":"2024-08-17T02:28:40.544301+0000","last_became_active":"2024-08-17T02:28:40.538453+0000","last_became_peered":"2024-08-17T02:28:40.538453+0000","last_unstale":"2024-08-17T02:28:40.544301+0000","last_undegraded":"2024-08-17T02:28:40.544301+0000","last_fullsized":"2024-08-17T02:28:40.544301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:34:23.586864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.547412+0000","last_change":"2024-08-17T02:28:39.524900+0000","last_active":"2024-08-17T02:28:40.547412+0000","last_peered":"2024-08-17T02:28:40.547412+0000","last_clean":"2024-08-17T02:28:40.547412+0000","last_became_active":"2024-08-17T02:28:39.524607+0000","last_became_peered":"2024-08-17T02:28:39.524607+0000","last_unstale":"2024-08-17T02:28:40.547412+0000","last_undegraded":"2024-08-17T02:28:40.547412+0000","last_fullsized":"2024-08-17T02:28:40.547412+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:15:35.234765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.530852+0000","last_change":"2024-08-17T02:28:40.522315+0000","last_active":"2024-08-17T02:28:40.530852+0000","last_peered":"2024-08-17T02:28:40.530852+0000","last_clean":"2024-08-17T02:28:40.530852+0000","last_became_active":"2024-08-17T02:28:40.522018+0000","last_became_peered":"2024-08-17T02:28:40.522018+0000","last_unstale":"2024-08-17T02:28:40.530852+0000","last_undegraded":"2024-08-17T02:28:40.530852+0000","last_fullsized":"2024-08-17T02:28:40.530852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:43:00.460758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:28:42.690010+0000","last_change":"2024-08-17T02:28:39.524072+0000","last_active":"2024-08-17T02:28:42.690010+0000","last_peered":"2024-08-17T02:28:42.690010+0000","last_clean":"2024-08-17T02:28:42.690010+0000","last_became_active":"2024-08-17T02:28:39.523818+0000","last_became_peered":"2024-08-17T02:28:39.523818+0000","last_unstale":"2024-08-17T02:28:42.690010+0000","last_undegraded":"2024-08-17T02:28:42.690010+0000","last_fullsized":"2024-08-17T02:28:42.690010+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:01:21.739302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.527456+0000","last_change":"2024-08-17T02:28:40.522941+0000","last_active":"2024-08-17T02:28:40.527456+0000","last_peered":"2024-08-17T02:28:40.527456+0000","last_clean":"2024-08-17T02:28:40.527456+0000","last_became_active":"2024-08-17T02:28:40.522629+0000","last_became_peered":"2024-08-17T02:28:40.522629+0000","last_unstale":"2024-08-17T02:28:40.527456+0000","last_undegraded":"2024-08-17T02:28:40.527456+0000","last_fullsized":"2024-08-17T02:28:40.527456+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:06:07.364340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.513108+0000","last_change":"2024-08-17T02:28:39.526302+0000","last_active":"2024-08-17T02:28:40.513108+0000","last_peered":"2024-08-17T02:28:40.513108+0000","last_clean":"2024-08-17T02:28:40.513108+0000","last_became_active":"2024-08-17T02:28:39.525515+0000","last_became_peered":"2024-08-17T02:28:39.525515+0000","last_unstale":"2024-08-17T02:28:40.513108+0000","last_undegraded":"2024-08-17T02:28:40.513108+0000","last_fullsized":"2024-08-17T02:28:40.513108+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:49:45.494694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.538888+0000","last_change":"2024-08-17T02:28:40.525216+0000","last_active":"2024-08-17T02:28:40.538888+0000","last_peered":"2024-08-17T02:28:40.538888+0000","last_clean":"2024-08-17T02:28:40.538888+0000","last_became_active":"2024-08-17T02:28:40.524492+0000","last_became_peered":"2024-08-17T02:28:40.524492+0000","last_unstale":"2024-08-17T02:28:40.538888+0000","last_undegraded":"2024-08-17T02:28:40.538888+0000","last_fullsized":"2024-08-17T02:28:40.538888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:49:46.500534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.510861+0000","last_change":"2024-08-17T02:28:39.510556+0000","last_active":"2024-08-17T02:28:40.510861+0000","last_peered":"2024-08-17T02:28:40.510861+0000","last_clean":"2024-08-17T02:28:40.510861+0000","last_became_active":"2024-08-17T02:28:39.510309+0000","last_became_peered":"2024-08-17T02:28:39.510309+0000","last_unstale":"2024-08-17T02:28:40.510861+0000","last_undegraded":"2024-08-17T02:28:40.510861+0000","last_fullsized":"2024-08-17T02:28:40.510861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:56:37.898150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.532396+0000","last_change":"2024-08-17T02:28:40.529787+0000","last_active":"2024-08-17T02:28:40.532396+0000","last_peered":"2024-08-17T02:28:40.532396+0000","last_clean":"2024-08-17T02:28:40.532396+0000","last_became_active":"2024-08-17T02:28:40.529361+0000","last_became_peered":"2024-08-17T02:28:40.529361+0000","last_unstale":"2024-08-17T02:28:40.532396+0000","last_undegraded":"2024-08-17T02:28:40.532396+0000","last_fullsized":"2024-08-17T02:28:40.532396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:47:58.359450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.512986+0000","last_change":"2024-08-17T02:28:39.524519+0000","last_active":"2024-08-17T02:28:40.512986+0000","last_peered":"2024-08-17T02:28:40.512986+0000","last_clean":"2024-08-17T02:28:40.512986+0000","last_became_active":"2024-08-17T02:28:39.524227+0000","last_became_peered":"2024-08-17T02:28:39.524227+0000","last_unstale":"2024-08-17T02:28:40.512986+0000","last_undegraded":"2024-08-17T02:28:40.512986+0000","last_fullsized":"2024-08-17T02:28:40.512986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:58.510911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.534084+0000","last_change":"2024-08-17T02:28:40.526109+0000","last_active":"2024-08-17T02:28:40.534084+0000","last_peered":"2024-08-17T02:28:40.534084+0000","last_clean":"2024-08-17T02:28:40.534084+0000","last_became_active":"2024-08-17T02:28:40.525852+0000","last_became_peered":"2024-08-17T02:28:40.525852+0000","last_unstale":"2024-08-17T02:28:40.534084+0000","last_undegraded":"2024-08-17T02:28:40.534084+0000","last_fullsized":"2024-08-17T02:28:40.534084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:05.540034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.515340+0000","last_change":"2024-08-17T02:28:39.525106+0000","last_active":"2024-08-17T02:28:40.515340+0000","last_peered":"2024-08-17T02:28:40.515340+0000","last_clean":"2024-08-17T02:28:40.515340+0000","last_became_active":"2024-08-17T02:28:39.524381+0000","last_became_peered":"2024-08-17T02:28:39.524381+0000","last_unstale":"2024-08-17T02:28:40.515340+0000","last_undegraded":"2024-08-17T02:28:40.515340+0000","last_fullsized":"2024-08-17T02:28:40.515340+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:43:29.281149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.540552+0000","last_change":"2024-08-17T02:28:40.533104+0000","last_active":"2024-08-17T02:28:40.540552+0000","last_peered":"2024-08-17T02:28:40.540552+0000","last_clean":"2024-08-17T02:28:40.540552+0000","last_became_active":"2024-08-17T02:28:40.532749+0000","last_became_peered":"2024-08-17T02:28:40.532749+0000","last_unstale":"2024-08-17T02:28:40.540552+0000","last_undegraded":"2024-08-17T02:28:40.540552+0000","last_fullsized":"2024-08-17T02:28:40.540552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:32:27.622020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.520587+0000","last_change":"2024-08-17T02:28:39.519382+0000","last_active":"2024-08-17T02:28:40.520587+0000","last_peered":"2024-08-17T02:28:40.520587+0000","last_clean":"2024-08-17T02:28:40.520587+0000","last_became_active":"2024-08-17T02:28:39.519037+0000","last_became_peered":"2024-08-17T02:28:39.519037+0000","last_unstale":"2024-08-17T02:28:40.520587+0000","last_undegraded":"2024-08-17T02:28:40.520587+0000","last_fullsized":"2024-08-17T02:28:40.520587+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:23:41.936601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.533422+0000","last_change":"2024-08-17T02:28:40.529258+0000","last_active":"2024-08-17T02:28:40.533422+0000","last_peered":"2024-08-17T02:28:40.533422+0000","last_clean":"2024-08-17T02:28:40.533422+0000","last_became_active":"2024-08-17T02:28:40.528993+0000","last_became_peered":"2024-08-17T02:28:40.528993+0000","last_unstale":"2024-08-17T02:28:40.533422+0000","last_undegraded":"2024-08-17T02:28:40.533422+0000","last_fullsized":"2024-08-17T02:28:40.533422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:52:23.690788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.525578+0000","last_change":"2024-08-17T02:28:39.520713+0000","last_active":"2024-08-17T02:28:40.525578+0000","last_peered":"2024-08-17T02:28:40.525578+0000","last_clean":"2024-08-17T02:28:40.525578+0000","last_became_active":"2024-08-17T02:28:39.519650+0000","last_became_peered":"2024-08-17T02:28:39.519650+0000","last_unstale":"2024-08-17T02:28:40.525578+0000","last_undegraded":"2024-08-17T02:28:40.525578+0000","last_fullsized":"2024-08-17T02:28:40.525578+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:01:21.739302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.519841+0000","last_change":"2024-08-17T02:27:39.552321+0000","last_active":"2024-08-17T02:28:40.519841+0000","last_peered":"2024-08-17T02:28:40.519841+0000","last_clean":"2024-08-17T02:28:40.519841+0000","last_became_active":"2024-08-17T02:27:39.551203+0000","last_became_peered":"2024-08-17T02:27:39.551203+0000","last_unstale":"2024-08-17T02:28:40.519841+0000","last_undegraded":"2024-08-17T02:28:40.519841+0000","last_fullsized":"2024-08-17T02:28:40.519841+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.155679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.155679+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.155679+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:02.785032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298292,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073548,"statfs":{"total":96636764160,"available":96331313152,"internally_reserved":0,"allocated":958464,"data_stored":730587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.79300000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":6.819,"5min":6.819,"15min":6.819},"last":0.76000000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.68500000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.73599999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.621},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.96799999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.72099999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.89900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":368640,"data_stored":140733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.67200000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.63700000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.80800000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.73799999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.90000000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.878}]},{"osd":7,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.82999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":368640,"data_stored":140789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.51700000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.498},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.56499999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.439},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.55300000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.54600000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.47799999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.60399999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.624}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":368640,"data_stored":140233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.54900000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.67100000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.622}]},{"osd":3,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.80600000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.66100000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.81999999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.89100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297724,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074116,"statfs":{"total":96636764160,"available":96331894784,"internally_reserved":0,"allocated":376832,"data_stored":141703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.309}]},{"osd":1,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.35599999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.378},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.46700000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.55200000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.53200000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.65400000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.66800000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":352256,"data_stored":133911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.39600000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.504},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.374}]},{"osd":3,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.56299999999999994}]},{"osd":4,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.79100000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":0.83699999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":0.73699999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.88200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297724,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074116,"statfs":{"total":96636764160,"available":96331894784,"internally_reserved":0,"allocated":376832,"data_stored":141703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.376},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.47299999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.54600000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.624},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.617,"5min":2.617,"15min":2.617},"last":0.58899999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.94099999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.96799999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.92500000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.76900000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298284,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073556,"statfs":{"total":96636764160,"available":96331321344,"internally_reserved":0,"allocated":942080,"data_stored":724209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.442},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.46600000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.41299999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.47999999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.61899999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.64000000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.54500000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.57699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:28:44.665 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:28:44.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.848+0000 7f14e5200640 1 Processor -- start 2024-08-17T02:28:44.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.848+0000 7f14e5200640 1 -- start start 2024-08-17T02:28:44.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.849+0000 7f14e5200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f14e006e790 0x7f14e00aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.849+0000 7f14e5200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e00afc10 con 0x7f14e0155180 2024-08-17T02:28:44.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.850+0000 7f14e5200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e00af000 con 0x7f14e0155550 2024-08-17T02:28:44.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.850+0000 7f14e5200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14e00af2e0 con 0x7f14e006e790 2024-08-17T02:28:44.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.850+0000 7f14dde00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f14e0155180 0x7f14e00ae070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:52050/0 (socket says 172.21.15.106:52050) 2024-08-17T02:28:44.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.850+0000 7f14dde00640 1 -- 172.21.15.106:0/1342503105 learned_addr learned my addr 172.21.15.106:0/1342503105 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:44.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.850+0000 7f14de800640 1 --2- 172.21.15.106:0/1342503105 >> v2:172.21.15.171:3300/0 conn(0x7f14e006e790 0x7f14e00aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.850+0000 7f14dd400640 1 -- 172.21.15.106:0/1342503105 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059722063 0 0) 0x7f14e00afc10 con 0x7f14e0155180 2024-08-17T02:28:44.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.850+0000 7f14dd400640 1 -- 172.21.15.106:0/1342503105 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14c40034e0 con 0x7f14e0155180 2024-08-17T02:28:44.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.850+0000 7f14dd400640 1 -- 172.21.15.106:0/1342503105 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1824299398 0 0) 0x7f14c40034e0 con 0x7f14e0155180 2024-08-17T02:28:44.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.851+0000 7f14dd400640 1 -- 172.21.15.106:0/1342503105 >> v2:172.21.15.171:3300/0 conn(0x7f14e006e790 msgr2=0x7f14e00aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:44.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.851+0000 7f14dd400640 1 --2- 172.21.15.106:0/1342503105 >> v2:172.21.15.171:3300/0 conn(0x7f14e006e790 0x7f14e00aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.851+0000 7f14dd400640 1 -- 172.21.15.106:0/1342503105 >> v1:172.21.15.171:6789/0 conn(0x7f14e0155550 legacy=0x7f14e006e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.851+0000 7f14dd400640 1 -- 172.21.15.106:0/1342503105 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e00af5c0 con 0x7f14e0155180 2024-08-17T02:28:44.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.851+0000 7f14dd400640 1 -- 172.21.15.106:0/1342503105 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7f14d0001490 con 0x7f14e0155180 2024-08-17T02:28:44.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.851+0000 7f14dd400640 1 -- 172.21.15.106:0/1342503105 >> v1:172.21.15.106:6789/0 conn(0x7f14e0155180 legacy=0x7f14e00ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.851+0000 7f14dd400640 1 --2- 172.21.15.106:0/1342503105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14c40039d0 0x7f14c4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.851+0000 7f14dd400640 1 --2- 172.21.15.106:0/1342503105 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14c4004780 0x7f14c4004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.851+0000 7f14dd400640 1 --2- 172.21.15.106:0/1342503105 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14c4005130 0x7f14c400dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.851+0000 7f14dd400640 1 -- 172.21.15.106:0/1342503105 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e00af2e0 con 0x7f14c4005130 2024-08-17T02:28:44.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.851+0000 7f14dd400640 1 -- 172.21.15.106:0/1342503105 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c400e250 con 0x7f14c40039d0 2024-08-17T02:28:44.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.851+0000 7f14dd400640 1 -- 172.21.15.106:0/1342503105 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c400e410 con 0x7f14c4004780 2024-08-17T02:28:44.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.851+0000 7f14de800640 1 --2- 172.21.15.106:0/1342503105 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14c4005130 0x7f14c400dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.851+0000 7f14dde00640 1 --2- 172.21.15.106:0/1342503105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14c40039d0 0x7f14c4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.851+0000 7f14d5400640 1 --2- 172.21.15.106:0/1342503105 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14c4004780 0x7f14c4004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.851+0000 7f14de800640 1 -- 172.21.15.106:0/1342503105 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14c4004780 msgr2=0x7f14c4004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:44.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.851+0000 7f14de800640 1 --2- 172.21.15.106:0/1342503105 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14c4004780 0x7f14c4004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.851+0000 7f14de800640 1 -- 172.21.15.106:0/1342503105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14c40039d0 msgr2=0x7f14c4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:44.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.851+0000 7f14de800640 1 --2- 172.21.15.106:0/1342503105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14c40039d0 0x7f14c4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.851+0000 7f14de800640 1 -- 172.21.15.106:0/1342503105 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c40034e0 con 0x7f14c4005130 2024-08-17T02:28:44.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.851+0000 7f14d5400640 1 --2- 172.21.15.106:0/1342503105 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14c4004780 0x7f14c4004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:44.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.852+0000 7f14de800640 1 -- 172.21.15.106:0/1342503105 reap_dead start 2024-08-17T02:28:44.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.852+0000 7f14de800640 1 --2- 172.21.15.106:0/1342503105 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14c4005130 0x7f14c400dbe0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f14d800e210 tx=0x7f14d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a877e0f80aec908 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:44.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.853+0000 7f14dd400640 1 -- 172.21.15.106:0/1342503105 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d802c040 con 0x7f14c4005130 2024-08-17T02:28:44.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.853+0000 7f14dd400640 1 -- 172.21.15.106:0/1342503105 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d800f040 con 0x7f14c4005130 2024-08-17T02:28:44.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.853+0000 7f14dd400640 1 -- 172.21.15.106:0/1342503105 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d8030650 con 0x7f14c4005130 2024-08-17T02:28:44.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.853+0000 7f14e5200640 1 -- 172.21.15.106:0/1342503105 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14c4005130 msgr2=0x7f14c400dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.853+0000 7f14e5200640 1 --2- 172.21.15.106:0/1342503105 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14c4005130 0x7f14c400dbe0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f14d800e210 tx=0x7f14d800b040 comp rx=0 tx=0).stop 2024-08-17T02:28:44.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.853+0000 7f14e5200640 1 -- 172.21.15.106:0/1342503105 shutdown_connections 2024-08-17T02:28:44.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.853+0000 7f14e5200640 1 --2- 172.21.15.106:0/1342503105 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14c4005130 0x7f14c400dbe0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.853+0000 7f14e5200640 1 -- 172.21.15.106:0/1342503105 >> 172.21.15.106:0/1342503105 conn(0x7f14e00cb9b0 msgr2=0x7f14e00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:44.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.853+0000 7f14e5200640 1 -- 172.21.15.106:0/1342503105 shutdown_connections 2024-08-17T02:28:44.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.853+0000 7f14e5200640 1 -- 172.21.15.106:0/1342503105 wait complete. 2024-08-17T02:28:44.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.855+0000 7f14e5200640 1 Processor -- start 2024-08-17T02:28:44.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.855+0000 7f14e5200640 1 -- start start 2024-08-17T02:28:44.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.856+0000 7f14e5200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14c4005130 0x7f14e00cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.856+0000 7f14e5200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14e00a98e0 0x7f14e006c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.856+0000 7f14e5200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14e006ce50 0x7f14e00c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.856+0000 7f14e5200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e00c9e60 con 0x7f14c4005130 2024-08-17T02:28:44.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.856+0000 7f14e5200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e00aa960 con 0x7f14e006ce50 2024-08-17T02:28:44.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.856+0000 7f14e5200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e00cb760 con 0x7f14e00a98e0 2024-08-17T02:28:44.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.856+0000 7f14dde00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14c4005130 0x7f14e00cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.856+0000 7f14dde00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14c4005130 0x7f14e00cb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59908/0 (socket says 172.21.15.106:59908) 2024-08-17T02:28:44.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.856+0000 7f14dde00640 1 -- 172.21.15.106:0/3008430522 learned_addr learned my addr 172.21.15.106:0/3008430522 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:44.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.856+0000 7f14de800640 1 --2- 172.21.15.106:0/3008430522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14e006ce50 0x7f14e00c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.856+0000 7f14d5400640 1 --2- 172.21.15.106:0/3008430522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14e00a98e0 0x7f14e006c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.856+0000 7f14dde00640 1 -- 172.21.15.106:0/3008430522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14e00a98e0 msgr2=0x7f14e006c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.856+0000 7f14dde00640 1 --2- 172.21.15.106:0/3008430522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14e00a98e0 0x7f14e006c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.856+0000 7f14dde00640 1 -- 172.21.15.106:0/3008430522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14e006ce50 msgr2=0x7f14e00c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.856+0000 7f14dde00640 1 --2- 172.21.15.106:0/3008430522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14e006ce50 0x7f14e00c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.856+0000 7f14dde00640 1 -- 172.21.15.106:0/3008430522 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e00a9d50 con 0x7f14c4005130 2024-08-17T02:28:44.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.857+0000 7f14dde00640 1 --2- 172.21.15.106:0/3008430522 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14c4005130 0x7f14e00cb220 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f14d00015c0 tx=0x7f14d0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:44.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.857+0000 7f14d6000640 1 -- 172.21.15.106:0/3008430522 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0018030 con 0x7f14c4005130 2024-08-17T02:28:44.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.857+0000 7f14d6000640 1 -- 172.21.15.106:0/3008430522 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d0007760 con 0x7f14c4005130 2024-08-17T02:28:44.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.857+0000 7f14d6000640 1 -- 172.21.15.106:0/3008430522 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d000fbf0 con 0x7f14c4005130 2024-08-17T02:28:44.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.857+0000 7f14e5200640 1 -- 172.21.15.106:0/3008430522 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e00aa030 con 0x7f14c4005130 2024-08-17T02:28:44.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.857+0000 7f14e5200640 1 -- 172.21.15.106:0/3008430522 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e00c8970 con 0x7f14c4005130 2024-08-17T02:28:44.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.858+0000 7f14e5200640 1 -- 172.21.15.106:0/3008430522 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e0064db0 con 0x7f14c4005130 2024-08-17T02:28:44.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.859+0000 7f14d6000640 1 -- 172.21.15.106:0/3008430522 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f14d001b070 con 0x7f14c4005130 2024-08-17T02:28:44.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.859+0000 7f14d6000640 1 --2- 172.21.15.106:0/3008430522 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f14bc065180 0x7f14bc067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.859+0000 7f14d6000640 1 -- 172.21.15.106:0/3008430522 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f14d0019070 con 0x7f14c4005130 2024-08-17T02:28:44.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.860+0000 7f14d5400640 1 --2- 172.21.15.106:0/3008430522 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f14bc065180 0x7f14bc067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.860+0000 7f14d5400640 1 --2- 172.21.15.106:0/3008430522 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f14bc065180 0x7f14bc067630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f14e0157cf0 tx=0x7f14c8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:44.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:44.864+0000 7f14d6000640 1 -- 172.21.15.106:0/3008430522 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f14d00503b0 con 0x7f14c4005130 2024-08-17T02:28:45.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.031+0000 7f14e5200640 1 -- 172.21.15.106:0/3008430522 --> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f14e01507e0 con 0x7f14bc065180 2024-08-17T02:28:45.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.038+0000 7f14d6000640 1 -- 172.21.15.106:0/3008430522 <== mgr.4107 v2:172.21.15.106:6832/36860 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288843 (secure 0 0 0) 0x7f14e01507e0 con 0x7f14bc065180 2024-08-17T02:28:45.042 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:45.043 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-08-17T02:28:45.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.042+0000 7f14e5200640 1 -- 172.21.15.106:0/3008430522 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f14bc065180 msgr2=0x7f14bc067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.042+0000 7f14e5200640 1 --2- 172.21.15.106:0/3008430522 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f14bc065180 0x7f14bc067630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f14e0157cf0 tx=0x7f14c8009040 comp rx=0 tx=0).stop 2024-08-17T02:28:45.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.042+0000 7f14e5200640 1 -- 172.21.15.106:0/3008430522 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14c4005130 msgr2=0x7f14e00cb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.042+0000 7f14e5200640 1 --2- 172.21.15.106:0/3008430522 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14c4005130 0x7f14e00cb220 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f14d00015c0 tx=0x7f14d0001e70 comp rx=0 tx=0).stop 2024-08-17T02:28:45.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.042+0000 7f14e5200640 1 -- 172.21.15.106:0/3008430522 shutdown_connections 2024-08-17T02:28:45.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.042+0000 7f14e5200640 1 --2- 172.21.15.106:0/3008430522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14e006ce50 0x7f14e00c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.042+0000 7f14e5200640 1 --2- 172.21.15.106:0/3008430522 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14e00a98e0 0x7f14e006c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.042+0000 7f14e5200640 1 --2- 172.21.15.106:0/3008430522 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f14bc065180 0x7f14bc067630 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.042+0000 7f14e5200640 1 --2- 172.21.15.106:0/3008430522 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14c4005130 0x7f14e00cb220 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.042+0000 7f14e5200640 1 -- 172.21.15.106:0/3008430522 >> 172.21.15.106:0/3008430522 conn(0x7f14e00cb9b0 msgr2=0x7f14e00ae020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:45.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.042+0000 7f14e5200640 1 -- 172.21.15.106:0/3008430522 shutdown_connections 2024-08-17T02:28:45.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.042+0000 7f14e5200640 1 -- 172.21.15.106:0/3008430522 wait complete. 2024-08-17T02:28:45.057 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-08-17T02:28:43.885856+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382880,"kb_used_data":4016,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":752591840,"statfs":{"total":773094113280,"available":770654044160,"internally_reserved":0,"allocated":4112384,"data_stored":2293868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.392946"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.546289+0000","last_change":"2024-08-17T02:28:40.538350+0000","last_active":"2024-08-17T02:28:40.546289+0000","last_peered":"2024-08-17T02:28:40.546289+0000","last_clean":"2024-08-17T02:28:40.546289+0000","last_became_active":"2024-08-17T02:28:40.538058+0000","last_became_peered":"2024-08-17T02:28:40.538058+0000","last_unstale":"2024-08-17T02:28:40.546289+0000","last_undegraded":"2024-08-17T02:28:40.546289+0000","last_fullsized":"2024-08-17T02:28:40.546289+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:32:27.622020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.534616+0000","last_change":"2024-08-17T02:28:40.530157+0000","last_active":"2024-08-17T02:28:40.534616+0000","last_peered":"2024-08-17T02:28:40.534616+0000","last_clean":"2024-08-17T02:28:40.534616+0000","last_became_active":"2024-08-17T02:28:40.529773+0000","last_became_peered":"2024-08-17T02:28:40.529773+0000","last_unstale":"2024-08-17T02:28:40.534616+0000","last_undegraded":"2024-08-17T02:28:40.534616+0000","last_fullsized":"2024-08-17T02:28:40.534616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:27:23.294901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.535042+0000","last_change":"2024-08-17T02:28:40.523201+0000","last_active":"2024-08-17T02:28:40.535042+0000","last_peered":"2024-08-17T02:28:40.535042+0000","last_clean":"2024-08-17T02:28:40.535042+0000","last_became_active":"2024-08-17T02:28:40.522937+0000","last_became_peered":"2024-08-17T02:28:40.522937+0000","last_unstale":"2024-08-17T02:28:40.535042+0000","last_undegraded":"2024-08-17T02:28:40.535042+0000","last_fullsized":"2024-08-17T02:28:40.535042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:50:30.415273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.535022+0000","last_change":"2024-08-17T02:28:40.529359+0000","last_active":"2024-08-17T02:28:40.535022+0000","last_peered":"2024-08-17T02:28:40.535022+0000","last_clean":"2024-08-17T02:28:40.535022+0000","last_became_active":"2024-08-17T02:28:40.527719+0000","last_became_peered":"2024-08-17T02:28:40.527719+0000","last_unstale":"2024-08-17T02:28:40.535022+0000","last_undegraded":"2024-08-17T02:28:40.535022+0000","last_fullsized":"2024-08-17T02:28:40.535022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:05.540034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.541840+0000","last_change":"2024-08-17T02:28:40.538524+0000","last_active":"2024-08-17T02:28:40.541840+0000","last_peered":"2024-08-17T02:28:40.541840+0000","last_clean":"2024-08-17T02:28:40.541840+0000","last_became_active":"2024-08-17T02:28:40.538266+0000","last_became_peered":"2024-08-17T02:28:40.538266+0000","last_unstale":"2024-08-17T02:28:40.541840+0000","last_undegraded":"2024-08-17T02:28:40.541840+0000","last_fullsized":"2024-08-17T02:28:40.541840+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:47:58.359450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.534183+0000","last_change":"2024-08-17T02:28:40.525634+0000","last_active":"2024-08-17T02:28:40.534183+0000","last_peered":"2024-08-17T02:28:40.534183+0000","last_clean":"2024-08-17T02:28:40.534183+0000","last_became_active":"2024-08-17T02:28:40.525325+0000","last_became_peered":"2024-08-17T02:28:40.525325+0000","last_unstale":"2024-08-17T02:28:40.534183+0000","last_undegraded":"2024-08-17T02:28:40.534183+0000","last_fullsized":"2024-08-17T02:28:40.534183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:18.022788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.535780+0000","last_change":"2024-08-17T02:28:40.533852+0000","last_active":"2024-08-17T02:28:40.535780+0000","last_peered":"2024-08-17T02:28:40.535780+0000","last_clean":"2024-08-17T02:28:40.535780+0000","last_became_active":"2024-08-17T02:28:40.533540+0000","last_became_peered":"2024-08-17T02:28:40.533540+0000","last_unstale":"2024-08-17T02:28:40.535780+0000","last_undegraded":"2024-08-17T02:28:40.535780+0000","last_fullsized":"2024-08-17T02:28:40.535780+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:12:27.152981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.548586+0000","last_change":"2024-08-17T02:28:40.545258+0000","last_active":"2024-08-17T02:28:40.548586+0000","last_peered":"2024-08-17T02:28:40.548586+0000","last_clean":"2024-08-17T02:28:40.548586+0000","last_became_active":"2024-08-17T02:28:40.544973+0000","last_became_peered":"2024-08-17T02:28:40.544973+0000","last_unstale":"2024-08-17T02:28:40.548586+0000","last_undegraded":"2024-08-17T02:28:40.548586+0000","last_fullsized":"2024-08-17T02:28:40.548586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:05.540034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.538986+0000","last_change":"2024-08-17T02:28:40.528376+0000","last_active":"2024-08-17T02:28:40.538986+0000","last_peered":"2024-08-17T02:28:40.538986+0000","last_clean":"2024-08-17T02:28:40.538986+0000","last_became_active":"2024-08-17T02:28:40.528137+0000","last_became_peered":"2024-08-17T02:28:40.528137+0000","last_unstale":"2024-08-17T02:28:40.538986+0000","last_undegraded":"2024-08-17T02:28:40.538986+0000","last_fullsized":"2024-08-17T02:28:40.538986+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:52:23.690788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.535052+0000","last_change":"2024-08-17T02:28:40.530302+0000","last_active":"2024-08-17T02:28:40.535052+0000","last_peered":"2024-08-17T02:28:40.535052+0000","last_clean":"2024-08-17T02:28:40.535052+0000","last_became_active":"2024-08-17T02:28:40.530085+0000","last_became_peered":"2024-08-17T02:28:40.530085+0000","last_unstale":"2024-08-17T02:28:40.535052+0000","last_undegraded":"2024-08-17T02:28:40.535052+0000","last_fullsized":"2024-08-17T02:28:40.535052+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:49:13.850770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.533269+0000","last_change":"2024-08-17T02:28:40.527406+0000","last_active":"2024-08-17T02:28:40.533269+0000","last_peered":"2024-08-17T02:28:40.533269+0000","last_clean":"2024-08-17T02:28:40.533269+0000","last_became_active":"2024-08-17T02:28:40.526627+0000","last_became_peered":"2024-08-17T02:28:40.526627+0000","last_unstale":"2024-08-17T02:28:40.533269+0000","last_undegraded":"2024-08-17T02:28:40.533269+0000","last_fullsized":"2024-08-17T02:28:40.533269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:43:00.460758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.535228+0000","last_change":"2024-08-17T02:28:40.528358+0000","last_active":"2024-08-17T02:28:40.535228+0000","last_peered":"2024-08-17T02:28:40.535228+0000","last_clean":"2024-08-17T02:28:40.535228+0000","last_became_active":"2024-08-17T02:28:40.527830+0000","last_became_peered":"2024-08-17T02:28:40.527830+0000","last_unstale":"2024-08-17T02:28:40.535228+0000","last_undegraded":"2024-08-17T02:28:40.535228+0000","last_fullsized":"2024-08-17T02:28:40.535228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:27:23.294901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.544371+0000","last_change":"2024-08-17T02:28:40.541514+0000","last_active":"2024-08-17T02:28:40.544371+0000","last_peered":"2024-08-17T02:28:40.544371+0000","last_clean":"2024-08-17T02:28:40.544371+0000","last_became_active":"2024-08-17T02:28:40.539684+0000","last_became_peered":"2024-08-17T02:28:40.539684+0000","last_unstale":"2024-08-17T02:28:40.544371+0000","last_undegraded":"2024-08-17T02:28:40.544371+0000","last_fullsized":"2024-08-17T02:28:40.544371+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:32:27.622020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.536605+0000","last_change":"2024-08-17T02:28:40.535116+0000","last_active":"2024-08-17T02:28:40.536605+0000","last_peered":"2024-08-17T02:28:40.536605+0000","last_clean":"2024-08-17T02:28:40.536605+0000","last_became_active":"2024-08-17T02:28:40.528062+0000","last_became_peered":"2024-08-17T02:28:40.528062+0000","last_unstale":"2024-08-17T02:28:40.536605+0000","last_undegraded":"2024-08-17T02:28:40.536605+0000","last_fullsized":"2024-08-17T02:28:40.536605+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:28.034779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.535490+0000","last_change":"2024-08-17T02:28:40.529700+0000","last_active":"2024-08-17T02:28:40.535490+0000","last_peered":"2024-08-17T02:28:40.535490+0000","last_clean":"2024-08-17T02:28:40.535490+0000","last_became_active":"2024-08-17T02:28:40.528834+0000","last_became_peered":"2024-08-17T02:28:40.528834+0000","last_unstale":"2024-08-17T02:28:40.535490+0000","last_undegraded":"2024-08-17T02:28:40.535490+0000","last_fullsized":"2024-08-17T02:28:40.535490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:18.022788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.548457+0000","last_change":"2024-08-17T02:28:40.541892+0000","last_active":"2024-08-17T02:28:40.548457+0000","last_peered":"2024-08-17T02:28:40.548457+0000","last_clean":"2024-08-17T02:28:40.548457+0000","last_became_active":"2024-08-17T02:28:40.540813+0000","last_became_peered":"2024-08-17T02:28:40.540813+0000","last_unstale":"2024-08-17T02:28:40.548457+0000","last_undegraded":"2024-08-17T02:28:40.548457+0000","last_fullsized":"2024-08-17T02:28:40.548457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:27:23.294901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.547302+0000","last_change":"2024-08-17T02:28:40.540416+0000","last_active":"2024-08-17T02:28:40.547302+0000","last_peered":"2024-08-17T02:28:40.547302+0000","last_clean":"2024-08-17T02:28:40.547302+0000","last_became_active":"2024-08-17T02:28:40.534149+0000","last_became_peered":"2024-08-17T02:28:40.534149+0000","last_unstale":"2024-08-17T02:28:40.547302+0000","last_undegraded":"2024-08-17T02:28:40.547302+0000","last_fullsized":"2024-08-17T02:28:40.547302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:18.022788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.534598+0000","last_change":"2024-08-17T02:28:40.526695+0000","last_active":"2024-08-17T02:28:40.534598+0000","last_peered":"2024-08-17T02:28:40.534598+0000","last_clean":"2024-08-17T02:28:40.534598+0000","last_became_active":"2024-08-17T02:28:40.526354+0000","last_became_peered":"2024-08-17T02:28:40.526354+0000","last_unstale":"2024-08-17T02:28:40.534598+0000","last_undegraded":"2024-08-17T02:28:40.534598+0000","last_fullsized":"2024-08-17T02:28:40.534598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:28:49.790619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.540818+0000","last_change":"2024-08-17T02:28:40.528687+0000","last_active":"2024-08-17T02:28:40.540818+0000","last_peered":"2024-08-17T02:28:40.540818+0000","last_clean":"2024-08-17T02:28:40.540818+0000","last_became_active":"2024-08-17T02:28:40.528420+0000","last_became_peered":"2024-08-17T02:28:40.528420+0000","last_unstale":"2024-08-17T02:28:40.540818+0000","last_undegraded":"2024-08-17T02:28:40.540818+0000","last_fullsized":"2024-08-17T02:28:40.540818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:50:30.415273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.544253+0000","last_change":"2024-08-17T02:28:40.538810+0000","last_active":"2024-08-17T02:28:40.544253+0000","last_peered":"2024-08-17T02:28:40.544253+0000","last_clean":"2024-08-17T02:28:40.544253+0000","last_became_active":"2024-08-17T02:28:40.538467+0000","last_became_peered":"2024-08-17T02:28:40.538467+0000","last_unstale":"2024-08-17T02:28:40.544253+0000","last_undegraded":"2024-08-17T02:28:40.544253+0000","last_fullsized":"2024-08-17T02:28:40.544253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:49:46.500534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.538768+0000","last_change":"2024-08-17T02:28:40.524951+0000","last_active":"2024-08-17T02:28:40.538768+0000","last_peered":"2024-08-17T02:28:40.538768+0000","last_clean":"2024-08-17T02:28:40.538768+0000","last_became_active":"2024-08-17T02:28:40.524707+0000","last_became_peered":"2024-08-17T02:28:40.524707+0000","last_unstale":"2024-08-17T02:28:40.538768+0000","last_undegraded":"2024-08-17T02:28:40.538768+0000","last_fullsized":"2024-08-17T02:28:40.538768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:26.872929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.540450+0000","last_change":"2024-08-17T02:28:40.532237+0000","last_active":"2024-08-17T02:28:40.540450+0000","last_peered":"2024-08-17T02:28:40.540450+0000","last_clean":"2024-08-17T02:28:40.540450+0000","last_became_active":"2024-08-17T02:28:40.531991+0000","last_became_peered":"2024-08-17T02:28:40.531991+0000","last_unstale":"2024-08-17T02:28:40.540450+0000","last_undegraded":"2024-08-17T02:28:40.540450+0000","last_fullsized":"2024-08-17T02:28:40.540450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:16:40.829492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.532202+0000","last_change":"2024-08-17T02:28:40.528256+0000","last_active":"2024-08-17T02:28:40.532202+0000","last_peered":"2024-08-17T02:28:40.532202+0000","last_clean":"2024-08-17T02:28:40.532202+0000","last_became_active":"2024-08-17T02:28:40.527993+0000","last_became_peered":"2024-08-17T02:28:40.527993+0000","last_unstale":"2024-08-17T02:28:40.532202+0000","last_undegraded":"2024-08-17T02:28:40.532202+0000","last_fullsized":"2024-08-17T02:28:40.532202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:32:27.622020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.542371+0000","last_change":"2024-08-17T02:28:40.537418+0000","last_active":"2024-08-17T02:28:40.542371+0000","last_peered":"2024-08-17T02:28:40.542371+0000","last_clean":"2024-08-17T02:28:40.542371+0000","last_became_active":"2024-08-17T02:28:40.533472+0000","last_became_peered":"2024-08-17T02:28:40.533472+0000","last_unstale":"2024-08-17T02:28:40.542371+0000","last_undegraded":"2024-08-17T02:28:40.542371+0000","last_fullsized":"2024-08-17T02:28:40.542371+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:22:21.827619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.535241+0000","last_change":"2024-08-17T02:28:40.531541+0000","last_active":"2024-08-17T02:28:40.535241+0000","last_peered":"2024-08-17T02:28:40.535241+0000","last_clean":"2024-08-17T02:28:40.535241+0000","last_became_active":"2024-08-17T02:28:40.528264+0000","last_became_peered":"2024-08-17T02:28:40.528264+0000","last_unstale":"2024-08-17T02:28:40.535241+0000","last_undegraded":"2024-08-17T02:28:40.535241+0000","last_fullsized":"2024-08-17T02:28:40.535241+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:12:27.152981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.543762+0000","last_change":"2024-08-17T02:28:40.530643+0000","last_active":"2024-08-17T02:28:40.543762+0000","last_peered":"2024-08-17T02:28:40.543762+0000","last_clean":"2024-08-17T02:28:40.543762+0000","last_became_active":"2024-08-17T02:28:40.530383+0000","last_became_peered":"2024-08-17T02:28:40.530383+0000","last_unstale":"2024-08-17T02:28:40.543762+0000","last_undegraded":"2024-08-17T02:28:40.543762+0000","last_fullsized":"2024-08-17T02:28:40.543762+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:09:04.951605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.541439+0000","last_change":"2024-08-17T02:28:40.534007+0000","last_active":"2024-08-17T02:28:40.541439+0000","last_peered":"2024-08-17T02:28:40.541439+0000","last_clean":"2024-08-17T02:28:40.541439+0000","last_became_active":"2024-08-17T02:28:40.533750+0000","last_became_peered":"2024-08-17T02:28:40.533750+0000","last_unstale":"2024-08-17T02:28:40.541439+0000","last_undegraded":"2024-08-17T02:28:40.541439+0000","last_fullsized":"2024-08-17T02:28:40.541439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:41:18.022788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.535112+0000","last_change":"2024-08-17T02:28:40.523831+0000","last_active":"2024-08-17T02:28:40.535112+0000","last_peered":"2024-08-17T02:28:40.535112+0000","last_clean":"2024-08-17T02:28:40.535112+0000","last_became_active":"2024-08-17T02:28:40.523586+0000","last_became_peered":"2024-08-17T02:28:40.523586+0000","last_unstale":"2024-08-17T02:28:40.535112+0000","last_undegraded":"2024-08-17T02:28:40.535112+0000","last_fullsized":"2024-08-17T02:28:40.535112+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:49:13.850770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.540636+0000","last_change":"2024-08-17T02:28:40.535994+0000","last_active":"2024-08-17T02:28:40.540636+0000","last_peered":"2024-08-17T02:28:40.540636+0000","last_clean":"2024-08-17T02:28:40.540636+0000","last_became_active":"2024-08-17T02:28:40.535738+0000","last_became_peered":"2024-08-17T02:28:40.535738+0000","last_unstale":"2024-08-17T02:28:40.540636+0000","last_undegraded":"2024-08-17T02:28:40.540636+0000","last_fullsized":"2024-08-17T02:28:40.540636+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:06:07.364340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.534995+0000","last_change":"2024-08-17T02:28:40.533608+0000","last_active":"2024-08-17T02:28:40.534995+0000","last_peered":"2024-08-17T02:28:40.534995+0000","last_clean":"2024-08-17T02:28:40.534995+0000","last_became_active":"2024-08-17T02:28:40.532530+0000","last_became_peered":"2024-08-17T02:28:40.532530+0000","last_unstale":"2024-08-17T02:28:40.534995+0000","last_undegraded":"2024-08-17T02:28:40.534995+0000","last_fullsized":"2024-08-17T02:28:40.534995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:49:13.850770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.542765+0000","last_change":"2024-08-17T02:28:40.537316+0000","last_active":"2024-08-17T02:28:40.542765+0000","last_peered":"2024-08-17T02:28:40.542765+0000","last_clean":"2024-08-17T02:28:40.542765+0000","last_became_active":"2024-08-17T02:28:40.528993+0000","last_became_peered":"2024-08-17T02:28:40.528993+0000","last_unstale":"2024-08-17T02:28:40.542765+0000","last_undegraded":"2024-08-17T02:28:40.542765+0000","last_fullsized":"2024-08-17T02:28:40.542765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:47:58.359450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.548555+0000","last_change":"2024-08-17T02:28:40.542132+0000","last_active":"2024-08-17T02:28:40.548555+0000","last_peered":"2024-08-17T02:28:40.548555+0000","last_clean":"2024-08-17T02:28:40.548555+0000","last_became_active":"2024-08-17T02:28:40.541181+0000","last_became_peered":"2024-08-17T02:28:40.541181+0000","last_unstale":"2024-08-17T02:28:40.548555+0000","last_undegraded":"2024-08-17T02:28:40.548555+0000","last_fullsized":"2024-08-17T02:28:40.548555+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:22:21.827619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.531148+0000","last_change":"2024-08-17T02:28:40.526501+0000","last_active":"2024-08-17T02:28:40.531148+0000","last_peered":"2024-08-17T02:28:40.531148+0000","last_clean":"2024-08-17T02:28:40.531148+0000","last_became_active":"2024-08-17T02:28:40.526257+0000","last_became_peered":"2024-08-17T02:28:40.526257+0000","last_unstale":"2024-08-17T02:28:40.531148+0000","last_undegraded":"2024-08-17T02:28:40.531148+0000","last_fullsized":"2024-08-17T02:28:40.531148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:34:23.586864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.550813+0000","last_change":"2024-08-17T02:28:39.520605+0000","last_active":"2024-08-17T02:28:40.550813+0000","last_peered":"2024-08-17T02:28:40.550813+0000","last_clean":"2024-08-17T02:28:40.550813+0000","last_became_active":"2024-08-17T02:28:39.520309+0000","last_became_peered":"2024-08-17T02:28:39.520309+0000","last_unstale":"2024-08-17T02:28:40.550813+0000","last_undegraded":"2024-08-17T02:28:40.550813+0000","last_fullsized":"2024-08-17T02:28:40.550813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:14:27.816420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.549580+0000","last_change":"2024-08-17T02:28:40.544057+0000","last_active":"2024-08-17T02:28:40.549580+0000","last_peered":"2024-08-17T02:28:40.549580+0000","last_clean":"2024-08-17T02:28:40.549580+0000","last_became_active":"2024-08-17T02:28:40.543112+0000","last_became_peered":"2024-08-17T02:28:40.543112+0000","last_unstale":"2024-08-17T02:28:40.549580+0000","last_undegraded":"2024-08-17T02:28:40.549580+0000","last_fullsized":"2024-08-17T02:28:40.549580+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:34:23.586864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.548787+0000","last_change":"2024-08-17T02:28:39.518592+0000","last_active":"2024-08-17T02:28:40.548787+0000","last_peered":"2024-08-17T02:28:40.548787+0000","last_clean":"2024-08-17T02:28:40.548787+0000","last_became_active":"2024-08-17T02:28:39.517612+0000","last_became_peered":"2024-08-17T02:28:39.517612+0000","last_unstale":"2024-08-17T02:28:40.548787+0000","last_undegraded":"2024-08-17T02:28:40.548787+0000","last_fullsized":"2024-08-17T02:28:40.548787+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:34:52.152840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.540668+0000","last_change":"2024-08-17T02:28:40.532666+0000","last_active":"2024-08-17T02:28:40.540668+0000","last_peered":"2024-08-17T02:28:40.540668+0000","last_clean":"2024-08-17T02:28:40.540668+0000","last_became_active":"2024-08-17T02:28:40.532240+0000","last_became_peered":"2024-08-17T02:28:40.532240+0000","last_unstale":"2024-08-17T02:28:40.540668+0000","last_undegraded":"2024-08-17T02:28:40.540668+0000","last_fullsized":"2024-08-17T02:28:40.540668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:34:23.586864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.546630+0000","last_change":"2024-08-17T02:28:39.521294+0000","last_active":"2024-08-17T02:28:40.546630+0000","last_peered":"2024-08-17T02:28:40.546630+0000","last_clean":"2024-08-17T02:28:40.546630+0000","last_became_active":"2024-08-17T02:28:39.521048+0000","last_became_peered":"2024-08-17T02:28:39.521048+0000","last_unstale":"2024-08-17T02:28:40.546630+0000","last_undegraded":"2024-08-17T02:28:40.546630+0000","last_fullsized":"2024-08-17T02:28:40.546630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:47:57.353610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.535326+0000","last_change":"2024-08-17T02:28:40.529463+0000","last_active":"2024-08-17T02:28:40.535326+0000","last_peered":"2024-08-17T02:28:40.535326+0000","last_clean":"2024-08-17T02:28:40.535326+0000","last_became_active":"2024-08-17T02:28:40.528099+0000","last_became_peered":"2024-08-17T02:28:40.528099+0000","last_unstale":"2024-08-17T02:28:40.535326+0000","last_undegraded":"2024-08-17T02:28:40.535326+0000","last_fullsized":"2024-08-17T02:28:40.535326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:27:23.294901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.548727+0000","last_change":"2024-08-17T02:28:39.521237+0000","last_active":"2024-08-17T02:28:40.548727+0000","last_peered":"2024-08-17T02:28:40.548727+0000","last_clean":"2024-08-17T02:28:40.548727+0000","last_became_active":"2024-08-17T02:28:39.520972+0000","last_became_peered":"2024-08-17T02:28:39.520972+0000","last_unstale":"2024-08-17T02:28:40.548727+0000","last_undegraded":"2024-08-17T02:28:40.548727+0000","last_fullsized":"2024-08-17T02:28:40.548727+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:10.912578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.547552+0000","last_change":"2024-08-17T02:28:40.540864+0000","last_active":"2024-08-17T02:28:40.547552+0000","last_peered":"2024-08-17T02:28:40.547552+0000","last_clean":"2024-08-17T02:28:40.547552+0000","last_became_active":"2024-08-17T02:28:40.540555+0000","last_became_peered":"2024-08-17T02:28:40.540555+0000","last_unstale":"2024-08-17T02:28:40.547552+0000","last_undegraded":"2024-08-17T02:28:40.547552+0000","last_fullsized":"2024-08-17T02:28:40.547552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:00.714390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.548427+0000","last_change":"2024-08-17T02:28:39.521624+0000","last_active":"2024-08-17T02:28:40.548427+0000","last_peered":"2024-08-17T02:28:40.548427+0000","last_clean":"2024-08-17T02:28:40.548427+0000","last_became_active":"2024-08-17T02:28:39.519671+0000","last_became_peered":"2024-08-17T02:28:39.519671+0000","last_unstale":"2024-08-17T02:28:40.548427+0000","last_undegraded":"2024-08-17T02:28:40.548427+0000","last_fullsized":"2024-08-17T02:28:40.548427+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:30:10.912578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.535054+0000","last_change":"2024-08-17T02:28:40.522743+0000","last_active":"2024-08-17T02:28:40.535054+0000","last_peered":"2024-08-17T02:28:40.535054+0000","last_clean":"2024-08-17T02:28:40.535054+0000","last_became_active":"2024-08-17T02:28:40.522472+0000","last_became_peered":"2024-08-17T02:28:40.522472+0000","last_unstale":"2024-08-17T02:28:40.535054+0000","last_undegraded":"2024-08-17T02:28:40.535054+0000","last_fullsized":"2024-08-17T02:28:40.535054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:12:27.152981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.548390+0000","last_change":"2024-08-17T02:28:39.514002+0000","last_active":"2024-08-17T02:28:40.548390+0000","last_peered":"2024-08-17T02:28:40.548390+0000","last_clean":"2024-08-17T02:28:40.548390+0000","last_became_active":"2024-08-17T02:28:39.513416+0000","last_became_peered":"2024-08-17T02:28:39.513416+0000","last_unstale":"2024-08-17T02:28:40.548390+0000","last_undegraded":"2024-08-17T02:28:40.548390+0000","last_fullsized":"2024-08-17T02:28:40.548390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:57:16.873631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.540397+0000","last_change":"2024-08-17T02:28:40.530560+0000","last_active":"2024-08-17T02:28:40.540397+0000","last_peered":"2024-08-17T02:28:40.540397+0000","last_clean":"2024-08-17T02:28:40.540397+0000","last_became_active":"2024-08-17T02:28:40.529618+0000","last_became_peered":"2024-08-17T02:28:40.529618+0000","last_unstale":"2024-08-17T02:28:40.540397+0000","last_undegraded":"2024-08-17T02:28:40.540397+0000","last_fullsized":"2024-08-17T02:28:40.540397+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:27:37.372109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.523257+0000","last_change":"2024-08-17T02:28:39.513505+0000","last_active":"2024-08-17T02:28:40.523257+0000","last_peered":"2024-08-17T02:28:40.523257+0000","last_clean":"2024-08-17T02:28:40.523257+0000","last_became_active":"2024-08-17T02:28:39.513225+0000","last_became_peered":"2024-08-17T02:28:39.513225+0000","last_unstale":"2024-08-17T02:28:40.523257+0000","last_undegraded":"2024-08-17T02:28:40.523257+0000","last_fullsized":"2024-08-17T02:28:40.523257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:32:26.616180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.524256+0000","last_change":"2024-08-17T02:28:40.520123+0000","last_active":"2024-08-17T02:28:40.524256+0000","last_peered":"2024-08-17T02:28:40.524256+0000","last_clean":"2024-08-17T02:28:40.524256+0000","last_became_active":"2024-08-17T02:28:40.517545+0000","last_became_peered":"2024-08-17T02:28:40.517545+0000","last_unstale":"2024-08-17T02:28:40.524256+0000","last_undegraded":"2024-08-17T02:28:40.524256+0000","last_fullsized":"2024-08-17T02:28:40.524256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:22:21.827619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.515245+0000","last_change":"2024-08-17T02:28:39.520014+0000","last_active":"2024-08-17T02:28:40.515245+0000","last_peered":"2024-08-17T02:28:40.515245+0000","last_clean":"2024-08-17T02:28:40.515245+0000","last_became_active":"2024-08-17T02:28:39.518708+0000","last_became_peered":"2024-08-17T02:28:39.518708+0000","last_unstale":"2024-08-17T02:28:40.515245+0000","last_undegraded":"2024-08-17T02:28:40.515245+0000","last_fullsized":"2024-08-17T02:28:40.515245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:56:37.898150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.535461+0000","last_change":"2024-08-17T02:28:40.528549+0000","last_active":"2024-08-17T02:28:40.535461+0000","last_peered":"2024-08-17T02:28:40.535461+0000","last_clean":"2024-08-17T02:28:40.535461+0000","last_became_active":"2024-08-17T02:28:40.528281+0000","last_became_peered":"2024-08-17T02:28:40.528281+0000","last_unstale":"2024-08-17T02:28:40.535461+0000","last_undegraded":"2024-08-17T02:28:40.535461+0000","last_fullsized":"2024-08-17T02:28:40.535461+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:28.034779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.533797+0000","last_change":"2024-08-17T02:28:39.519240+0000","last_active":"2024-08-17T02:28:40.533797+0000","last_peered":"2024-08-17T02:28:40.533797+0000","last_clean":"2024-08-17T02:28:40.533797+0000","last_became_active":"2024-08-17T02:28:39.519051+0000","last_became_peered":"2024-08-17T02:28:39.519051+0000","last_unstale":"2024-08-17T02:28:40.533797+0000","last_undegraded":"2024-08-17T02:28:40.533797+0000","last_fullsized":"2024-08-17T02:28:40.533797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:15:35.234765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.534430+0000","last_change":"2024-08-17T02:28:40.525531+0000","last_active":"2024-08-17T02:28:40.534430+0000","last_peered":"2024-08-17T02:28:40.534430+0000","last_clean":"2024-08-17T02:28:40.534430+0000","last_became_active":"2024-08-17T02:28:40.525295+0000","last_became_peered":"2024-08-17T02:28:40.525295+0000","last_unstale":"2024-08-17T02:28:40.534430+0000","last_undegraded":"2024-08-17T02:28:40.534430+0000","last_fullsized":"2024-08-17T02:28:40.534430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:23:13.667975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.511286+0000","last_change":"2024-08-17T02:28:39.515580+0000","last_active":"2024-08-17T02:28:40.511286+0000","last_peered":"2024-08-17T02:28:40.511286+0000","last_clean":"2024-08-17T02:28:40.511286+0000","last_became_active":"2024-08-17T02:28:39.515338+0000","last_became_peered":"2024-08-17T02:28:39.515338+0000","last_unstale":"2024-08-17T02:28:40.511286+0000","last_undegraded":"2024-08-17T02:28:40.511286+0000","last_fullsized":"2024-08-17T02:28:40.511286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:03:02.162597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.534673+0000","last_change":"2024-08-17T02:28:40.530336+0000","last_active":"2024-08-17T02:28:40.534673+0000","last_peered":"2024-08-17T02:28:40.534673+0000","last_clean":"2024-08-17T02:28:40.534673+0000","last_became_active":"2024-08-17T02:28:40.530062+0000","last_became_peered":"2024-08-17T02:28:40.530062+0000","last_unstale":"2024-08-17T02:28:40.534673+0000","last_undegraded":"2024-08-17T02:28:40.534673+0000","last_fullsized":"2024-08-17T02:28:40.534673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:43:00.460758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.548808+0000","last_change":"2024-08-17T02:28:39.518305+0000","last_active":"2024-08-17T02:28:40.548808+0000","last_peered":"2024-08-17T02:28:40.548808+0000","last_clean":"2024-08-17T02:28:40.548808+0000","last_became_active":"2024-08-17T02:28:39.518096+0000","last_became_peered":"2024-08-17T02:28:39.518096+0000","last_unstale":"2024-08-17T02:28:40.548808+0000","last_undegraded":"2024-08-17T02:28:40.548808+0000","last_fullsized":"2024-08-17T02:28:40.548808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:49:45.494694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.535023+0000","last_change":"2024-08-17T02:28:40.523157+0000","last_active":"2024-08-17T02:28:40.535023+0000","last_peered":"2024-08-17T02:28:40.535023+0000","last_clean":"2024-08-17T02:28:40.535023+0000","last_became_active":"2024-08-17T02:28:40.522533+0000","last_became_peered":"2024-08-17T02:28:40.522533+0000","last_unstale":"2024-08-17T02:28:40.535023+0000","last_undegraded":"2024-08-17T02:28:40.535023+0000","last_fullsized":"2024-08-17T02:28:40.535023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:09:04.951605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.550406+0000","last_change":"2024-08-17T02:28:39.522124+0000","last_active":"2024-08-17T02:28:40.550406+0000","last_peered":"2024-08-17T02:28:40.550406+0000","last_clean":"2024-08-17T02:28:40.550406+0000","last_became_active":"2024-08-17T02:28:39.521949+0000","last_became_peered":"2024-08-17T02:28:39.521949+0000","last_unstale":"2024-08-17T02:28:40.550406+0000","last_undegraded":"2024-08-17T02:28:40.550406+0000","last_fullsized":"2024-08-17T02:28:40.550406+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:49:45.494694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.534021+0000","last_change":"2024-08-17T02:28:40.521305+0000","last_active":"2024-08-17T02:28:40.534021+0000","last_peered":"2024-08-17T02:28:40.534021+0000","last_clean":"2024-08-17T02:28:40.534021+0000","last_became_active":"2024-08-17T02:28:40.520995+0000","last_became_peered":"2024-08-17T02:28:40.520995+0000","last_unstale":"2024-08-17T02:28:40.534021+0000","last_undegraded":"2024-08-17T02:28:40.534021+0000","last_fullsized":"2024-08-17T02:28:40.534021+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:00.714390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.550623+0000","last_change":"2024-08-17T02:28:39.521995+0000","last_active":"2024-08-17T02:28:40.550623+0000","last_peered":"2024-08-17T02:28:40.550623+0000","last_clean":"2024-08-17T02:28:40.550623+0000","last_became_active":"2024-08-17T02:28:39.520324+0000","last_became_peered":"2024-08-17T02:28:39.520324+0000","last_unstale":"2024-08-17T02:28:40.550623+0000","last_undegraded":"2024-08-17T02:28:40.550623+0000","last_fullsized":"2024-08-17T02:28:40.550623+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:01:21.739302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.534635+0000","last_change":"2024-08-17T02:28:40.530462+0000","last_active":"2024-08-17T02:28:40.534635+0000","last_peered":"2024-08-17T02:28:40.534635+0000","last_clean":"2024-08-17T02:28:40.534635+0000","last_became_active":"2024-08-17T02:28:40.530143+0000","last_became_peered":"2024-08-17T02:28:40.530143+0000","last_unstale":"2024-08-17T02:28:40.534635+0000","last_undegraded":"2024-08-17T02:28:40.534635+0000","last_fullsized":"2024-08-17T02:28:40.534635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:12:27.152981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.512903+0000","last_change":"2024-08-17T02:28:39.523218+0000","last_active":"2024-08-17T02:28:40.512903+0000","last_peered":"2024-08-17T02:28:40.512903+0000","last_clean":"2024-08-17T02:28:40.512903+0000","last_became_active":"2024-08-17T02:28:39.522642+0000","last_became_peered":"2024-08-17T02:28:39.522642+0000","last_unstale":"2024-08-17T02:28:40.512903+0000","last_undegraded":"2024-08-17T02:28:40.512903+0000","last_fullsized":"2024-08-17T02:28:40.512903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:47:57.353610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.548569+0000","last_change":"2024-08-17T02:28:40.542346+0000","last_active":"2024-08-17T02:28:40.548569+0000","last_peered":"2024-08-17T02:28:40.548569+0000","last_clean":"2024-08-17T02:28:40.548569+0000","last_became_active":"2024-08-17T02:28:40.541608+0000","last_became_peered":"2024-08-17T02:28:40.541608+0000","last_unstale":"2024-08-17T02:28:40.548569+0000","last_undegraded":"2024-08-17T02:28:40.548569+0000","last_fullsized":"2024-08-17T02:28:40.548569+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:07:31.033049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.523884+0000","last_change":"2024-08-17T02:28:39.517945+0000","last_active":"2024-08-17T02:28:40.523884+0000","last_peered":"2024-08-17T02:28:40.523884+0000","last_clean":"2024-08-17T02:28:40.523884+0000","last_became_active":"2024-08-17T02:28:39.517683+0000","last_became_peered":"2024-08-17T02:28:39.517683+0000","last_unstale":"2024-08-17T02:28:40.523884+0000","last_undegraded":"2024-08-17T02:28:40.523884+0000","last_fullsized":"2024-08-17T02:28:40.523884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:58.510911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.542253+0000","last_change":"2024-08-17T02:28:40.525424+0000","last_active":"2024-08-17T02:28:40.542253+0000","last_peered":"2024-08-17T02:28:40.542253+0000","last_clean":"2024-08-17T02:28:40.542253+0000","last_became_active":"2024-08-17T02:28:40.524146+0000","last_became_peered":"2024-08-17T02:28:40.524146+0000","last_unstale":"2024-08-17T02:28:40.542253+0000","last_undegraded":"2024-08-17T02:28:40.542253+0000","last_fullsized":"2024-08-17T02:28:40.542253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:06:07.364340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.548481+0000","last_change":"2024-08-17T02:28:39.516455+0000","last_active":"2024-08-17T02:28:40.548481+0000","last_peered":"2024-08-17T02:28:40.548481+0000","last_clean":"2024-08-17T02:28:40.548481+0000","last_became_active":"2024-08-17T02:28:39.515787+0000","last_became_peered":"2024-08-17T02:28:39.515787+0000","last_unstale":"2024-08-17T02:28:40.548481+0000","last_undegraded":"2024-08-17T02:28:40.548481+0000","last_fullsized":"2024-08-17T02:28:40.548481+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:36.713899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.540428+0000","last_change":"2024-08-17T02:28:40.531510+0000","last_active":"2024-08-17T02:28:40.540428+0000","last_peered":"2024-08-17T02:28:40.540428+0000","last_clean":"2024-08-17T02:28:40.540428+0000","last_became_active":"2024-08-17T02:28:40.531292+0000","last_became_peered":"2024-08-17T02:28:40.531292+0000","last_unstale":"2024-08-17T02:28:40.540428+0000","last_undegraded":"2024-08-17T02:28:40.540428+0000","last_fullsized":"2024-08-17T02:28:40.540428+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:51:45.274774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.546093+0000","last_change":"2024-08-17T02:28:39.523804+0000","last_active":"2024-08-17T02:28:40.546093+0000","last_peered":"2024-08-17T02:28:40.546093+0000","last_clean":"2024-08-17T02:28:40.546093+0000","last_became_active":"2024-08-17T02:28:39.523528+0000","last_became_peered":"2024-08-17T02:28:39.523528+0000","last_unstale":"2024-08-17T02:28:40.546093+0000","last_undegraded":"2024-08-17T02:28:40.546093+0000","last_fullsized":"2024-08-17T02:28:40.546093+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:36.713899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.530869+0000","last_change":"2024-08-17T02:28:40.522831+0000","last_active":"2024-08-17T02:28:40.530869+0000","last_peered":"2024-08-17T02:28:40.530869+0000","last_clean":"2024-08-17T02:28:40.530869+0000","last_became_active":"2024-08-17T02:28:40.522567+0000","last_became_peered":"2024-08-17T02:28:40.522567+0000","last_unstale":"2024-08-17T02:28:40.530869+0000","last_undegraded":"2024-08-17T02:28:40.530869+0000","last_fullsized":"2024-08-17T02:28:40.530869+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:05.540034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.550292+0000","last_change":"2024-08-17T02:28:39.521650+0000","last_active":"2024-08-17T02:28:40.550292+0000","last_peered":"2024-08-17T02:28:40.550292+0000","last_clean":"2024-08-17T02:28:40.550292+0000","last_became_active":"2024-08-17T02:28:39.519645+0000","last_became_peered":"2024-08-17T02:28:39.519645+0000","last_unstale":"2024-08-17T02:28:40.550292+0000","last_undegraded":"2024-08-17T02:28:40.550292+0000","last_fullsized":"2024-08-17T02:28:40.550292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:14:27.816420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.525615+0000","last_change":"2024-08-17T02:28:40.520957+0000","last_active":"2024-08-17T02:28:40.525615+0000","last_peered":"2024-08-17T02:28:40.525615+0000","last_clean":"2024-08-17T02:28:40.525615+0000","last_became_active":"2024-08-17T02:28:40.520693+0000","last_became_peered":"2024-08-17T02:28:40.520693+0000","last_unstale":"2024-08-17T02:28:40.525615+0000","last_undegraded":"2024-08-17T02:28:40.525615+0000","last_fullsized":"2024-08-17T02:28:40.525615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:28.034779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.550226+0000","last_change":"2024-08-17T02:28:39.513039+0000","last_active":"2024-08-17T02:28:40.550226+0000","last_peered":"2024-08-17T02:28:40.550226+0000","last_clean":"2024-08-17T02:28:40.550226+0000","last_became_active":"2024-08-17T02:28:39.512509+0000","last_became_peered":"2024-08-17T02:28:39.512509+0000","last_unstale":"2024-08-17T02:28:40.550226+0000","last_undegraded":"2024-08-17T02:28:40.550226+0000","last_fullsized":"2024-08-17T02:28:40.550226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:06:47.930710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.535929+0000","last_change":"2024-08-17T02:28:40.534248+0000","last_active":"2024-08-17T02:28:40.535929+0000","last_peered":"2024-08-17T02:28:40.535929+0000","last_clean":"2024-08-17T02:28:40.535929+0000","last_became_active":"2024-08-17T02:28:40.533991+0000","last_became_peered":"2024-08-17T02:28:40.533991+0000","last_unstale":"2024-08-17T02:28:40.535929+0000","last_undegraded":"2024-08-17T02:28:40.535929+0000","last_fullsized":"2024-08-17T02:28:40.535929+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:52:26.872929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.517436+0000","last_change":"2024-08-17T02:28:39.515205+0000","last_active":"2024-08-17T02:28:40.517436+0000","last_peered":"2024-08-17T02:28:40.517436+0000","last_clean":"2024-08-17T02:28:40.517436+0000","last_became_active":"2024-08-17T02:28:39.514296+0000","last_became_peered":"2024-08-17T02:28:39.514296+0000","last_unstale":"2024-08-17T02:28:40.517436+0000","last_undegraded":"2024-08-17T02:28:40.517436+0000","last_fullsized":"2024-08-17T02:28:40.517436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:37:50.879083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.528979+0000","last_change":"2024-08-17T02:28:40.525657+0000","last_active":"2024-08-17T02:28:40.528979+0000","last_peered":"2024-08-17T02:28:40.528979+0000","last_clean":"2024-08-17T02:28:40.528979+0000","last_became_active":"2024-08-17T02:28:40.525424+0000","last_became_peered":"2024-08-17T02:28:40.525424+0000","last_unstale":"2024-08-17T02:28:40.528979+0000","last_undegraded":"2024-08-17T02:28:40.528979+0000","last_fullsized":"2024-08-17T02:28:40.528979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:16:40.829492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.548985+0000","last_change":"2024-08-17T02:28:39.513052+0000","last_active":"2024-08-17T02:28:40.548985+0000","last_peered":"2024-08-17T02:28:40.548985+0000","last_clean":"2024-08-17T02:28:40.548985+0000","last_became_active":"2024-08-17T02:28:39.512760+0000","last_became_peered":"2024-08-17T02:28:39.512760+0000","last_unstale":"2024-08-17T02:28:40.548985+0000","last_undegraded":"2024-08-17T02:28:40.548985+0000","last_fullsized":"2024-08-17T02:28:40.548985+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:08:18.318555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.528973+0000","last_change":"2024-08-17T02:28:40.527299+0000","last_active":"2024-08-17T02:28:40.528973+0000","last_peered":"2024-08-17T02:28:40.528973+0000","last_clean":"2024-08-17T02:28:40.528973+0000","last_became_active":"2024-08-17T02:28:40.527033+0000","last_became_peered":"2024-08-17T02:28:40.527033+0000","last_unstale":"2024-08-17T02:28:40.528973+0000","last_undegraded":"2024-08-17T02:28:40.528973+0000","last_fullsized":"2024-08-17T02:28:40.528973+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:15:36.240605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.525067+0000","last_change":"2024-08-17T02:28:39.525240+0000","last_active":"2024-08-17T02:28:40.525067+0000","last_peered":"2024-08-17T02:28:40.525067+0000","last_clean":"2024-08-17T02:28:40.525067+0000","last_became_active":"2024-08-17T02:28:39.525025+0000","last_became_peered":"2024-08-17T02:28:39.525025+0000","last_unstale":"2024-08-17T02:28:40.525067+0000","last_undegraded":"2024-08-17T02:28:40.525067+0000","last_fullsized":"2024-08-17T02:28:40.525067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:56:37.898150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.532030+0000","last_change":"2024-08-17T02:28:40.528259+0000","last_active":"2024-08-17T02:28:40.532030+0000","last_peered":"2024-08-17T02:28:40.532030+0000","last_clean":"2024-08-17T02:28:40.532030+0000","last_became_active":"2024-08-17T02:28:40.528054+0000","last_became_peered":"2024-08-17T02:28:40.528054+0000","last_unstale":"2024-08-17T02:28:40.532030+0000","last_undegraded":"2024-08-17T02:28:40.532030+0000","last_fullsized":"2024-08-17T02:28:40.532030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:06:07.364340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.515243+0000","last_change":"2024-08-17T02:28:39.524498+0000","last_active":"2024-08-17T02:28:40.515243+0000","last_peered":"2024-08-17T02:28:40.515243+0000","last_clean":"2024-08-17T02:28:40.515243+0000","last_became_active":"2024-08-17T02:28:39.524230+0000","last_became_peered":"2024-08-17T02:28:39.524230+0000","last_unstale":"2024-08-17T02:28:40.515243+0000","last_undegraded":"2024-08-17T02:28:40.515243+0000","last_fullsized":"2024-08-17T02:28:40.515243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:33.214446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.545189+0000","last_change":"2024-08-17T02:28:40.535690+0000","last_active":"2024-08-17T02:28:40.545189+0000","last_peered":"2024-08-17T02:28:40.545189+0000","last_clean":"2024-08-17T02:28:40.545189+0000","last_became_active":"2024-08-17T02:28:40.533178+0000","last_became_peered":"2024-08-17T02:28:40.533178+0000","last_unstale":"2024-08-17T02:28:40.545189+0000","last_undegraded":"2024-08-17T02:28:40.545189+0000","last_fullsized":"2024-08-17T02:28:40.545189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:41:28.034779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.512167+0000","last_change":"2024-08-17T02:28:39.511566+0000","last_active":"2024-08-17T02:28:40.512167+0000","last_peered":"2024-08-17T02:28:40.512167+0000","last_clean":"2024-08-17T02:28:40.512167+0000","last_became_active":"2024-08-17T02:28:39.511284+0000","last_became_peered":"2024-08-17T02:28:39.511284+0000","last_unstale":"2024-08-17T02:28:40.512167+0000","last_undegraded":"2024-08-17T02:28:40.512167+0000","last_fullsized":"2024-08-17T02:28:40.512167+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:15:35.234765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.544301+0000","last_change":"2024-08-17T02:28:40.538818+0000","last_active":"2024-08-17T02:28:40.544301+0000","last_peered":"2024-08-17T02:28:40.544301+0000","last_clean":"2024-08-17T02:28:40.544301+0000","last_became_active":"2024-08-17T02:28:40.538453+0000","last_became_peered":"2024-08-17T02:28:40.538453+0000","last_unstale":"2024-08-17T02:28:40.544301+0000","last_undegraded":"2024-08-17T02:28:40.544301+0000","last_fullsized":"2024-08-17T02:28:40.544301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:34:23.586864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.547412+0000","last_change":"2024-08-17T02:28:39.524900+0000","last_active":"2024-08-17T02:28:40.547412+0000","last_peered":"2024-08-17T02:28:40.547412+0000","last_clean":"2024-08-17T02:28:40.547412+0000","last_became_active":"2024-08-17T02:28:39.524607+0000","last_became_peered":"2024-08-17T02:28:39.524607+0000","last_unstale":"2024-08-17T02:28:40.547412+0000","last_undegraded":"2024-08-17T02:28:40.547412+0000","last_fullsized":"2024-08-17T02:28:40.547412+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:15:35.234765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.530852+0000","last_change":"2024-08-17T02:28:40.522315+0000","last_active":"2024-08-17T02:28:40.530852+0000","last_peered":"2024-08-17T02:28:40.530852+0000","last_clean":"2024-08-17T02:28:40.530852+0000","last_became_active":"2024-08-17T02:28:40.522018+0000","last_became_peered":"2024-08-17T02:28:40.522018+0000","last_unstale":"2024-08-17T02:28:40.530852+0000","last_undegraded":"2024-08-17T02:28:40.530852+0000","last_fullsized":"2024-08-17T02:28:40.530852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:43:00.460758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:28:42.690010+0000","last_change":"2024-08-17T02:28:39.524072+0000","last_active":"2024-08-17T02:28:42.690010+0000","last_peered":"2024-08-17T02:28:42.690010+0000","last_clean":"2024-08-17T02:28:42.690010+0000","last_became_active":"2024-08-17T02:28:39.523818+0000","last_became_peered":"2024-08-17T02:28:39.523818+0000","last_unstale":"2024-08-17T02:28:42.690010+0000","last_undegraded":"2024-08-17T02:28:42.690010+0000","last_fullsized":"2024-08-17T02:28:42.690010+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:01:21.739302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.527456+0000","last_change":"2024-08-17T02:28:40.522941+0000","last_active":"2024-08-17T02:28:40.527456+0000","last_peered":"2024-08-17T02:28:40.527456+0000","last_clean":"2024-08-17T02:28:40.527456+0000","last_became_active":"2024-08-17T02:28:40.522629+0000","last_became_peered":"2024-08-17T02:28:40.522629+0000","last_unstale":"2024-08-17T02:28:40.527456+0000","last_undegraded":"2024-08-17T02:28:40.527456+0000","last_fullsized":"2024-08-17T02:28:40.527456+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:06:07.364340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.513108+0000","last_change":"2024-08-17T02:28:39.526302+0000","last_active":"2024-08-17T02:28:40.513108+0000","last_peered":"2024-08-17T02:28:40.513108+0000","last_clean":"2024-08-17T02:28:40.513108+0000","last_became_active":"2024-08-17T02:28:39.525515+0000","last_became_peered":"2024-08-17T02:28:39.525515+0000","last_unstale":"2024-08-17T02:28:40.513108+0000","last_undegraded":"2024-08-17T02:28:40.513108+0000","last_fullsized":"2024-08-17T02:28:40.513108+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:49:45.494694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.538888+0000","last_change":"2024-08-17T02:28:40.525216+0000","last_active":"2024-08-17T02:28:40.538888+0000","last_peered":"2024-08-17T02:28:40.538888+0000","last_clean":"2024-08-17T02:28:40.538888+0000","last_became_active":"2024-08-17T02:28:40.524492+0000","last_became_peered":"2024-08-17T02:28:40.524492+0000","last_unstale":"2024-08-17T02:28:40.538888+0000","last_undegraded":"2024-08-17T02:28:40.538888+0000","last_fullsized":"2024-08-17T02:28:40.538888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:49:46.500534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.510861+0000","last_change":"2024-08-17T02:28:39.510556+0000","last_active":"2024-08-17T02:28:40.510861+0000","last_peered":"2024-08-17T02:28:40.510861+0000","last_clean":"2024-08-17T02:28:40.510861+0000","last_became_active":"2024-08-17T02:28:39.510309+0000","last_became_peered":"2024-08-17T02:28:39.510309+0000","last_unstale":"2024-08-17T02:28:40.510861+0000","last_undegraded":"2024-08-17T02:28:40.510861+0000","last_fullsized":"2024-08-17T02:28:40.510861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:56:37.898150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.532396+0000","last_change":"2024-08-17T02:28:40.529787+0000","last_active":"2024-08-17T02:28:40.532396+0000","last_peered":"2024-08-17T02:28:40.532396+0000","last_clean":"2024-08-17T02:28:40.532396+0000","last_became_active":"2024-08-17T02:28:40.529361+0000","last_became_peered":"2024-08-17T02:28:40.529361+0000","last_unstale":"2024-08-17T02:28:40.532396+0000","last_undegraded":"2024-08-17T02:28:40.532396+0000","last_fullsized":"2024-08-17T02:28:40.532396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:47:58.359450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.512986+0000","last_change":"2024-08-17T02:28:39.524519+0000","last_active":"2024-08-17T02:28:40.512986+0000","last_peered":"2024-08-17T02:28:40.512986+0000","last_clean":"2024-08-17T02:28:40.512986+0000","last_became_active":"2024-08-17T02:28:39.524227+0000","last_became_peered":"2024-08-17T02:28:39.524227+0000","last_unstale":"2024-08-17T02:28:40.512986+0000","last_undegraded":"2024-08-17T02:28:40.512986+0000","last_fullsized":"2024-08-17T02:28:40.512986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:40:58.510911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.534084+0000","last_change":"2024-08-17T02:28:40.526109+0000","last_active":"2024-08-17T02:28:40.534084+0000","last_peered":"2024-08-17T02:28:40.534084+0000","last_clean":"2024-08-17T02:28:40.534084+0000","last_became_active":"2024-08-17T02:28:40.525852+0000","last_became_peered":"2024-08-17T02:28:40.525852+0000","last_unstale":"2024-08-17T02:28:40.534084+0000","last_undegraded":"2024-08-17T02:28:40.534084+0000","last_fullsized":"2024-08-17T02:28:40.534084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:41:05.540034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.515340+0000","last_change":"2024-08-17T02:28:39.525106+0000","last_active":"2024-08-17T02:28:40.515340+0000","last_peered":"2024-08-17T02:28:40.515340+0000","last_clean":"2024-08-17T02:28:40.515340+0000","last_became_active":"2024-08-17T02:28:39.524381+0000","last_became_peered":"2024-08-17T02:28:39.524381+0000","last_unstale":"2024-08-17T02:28:40.515340+0000","last_undegraded":"2024-08-17T02:28:40.515340+0000","last_fullsized":"2024-08-17T02:28:40.515340+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:43:29.281149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.540552+0000","last_change":"2024-08-17T02:28:40.533104+0000","last_active":"2024-08-17T02:28:40.540552+0000","last_peered":"2024-08-17T02:28:40.540552+0000","last_clean":"2024-08-17T02:28:40.540552+0000","last_became_active":"2024-08-17T02:28:40.532749+0000","last_became_peered":"2024-08-17T02:28:40.532749+0000","last_unstale":"2024-08-17T02:28:40.540552+0000","last_undegraded":"2024-08-17T02:28:40.540552+0000","last_fullsized":"2024-08-17T02:28:40.540552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:32:27.622020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.520587+0000","last_change":"2024-08-17T02:28:39.519382+0000","last_active":"2024-08-17T02:28:40.520587+0000","last_peered":"2024-08-17T02:28:40.520587+0000","last_clean":"2024-08-17T02:28:40.520587+0000","last_became_active":"2024-08-17T02:28:39.519037+0000","last_became_peered":"2024-08-17T02:28:39.519037+0000","last_unstale":"2024-08-17T02:28:40.520587+0000","last_undegraded":"2024-08-17T02:28:40.520587+0000","last_fullsized":"2024-08-17T02:28:40.520587+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:23:41.936601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.533422+0000","last_change":"2024-08-17T02:28:40.529258+0000","last_active":"2024-08-17T02:28:40.533422+0000","last_peered":"2024-08-17T02:28:40.533422+0000","last_clean":"2024-08-17T02:28:40.533422+0000","last_became_active":"2024-08-17T02:28:40.528993+0000","last_became_peered":"2024-08-17T02:28:40.528993+0000","last_unstale":"2024-08-17T02:28:40.533422+0000","last_undegraded":"2024-08-17T02:28:40.533422+0000","last_fullsized":"2024-08-17T02:28:40.533422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:39.492419+0000","last_clean_scrub_stamp":"2024-08-17T02:28:39.492419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:52:23.690788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.525578+0000","last_change":"2024-08-17T02:28:39.520713+0000","last_active":"2024-08-17T02:28:40.525578+0000","last_peered":"2024-08-17T02:28:40.525578+0000","last_clean":"2024-08-17T02:28:40.525578+0000","last_became_active":"2024-08-17T02:28:39.519650+0000","last_became_peered":"2024-08-17T02:28:39.519650+0000","last_unstale":"2024-08-17T02:28:40.525578+0000","last_undegraded":"2024-08-17T02:28:40.525578+0000","last_fullsized":"2024-08-17T02:28:40.525578+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:28:38.486579+0000","last_clean_scrub_stamp":"2024-08-17T02:28:38.486579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:01:21.739302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:28:40.519841+0000","last_change":"2024-08-17T02:27:39.552321+0000","last_active":"2024-08-17T02:28:40.519841+0000","last_peered":"2024-08-17T02:28:40.519841+0000","last_clean":"2024-08-17T02:28:40.519841+0000","last_became_active":"2024-08-17T02:27:39.551203+0000","last_became_peered":"2024-08-17T02:27:39.551203+0000","last_unstale":"2024-08-17T02:28:40.519841+0000","last_undegraded":"2024-08-17T02:28:40.519841+0000","last_fullsized":"2024-08-17T02:28:40.519841+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.155679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.155679+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.155679+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:02.785032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298292,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073548,"statfs":{"total":96636764160,"available":96331313152,"internally_reserved":0,"allocated":958464,"data_stored":730587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.79300000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":6.819,"5min":6.819,"15min":6.819},"last":0.76000000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.68500000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.73599999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.621},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.96799999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.72099999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.89900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":368640,"data_stored":140733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.67200000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.63700000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.80800000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.73799999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.90000000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.878}]},{"osd":7,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.82999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":368640,"data_stored":140789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.51700000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.498},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.56499999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.439},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.55300000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.54600000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.47799999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.60399999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.624}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":368640,"data_stored":140233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.54900000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.67100000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.622}]},{"osd":3,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.80600000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.66100000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.81999999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.89100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297724,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074116,"statfs":{"total":96636764160,"available":96331894784,"internally_reserved":0,"allocated":376832,"data_stored":141703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.309}]},{"osd":1,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.35599999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.378},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":0.46700000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.55200000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.53200000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.65400000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:28:40 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.66800000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297708,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074132,"statfs":{"total":96636764160,"available":96331911168,"internally_reserved":0,"allocated":352256,"data_stored":133911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.39600000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.504},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.374}]},{"osd":3,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.56299999999999994}]},{"osd":4,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.79100000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":0.83699999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.788,"5min":1.788,"15min":1.788},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":0.73699999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:28:38 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.88200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297724,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074116,"statfs":{"total":96636764160,"available":96331894784,"internally_reserved":0,"allocated":376832,"data_stored":141703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.376},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.47299999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.54600000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.624},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.617,"5min":2.617,"15min":2.617},"last":0.58899999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.94099999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.96799999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.92500000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.76900000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298284,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073556,"statfs":{"total":96636764160,"available":96331321344,"internally_reserved":0,"allocated":942080,"data_stored":724209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.442},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.46600000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.41299999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.47999999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.61899999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.64000000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.54500000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:28:39 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.57699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:28:45.062 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:28:45.062 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-17T02:28:45.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.252+0000 7f402d600640 1 Processor -- start 2024-08-17T02:28:45.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.252+0000 7f402d600640 1 -- start start 2024-08-17T02:28:45.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.253+0000 7f402d600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4028150130 0x7f40280aa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.253+0000 7f402d600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4028156d40 0x7f402806dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.253+0000 7f402d600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40281568b0 con 0x7f402806e420 2024-08-17T02:28:45.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.253+0000 7f402d600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f402806e8a0 con 0x7f4028150130 2024-08-17T02:28:45.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.253+0000 7f402d600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4028150500 con 0x7f4028156d40 2024-08-17T02:28:45.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.254+0000 7f4026a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4028150130 0x7f40280aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.254+0000 7f4026a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4028150130 0x7f40280aa730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59910/0 (socket says 172.21.15.106:59910) 2024-08-17T02:28:45.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.254+0000 7f4026a00640 1 -- 172.21.15.106:0/4230965221 learned_addr learned my addr 172.21.15.106:0/4230965221 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:45.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.254+0000 7f4026000640 1 --2- 172.21.15.106:0/4230965221 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4028156d40 0x7f402806dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.254+0000 7f4026a00640 1 -- 172.21.15.106:0/4230965221 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4028156d40 msgr2=0x7f402806dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:45.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.254+0000 7f4026a00640 1 --2- 172.21.15.106:0/4230965221 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4028156d40 0x7f402806dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.254+0000 7f4026a00640 1 -- 172.21.15.106:0/4230965221 >> v1:172.21.15.171:6789/0 conn(0x7f402806e420 legacy=0x7f40280afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.254+0000 7f4026a00640 1 -- 172.21.15.106:0/4230965221 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4028155fc0 con 0x7f4028150130 2024-08-17T02:28:45.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.254+0000 7f4026000640 1 --2- 172.21.15.106:0/4230965221 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4028156d40 0x7f402806dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:45.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.255+0000 7f4026a00640 1 --2- 172.21.15.106:0/4230965221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4028150130 0x7f40280aa730 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4018009910 tx=0x7f40180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55432b3204b9ba4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:45.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.255+0000 7f4025600640 1 -- 172.21.15.106:0/4230965221 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401802add0 con 0x7f4028150130 2024-08-17T02:28:45.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.255+0000 7f4025600640 1 -- 172.21.15.106:0/4230965221 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4018032440 con 0x7f4028150130 2024-08-17T02:28:45.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.255+0000 7f4025600640 1 -- 172.21.15.106:0/4230965221 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4018032820 con 0x7f4028150130 2024-08-17T02:28:45.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.256+0000 7f402d600640 1 -- 172.21.15.106:0/4230965221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4028150130 msgr2=0x7f40280aa730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.256+0000 7f402d600640 1 --2- 172.21.15.106:0/4230965221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4028150130 0x7f40280aa730 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4018009910 tx=0x7f40180091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.256+0000 7f402d600640 1 -- 172.21.15.106:0/4230965221 shutdown_connections 2024-08-17T02:28:45.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.256+0000 7f402d600640 1 --2- 172.21.15.106:0/4230965221 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4028156d40 0x7f402806dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.256+0000 7f402d600640 1 --2- 172.21.15.106:0/4230965221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4028150130 0x7f40280aa730 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.256+0000 7f402d600640 1 -- 172.21.15.106:0/4230965221 >> 172.21.15.106:0/4230965221 conn(0x7f4028067750 msgr2=0x7f402806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:45.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.256+0000 7f402d600640 1 -- 172.21.15.106:0/4230965221 shutdown_connections 2024-08-17T02:28:45.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.256+0000 7f402d600640 1 -- 172.21.15.106:0/4230965221 wait complete. 2024-08-17T02:28:45.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.258+0000 7f402d600640 1 Processor -- start 2024-08-17T02:28:45.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.258+0000 7f402d600640 1 -- start start 2024-08-17T02:28:45.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.258+0000 7f402d600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f402806e420 0x7f4028150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.259+0000 7f402d600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4028150130 0x7f40281484d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.259+0000 7f402d600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4028156d40 0x7f402814cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.259+0000 7f402d600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402814c6c0 con 0x7f402806e420 2024-08-17T02:28:45.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.259+0000 7f402d600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40281464d0 con 0x7f4028156d40 2024-08-17T02:28:45.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.259+0000 7f402d600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402814b860 con 0x7f4028150130 2024-08-17T02:28:45.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.259+0000 7f4026a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f402806e420 0x7f4028150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.259+0000 7f4026a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f402806e420 0x7f4028150f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59912/0 (socket says 172.21.15.106:59912) 2024-08-17T02:28:45.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.259+0000 7f4026a00640 1 -- 172.21.15.106:0/251255835 learned_addr learned my addr 172.21.15.106:0/251255835 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:45.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.259+0000 7f4026000640 1 --2- 172.21.15.106:0/251255835 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4028150130 0x7f40281484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.259+0000 7f4027400640 1 --2- 172.21.15.106:0/251255835 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4028156d40 0x7f402814cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.259+0000 7f4026a00640 1 -- 172.21.15.106:0/251255835 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4028150130 msgr2=0x7f40281484d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.259+0000 7f4026a00640 1 --2- 172.21.15.106:0/251255835 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4028150130 0x7f40281484d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.259+0000 7f4026a00640 1 -- 172.21.15.106:0/251255835 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4028156d40 msgr2=0x7f402814cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.259+0000 7f4026a00640 1 --2- 172.21.15.106:0/251255835 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4028156d40 0x7f402814cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.259+0000 7f4026a00640 1 -- 172.21.15.106:0/251255835 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4018009450 con 0x7f402806e420 2024-08-17T02:28:45.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.260+0000 7f4026a00640 1 --2- 172.21.15.106:0/251255835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f402806e420 0x7f4028150f20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4018035040 tx=0x7f4018032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:45.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.260+0000 7f401e000640 1 -- 172.21.15.106:0/251255835 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4018000c90 con 0x7f402806e420 2024-08-17T02:28:45.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.260+0000 7f401e000640 1 -- 172.21.15.106:0/251255835 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4018031a40 con 0x7f402806e420 2024-08-17T02:28:45.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.260+0000 7f401e000640 1 -- 172.21.15.106:0/251255835 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4018031e00 con 0x7f402806e420 2024-08-17T02:28:45.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.260+0000 7f402d600640 1 -- 172.21.15.106:0/251255835 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f402814bab0 con 0x7f402806e420 2024-08-17T02:28:45.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.260+0000 7f402d600640 1 -- 172.21.15.106:0/251255835 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402814c070 con 0x7f402806e420 2024-08-17T02:28:45.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.261+0000 7f402d600640 1 -- 172.21.15.106:0/251255835 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40280710c0 con 0x7f402806e420 2024-08-17T02:28:45.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.262+0000 7f401e000640 1 -- 172.21.15.106:0/251255835 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4018039040 con 0x7f402806e420 2024-08-17T02:28:45.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.263+0000 7f401e000640 1 --2- 172.21.15.106:0/251255835 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4008065150 0x7f4008067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.263+0000 7f401e000640 1 -- 172.21.15.106:0/251255835 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f40180a2160 con 0x7f402806e420 2024-08-17T02:28:45.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.263+0000 7f4026000640 1 --2- 172.21.15.106:0/251255835 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4008065150 0x7f4008067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.263+0000 7f4026000640 1 --2- 172.21.15.106:0/251255835 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4008065150 0x7f4008067600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f402806a710 tx=0x7f4014008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:45.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.267+0000 7f401e000640 1 -- 172.21.15.106:0/251255835 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4018070230 con 0x7f402806e420 2024-08-17T02:28:45.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.501+0000 7f402d600640 1 -- 172.21.15.106:0/251255835 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4028155da0 con 0x7f402806e420 2024-08-17T02:28:45.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.506+0000 7f401e000640 1 -- 172.21.15.106:0/251255835 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4018073850 con 0x7f402806e420 2024-08-17T02:28:45.506 INFO:teuthology.orchestra.run.smithi106.stderr:updated caps for client.0 2024-08-17T02:28:45.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.508+0000 7f402d600640 1 -- 172.21.15.106:0/251255835 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4008065150 msgr2=0x7f4008067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.508+0000 7f402d600640 1 --2- 172.21.15.106:0/251255835 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4008065150 0x7f4008067600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f402806a710 tx=0x7f4014008040 comp rx=0 tx=0).stop 2024-08-17T02:28:45.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.508+0000 7f402d600640 1 -- 172.21.15.106:0/251255835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f402806e420 msgr2=0x7f4028150f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.508+0000 7f402d600640 1 --2- 172.21.15.106:0/251255835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f402806e420 0x7f4028150f20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4018035040 tx=0x7f4018032000 comp rx=0 tx=0).stop 2024-08-17T02:28:45.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.508+0000 7f402d600640 1 -- 172.21.15.106:0/251255835 shutdown_connections 2024-08-17T02:28:45.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.508+0000 7f402d600640 1 --2- 172.21.15.106:0/251255835 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4028156d40 0x7f402814cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.508+0000 7f402d600640 1 --2- 172.21.15.106:0/251255835 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4028150130 0x7f40281484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.508+0000 7f402d600640 1 --2- 172.21.15.106:0/251255835 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4008065150 0x7f4008067600 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.508+0000 7f402d600640 1 --2- 172.21.15.106:0/251255835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f402806e420 0x7f4028150f20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.508+0000 7f402d600640 1 -- 172.21.15.106:0/251255835 >> 172.21.15.106:0/251255835 conn(0x7f4028067750 msgr2=0x7f40280ae9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:45.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.508+0000 7f402d600640 1 -- 172.21.15.106:0/251255835 shutdown_connections 2024-08-17T02:28:45.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.508+0000 7f402d600640 1 -- 172.21.15.106:0/251255835 wait complete. 2024-08-17T02:28:45.523 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:45.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.669+0000 7f0cd3200640 1 Processor -- start 2024-08-17T02:28:45.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.670+0000 7f0cd3200640 1 -- start start 2024-08-17T02:28:45.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.671+0000 7f0cd3200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0cd4155900 0x7f0cd4155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.671+0000 7f0cd3200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0cd40b0270 0x7f0cd4156210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.671+0000 7f0cd3200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0cd4157b20 0x7f0cd4157f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.671+0000 7f0cd3200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cd4157690 con 0x7f0cd40b0270 2024-08-17T02:28:45.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.671+0000 7f0cd3200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cd4156a80 con 0x7f0cd4155900 2024-08-17T02:28:45.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.671+0000 7f0cd3200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd4156d60 con 0x7f0cd4157b20 2024-08-17T02:28:45.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.671+0000 7f0cd1400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0cd40b0270 0x7f0cd4156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.671+0000 7f0cd1400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0cd40b0270 0x7f0cd4156210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59920/0 (socket says 172.21.15.106:59920) 2024-08-17T02:28:45.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.671+0000 7f0cd1400640 1 -- 172.21.15.106:0/2469456626 learned_addr learned my addr 172.21.15.106:0/2469456626 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:45.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.671+0000 7f0cd2800640 1 --2- 172.21.15.106:0/2469456626 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0cd4157b20 0x7f0cd4157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.671+0000 7f0cd1e00640 1 --2- 172.21.15.106:0/2469456626 >> v2:172.21.15.171:3300/0 conn(0x7f0cd4155900 0x7f0cd4155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.672+0000 7f0cd1400640 1 -- 172.21.15.106:0/2469456626 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0cd4157b20 msgr2=0x7f0cd4157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:45.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.672+0000 7f0cd1400640 1 --2- 172.21.15.106:0/2469456626 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0cd4157b20 0x7f0cd4157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.672+0000 7f0cd1400640 1 -- 172.21.15.106:0/2469456626 >> v2:172.21.15.171:3300/0 conn(0x7f0cd4155900 msgr2=0x7f0cd4155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:45.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.672+0000 7f0cd1400640 1 --2- 172.21.15.106:0/2469456626 >> v2:172.21.15.171:3300/0 conn(0x7f0cd4155900 0x7f0cd4155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.672+0000 7f0cd1400640 1 -- 172.21.15.106:0/2469456626 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd4157040 con 0x7f0cd40b0270 2024-08-17T02:28:45.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.672+0000 7f0cd2800640 1 --2- 172.21.15.106:0/2469456626 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0cd4157b20 0x7f0cd4157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:45.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.672+0000 7f0cd1e00640 1 --2- 172.21.15.106:0/2469456626 >> v2:172.21.15.171:3300/0 conn(0x7f0cd4155900 0x7f0cd4155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:45.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.673+0000 7f0cd1400640 1 --2- 172.21.15.106:0/2469456626 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cd40b0270 0x7f0cd4156210 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4065fd0 tx=0x7f0cc00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61783e70b4b74a3e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:45.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.673+0000 7f0cd0a00640 1 -- 172.21.15.106:0/2469456626 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc002ad40 con 0x7f0cd40b0270 2024-08-17T02:28:45.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.673+0000 7f0cd0a00640 1 -- 172.21.15.106:0/2469456626 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc0032440 con 0x7f0cd40b0270 2024-08-17T02:28:45.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.673+0000 7f0cd0a00640 1 -- 172.21.15.106:0/2469456626 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc002aea0 con 0x7f0cd40b0270 2024-08-17T02:28:45.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.673+0000 7f0cd3200640 1 -- 172.21.15.106:0/2469456626 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cd40b0270 msgr2=0x7f0cd4156210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.673+0000 7f0cd3200640 1 --2- 172.21.15.106:0/2469456626 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cd40b0270 0x7f0cd4156210 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4065fd0 tx=0x7f0cc00091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.673+0000 7f0cd3200640 1 -- 172.21.15.106:0/2469456626 shutdown_connections 2024-08-17T02:28:45.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.673+0000 7f0cd3200640 1 --2- 172.21.15.106:0/2469456626 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0cd4157b20 0x7f0cd4157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.673+0000 7f0cd3200640 1 --2- 172.21.15.106:0/2469456626 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cd40b0270 0x7f0cd4156210 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.674+0000 7f0cd3200640 1 --2- 172.21.15.106:0/2469456626 >> v2:172.21.15.171:3300/0 conn(0x7f0cd4155900 0x7f0cd4155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.674+0000 7f0cd3200640 1 -- 172.21.15.106:0/2469456626 >> 172.21.15.106:0/2469456626 conn(0x7f0cd4067750 msgr2=0x7f0cd40cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:45.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.674+0000 7f0cd3200640 1 -- 172.21.15.106:0/2469456626 shutdown_connections 2024-08-17T02:28:45.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.674+0000 7f0cd3200640 1 -- 172.21.15.106:0/2469456626 wait complete. 2024-08-17T02:28:45.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.675+0000 7f0cd3200640 1 Processor -- start 2024-08-17T02:28:45.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.675+0000 7f0cd3200640 1 -- start start 2024-08-17T02:28:45.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.676+0000 7f0cd3200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cd40b0270 0x7f0cd41515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.676+0000 7f0cd3200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0cd4155900 0x7f0cd40ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.676+0000 7f0cd3200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0cd4157b20 0x7f0cd40a7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.676+0000 7f0cd3200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd4151af0 con 0x7f0cd40b0270 2024-08-17T02:28:45.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.676+0000 7f0cd3200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd40a5670 con 0x7f0cd4155900 2024-08-17T02:28:45.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.676+0000 7f0cd3200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd40a5950 con 0x7f0cd4157b20 2024-08-17T02:28:45.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.676+0000 7f0cd1e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cd40b0270 0x7f0cd41515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.676+0000 7f0cd1e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cd40b0270 0x7f0cd41515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59928/0 (socket says 172.21.15.106:59928) 2024-08-17T02:28:45.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.676+0000 7f0cd1e00640 1 -- 172.21.15.106:0/2627942590 learned_addr learned my addr 172.21.15.106:0/2627942590 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:45.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.676+0000 7f0cd1e00640 1 -- 172.21.15.106:0/2627942590 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0cd4157b20 msgr2=0x7f0cd40a7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.676+0000 7f0cd1e00640 1 --2- 172.21.15.106:0/2627942590 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0cd4157b20 0x7f0cd40a7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.676+0000 7f0cd1e00640 1 -- 172.21.15.106:0/2627942590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0cd4155900 msgr2=0x7f0cd40ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.676+0000 7f0cd1e00640 1 --2- 172.21.15.106:0/2627942590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0cd4155900 0x7f0cd40ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.677+0000 7f0cd1e00640 1 -- 172.21.15.106:0/2627942590 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc0009450 con 0x7f0cd40b0270 2024-08-17T02:28:45.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.677+0000 7f0cd1e00640 1 --2- 172.21.15.106:0/2627942590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cd40b0270 0x7f0cd41515b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0cc400d890 tx=0x7f0cc4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:45.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.677+0000 7f0cc9600640 1 -- 172.21.15.106:0/2627942590 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc400de80 con 0x7f0cd40b0270 2024-08-17T02:28:45.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.677+0000 7f0cc9600640 1 -- 172.21.15.106:0/2627942590 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc400b8d0 con 0x7f0cd40b0270 2024-08-17T02:28:45.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.677+0000 7f0cd3200640 1 -- 172.21.15.106:0/2627942590 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd40a5c30 con 0x7f0cd40b0270 2024-08-17T02:28:45.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.677+0000 7f0cc9600640 1 -- 172.21.15.106:0/2627942590 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc400bc90 con 0x7f0cd40b0270 2024-08-17T02:28:45.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.677+0000 7f0cd3200640 1 -- 172.21.15.106:0/2627942590 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd40a61f0 con 0x7f0cd40b0270 2024-08-17T02:28:45.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.678+0000 7f0cd3200640 1 -- 172.21.15.106:0/2627942590 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd4071050 con 0x7f0cd40b0270 2024-08-17T02:28:45.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.679+0000 7f0cc9600640 1 -- 172.21.15.106:0/2627942590 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0cc401e460 con 0x7f0cd40b0270 2024-08-17T02:28:45.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.680+0000 7f0cc9600640 1 --2- 172.21.15.106:0/2627942590 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0cb4065150 0x7f0cb4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.680+0000 7f0cc9600640 1 -- 172.21.15.106:0/2627942590 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0cc4082ba0 con 0x7f0cd40b0270 2024-08-17T02:28:45.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.680+0000 7f0cd1400640 1 --2- 172.21.15.106:0/2627942590 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0cb4065150 0x7f0cb4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.681+0000 7f0cd1400640 1 --2- 172.21.15.106:0/2627942590 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0cb4065150 0x7f0cb4067600 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0034000 tx=0x7f0cc0032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:45.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.684+0000 7f0cc9600640 1 -- 172.21.15.106:0/2627942590 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0cc4050bc0 con 0x7f0cd40b0270 2024-08-17T02:28:45.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.892+0000 7f0cd3200640 1 -- 172.21.15.106:0/2627942590 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0cd406f480 con 0x7f0cd40b0270 2024-08-17T02:28:45.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.892+0000 7f0cc9600640 1 -- 172.21.15.106:0/2627942590 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4606 (secure 0 0 0) 0x7f0cc40541e0 con 0x7f0cd40b0270 2024-08-17T02:28:45.893 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:45.893 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4900,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1137148711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1137148711},{"type":"v1","addr":"172.21.15.106:6836","nonce":1137148711}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4903,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3136131297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":3136131297},{"type":"v1","addr":"172.21.15.106:6837","nonce":3136131297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4909,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/3251295288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6833","nonce":3251295288},{"type":"v1","addr":"172.21.15.171:6835","nonce":3251295288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:39.908382+0000","modified":"2024-08-17T02:28:43.540030+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6834/754665763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":754665763},{"type":"v1","addr":"172.21.15.171:6834","nonce":754665763}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:28:45.893 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 17 2024-08-17T02:28:45.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.894+0000 7f0cd3200640 1 -- 172.21.15.106:0/2627942590 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0cb4065150 msgr2=0x7f0cb4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.894+0000 7f0cd3200640 1 --2- 172.21.15.106:0/2627942590 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0cb4065150 0x7f0cb4067600 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0034000 tx=0x7f0cc0032000 comp rx=0 tx=0).stop 2024-08-17T02:28:45.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.894+0000 7f0cd3200640 1 -- 172.21.15.106:0/2627942590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cd40b0270 msgr2=0x7f0cd41515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.894+0000 7f0cd3200640 1 --2- 172.21.15.106:0/2627942590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cd40b0270 0x7f0cd41515b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0cc400d890 tx=0x7f0cc4008040 comp rx=0 tx=0).stop 2024-08-17T02:28:45.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.894+0000 7f0cd3200640 1 -- 172.21.15.106:0/2627942590 shutdown_connections 2024-08-17T02:28:45.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.894+0000 7f0cd3200640 1 --2- 172.21.15.106:0/2627942590 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0cd4157b20 0x7f0cd40a7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.894+0000 7f0cd3200640 1 --2- 172.21.15.106:0/2627942590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0cd4155900 0x7f0cd40ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.894+0000 7f0cd3200640 1 --2- 172.21.15.106:0/2627942590 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0cb4065150 0x7f0cb4067600 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.894+0000 7f0cd3200640 1 --2- 172.21.15.106:0/2627942590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cd40b0270 0x7f0cd41515b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.894+0000 7f0cd3200640 1 -- 172.21.15.106:0/2627942590 >> 172.21.15.106:0/2627942590 conn(0x7f0cd4067750 msgr2=0x7f0cd406da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:45.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.894+0000 7f0cd3200640 1 -- 172.21.15.106:0/2627942590 shutdown_connections 2024-08-17T02:28:45.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:45.894+0000 7f0cd3200640 1 -- 172.21.15.106:0/2627942590 wait complete. 2024-08-17T02:28:46.313 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:28:39.908382+0000', 'modified': '2024-08-17T02:28:43.540030+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4959}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4959': {'gid': 4959, 'name': 'b', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.171:6834/754665763', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6832', 'nonce': 754665763}, {'type': 'v1', 'addr': '172.21.15.171:6834', 'nonce': 754665763}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:28:46.314 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:28:46.314 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-08-17T02:28:46.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.463+0000 7f0505600640 1 Processor -- start 2024-08-17T02:28:46.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.463+0000 7f0505600640 1 -- start start 2024-08-17T02:28:46.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.464+0000 7f0505600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0500155550 0x7f05000aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.464+0000 7f0505600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f050006e080 0x7f050006e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.464+0000 7f0505600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05000afc10 con 0x7f0500155180 2024-08-17T02:28:46.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.464+0000 7f0505600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f050006ea00 con 0x7f0500155550 2024-08-17T02:28:46.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.464+0000 7f0505600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05000af000 con 0x7f050006e080 2024-08-17T02:28:46.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.465+0000 7f04fe000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0500155550 0x7f05000aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.465+0000 7f04ff400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f050006e080 0x7f050006e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.465+0000 7f04fe000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0500155550 0x7f05000aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:44872/0 (socket says 172.21.15.106:44872) 2024-08-17T02:28:46.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.465+0000 7f04fe000640 1 -- 172.21.15.106:0/2749348096 learned_addr learned my addr 172.21.15.106:0/2749348096 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:46.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.465+0000 7f04fe000640 1 -- 172.21.15.106:0/2749348096 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f050006e080 msgr2=0x7f050006e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:46.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.465+0000 7f04fe000640 1 --2- 172.21.15.106:0/2749348096 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f050006e080 0x7f050006e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.465+0000 7f04fe000640 1 -- 172.21.15.106:0/2749348096 >> v1:172.21.15.171:6789/0 conn(0x7f0500155180 legacy=0x7f05000ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.465+0000 7f04fe000640 1 -- 172.21.15.106:0/2749348096 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05000af2e0 con 0x7f0500155550 2024-08-17T02:28:46.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.465+0000 7f04fd600640 1 -- 172.21.15.106:0/2749348096 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4216269301 0 0) 0x7f05000afc10 con 0x7f0500155180 2024-08-17T02:28:46.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.467+0000 7f04fe000640 1 --2- 172.21.15.106:0/2749348096 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0500155550 0x7f05000aea20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f04ec009910 tx=0x7f04ec0091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=984ae52558ead519 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:46.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.467+0000 7f04fd600640 1 -- 172.21.15.106:0/2749348096 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec02ae40 con 0x7f0500155550 2024-08-17T02:28:46.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.467+0000 7f04fd600640 1 -- 172.21.15.106:0/2749348096 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ec032440 con 0x7f0500155550 2024-08-17T02:28:46.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.467+0000 7f04fd600640 1 -- 172.21.15.106:0/2749348096 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec0327e0 con 0x7f0500155550 2024-08-17T02:28:46.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.467+0000 7f0505600640 1 -- 172.21.15.106:0/2749348096 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0500155550 msgr2=0x7f05000aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.467+0000 7f0505600640 1 --2- 172.21.15.106:0/2749348096 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0500155550 0x7f05000aea20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f04ec009910 tx=0x7f04ec0091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.467+0000 7f0505600640 1 -- 172.21.15.106:0/2749348096 shutdown_connections 2024-08-17T02:28:46.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.467+0000 7f0505600640 1 --2- 172.21.15.106:0/2749348096 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f050006e080 0x7f050006e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.467+0000 7f0505600640 1 --2- 172.21.15.106:0/2749348096 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0500155550 0x7f05000aea20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.467+0000 7f0505600640 1 -- 172.21.15.106:0/2749348096 >> 172.21.15.106:0/2749348096 conn(0x7f05000cb9b0 msgr2=0x7f05000cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:46.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.468+0000 7f0505600640 1 -- 172.21.15.106:0/2749348096 shutdown_connections 2024-08-17T02:28:46.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.468+0000 7f0505600640 1 -- 172.21.15.106:0/2749348096 wait complete. 2024-08-17T02:28:46.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.469+0000 7f0505600640 1 Processor -- start 2024-08-17T02:28:46.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.469+0000 7f0505600640 1 -- start start 2024-08-17T02:28:46.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.470+0000 7f0505600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f050006e080 0x7f05000ac080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.470+0000 7f0505600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0500155180 0x7f0500169c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.470+0000 7f0505600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0500155550 0x7f05000aa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.470+0000 7f0505600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0500166640 con 0x7f050006e080 2024-08-17T02:28:46.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.470+0000 7f0505600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0500166910 con 0x7f0500155180 2024-08-17T02:28:46.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.470+0000 7f0505600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050016a1d0 con 0x7f0500155550 2024-08-17T02:28:46.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.470+0000 7f04fea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f050006e080 0x7f05000ac080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.470+0000 7f04fea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f050006e080 0x7f05000ac080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59944/0 (socket says 172.21.15.106:59944) 2024-08-17T02:28:46.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.470+0000 7f04fea00640 1 -- 172.21.15.106:0/3372196397 learned_addr learned my addr 172.21.15.106:0/3372196397 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:46.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.470+0000 7f04ff400640 1 --2- 172.21.15.106:0/3372196397 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0500155550 0x7f05000aa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.470+0000 7f04fe000640 1 --2- 172.21.15.106:0/3372196397 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0500155180 0x7f0500169c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.471+0000 7f04fea00640 1 -- 172.21.15.106:0/3372196397 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0500155550 msgr2=0x7f05000aa1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.471+0000 7f04fea00640 1 --2- 172.21.15.106:0/3372196397 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0500155550 0x7f05000aa1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.471+0000 7f04fea00640 1 -- 172.21.15.106:0/3372196397 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0500155180 msgr2=0x7f0500169c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.471+0000 7f04fea00640 1 --2- 172.21.15.106:0/3372196397 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0500155180 0x7f0500169c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.471+0000 7f04fea00640 1 -- 172.21.15.106:0/3372196397 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ec009450 con 0x7f050006e080 2024-08-17T02:28:46.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.471+0000 7f04ff400640 1 --2- 172.21.15.106:0/3372196397 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0500155550 0x7f05000aa1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:46.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.471+0000 7f04fea00640 1 --2- 172.21.15.106:0/3372196397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f050006e080 0x7f05000ac080 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f04f00011e0 tx=0x7f04f0007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:46.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.471+0000 7f04f6000640 1 -- 172.21.15.106:0/3372196397 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f0012630 con 0x7f050006e080 2024-08-17T02:28:46.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.471+0000 7f04f6000640 1 -- 172.21.15.106:0/3372196397 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f00127b0 con 0x7f050006e080 2024-08-17T02:28:46.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.471+0000 7f0505600640 1 -- 172.21.15.106:0/3372196397 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f050016a430 con 0x7f050006e080 2024-08-17T02:28:46.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.471+0000 7f04f6000640 1 -- 172.21.15.106:0/3372196397 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f0012b70 con 0x7f050006e080 2024-08-17T02:28:46.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.471+0000 7f0505600640 1 -- 172.21.15.106:0/3372196397 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f050016a9f0 con 0x7f050006e080 2024-08-17T02:28:46.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.473+0000 7f04f6000640 1 -- 172.21.15.106:0/3372196397 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f04f001b400 con 0x7f050006e080 2024-08-17T02:28:46.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.474+0000 7f04f6000640 1 --2- 172.21.15.106:0/3372196397 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f04e0065180 0x7f04e0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.474+0000 7f04f6000640 1 -- 172.21.15.106:0/3372196397 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f04f0081ff0 con 0x7f050006e080 2024-08-17T02:28:46.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.474+0000 7f04fe000640 1 --2- 172.21.15.106:0/3372196397 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f04e0065180 0x7f04e0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.475+0000 7f0507bb0740 1 Processor -- start 2024-08-17T02:28:46.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.475+0000 7f04fe000640 1 --2- 172.21.15.106:0/3372196397 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f04e0065180 0x7f04e0067630 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f04ec034000 tx=0x7f04ec032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:46.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.475+0000 7f0507bb0740 1 -- start start 2024-08-17T02:28:46.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.476+0000 7f0507bb0740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559ca3ef8e40 0x559ca3ef9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.476+0000 7f0507bb0740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559ca3ed44b0 0x559ca3f169e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.476+0000 7f0507bb0740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3f16f20 0x559ca3ecdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.476+0000 7f0507bb0740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ca3e8a380 con 0x559ca3f16f20 2024-08-17T02:28:46.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.476+0000 7f0507bb0740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ca3e339e0 con 0x559ca3ed44b0 2024-08-17T02:28:46.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.476+0000 7f0507bb0740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ca3e31170 con 0x559ca3ef8e40 2024-08-17T02:28:46.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.476+0000 7f04ff400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3f16f20 0x559ca3ecdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.476+0000 7f04ff400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3f16f20 0x559ca3ecdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59954/0 (socket says 172.21.15.106:59954) 2024-08-17T02:28:46.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.476+0000 7f04ff400640 1 -- 172.21.15.106:0/772284640 learned_addr learned my addr 172.21.15.106:0/772284640 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:46.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.476+0000 7f04fe000640 1 --2- 172.21.15.106:0/772284640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559ca3ed44b0 0x559ca3f169e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.476+0000 7f04fea00640 1 --2- 172.21.15.106:0/772284640 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559ca3ef8e40 0x559ca3ef9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.477+0000 7f04ff400640 1 -- 172.21.15.106:0/772284640 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559ca3ef8e40 msgr2=0x559ca3ef9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:46.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.477+0000 7f04ff400640 1 --2- 172.21.15.106:0/772284640 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559ca3ef8e40 0x559ca3ef9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.477+0000 7f04ff400640 1 -- 172.21.15.106:0/772284640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559ca3ed44b0 msgr2=0x559ca3f169e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:46.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.477+0000 7f04ff400640 1 --2- 172.21.15.106:0/772284640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559ca3ed44b0 0x559ca3f169e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.477+0000 7f04ff400640 1 -- 172.21.15.106:0/772284640 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ca3de0820 con 0x559ca3f16f20 2024-08-17T02:28:46.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.477+0000 7f04ff400640 1 --2- 172.21.15.106:0/772284640 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3f16f20 0x559ca3ecdd10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f04f800adf0 tx=0x7f04f800a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ac084fb5fcc70a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:46.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.477+0000 7f04eaa00640 1 -- 172.21.15.106:0/772284640 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8014580 con 0x559ca3f16f20 2024-08-17T02:28:46.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.477+0000 7f04eaa00640 1 -- 172.21.15.106:0/772284640 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f8010050 con 0x559ca3f16f20 2024-08-17T02:28:46.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.477+0000 7f04eaa00640 1 -- 172.21.15.106:0/772284640 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f80148f0 con 0x559ca3f16f20 2024-08-17T02:28:46.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.478+0000 7f0507bb0740 1 -- 172.21.15.106:0/772284640 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3f16f20 msgr2=0x559ca3ecdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.478+0000 7f0507bb0740 1 --2- 172.21.15.106:0/772284640 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3f16f20 0x559ca3ecdd10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f04f800adf0 tx=0x7f04f800a890 comp rx=0 tx=0).stop 2024-08-17T02:28:46.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.478+0000 7f0507bb0740 1 -- 172.21.15.106:0/772284640 shutdown_connections 2024-08-17T02:28:46.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.478+0000 7f0507bb0740 1 --2- 172.21.15.106:0/772284640 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3f16f20 0x559ca3ecdd10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.478+0000 7f0507bb0740 1 --2- 172.21.15.106:0/772284640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559ca3ed44b0 0x559ca3f169e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.478+0000 7f0507bb0740 1 --2- 172.21.15.106:0/772284640 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559ca3ef8e40 0x559ca3ef9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.478+0000 7f0507bb0740 1 -- 172.21.15.106:0/772284640 >> 172.21.15.106:0/772284640 conn(0x559ca3e68030 msgr2=0x559ca3f1b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:46.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.478+0000 7f0507bb0740 1 -- 172.21.15.106:0/772284640 shutdown_connections 2024-08-17T02:28:46.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.478+0000 7f0507bb0740 1 -- 172.21.15.106:0/772284640 wait complete. 2024-08-17T02:28:46.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.478+0000 7f0507bb0740 1 -- start start 2024-08-17T02:28:46.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.479+0000 7f0507bb0740 1 Processor -- start 2024-08-17T02:28:46.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.480+0000 7f0507bb0740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559ca3ed44b0 0x559ca3f14f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.480+0000 7f0507bb0740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3ef8e40 0x559ca3f26e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.480+0000 7f0507bb0740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559ca3f16f20 0x559ca3ed2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.480+0000 7f0507bb0740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ca3e2cf60 con 0x559ca3ef8e40 2024-08-17T02:28:46.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.480+0000 7f0507bb0740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ca3dd5690 con 0x559ca3f16f20 2024-08-17T02:28:46.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.480+0000 7f0507bb0740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ca3dd5330 con 0x559ca3ed44b0 2024-08-17T02:28:46.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.480+0000 7f0507bb0740 10 client.0 _ll_register_callbacks cb 0x559ca3dcf2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:28:46.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.480+0000 7f04fe000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3ef8e40 0x559ca3f26e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.480+0000 7f04fe000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3ef8e40 0x559ca3f26e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59968/0 (socket says 172.21.15.106:59968) 2024-08-17T02:28:46.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.480+0000 7f04fe000640 1 -- 172.21.15.106:0/4175219306 learned_addr learned my addr 172.21.15.106:0/4175219306 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:46.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.480+0000 7f04fea00640 1 --2- 172.21.15.106:0/4175219306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559ca3ed44b0 0x559ca3f14f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.480+0000 7f04ff400640 1 --2- 172.21.15.106:0/4175219306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559ca3f16f20 0x559ca3ed2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.480+0000 7f04fe000640 1 -- 172.21.15.106:0/4175219306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559ca3ed44b0 msgr2=0x559ca3f14f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:46.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.480+0000 7f04fe000640 1 --2- 172.21.15.106:0/4175219306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559ca3ed44b0 0x559ca3f14f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.480+0000 7f04fe000640 1 -- 172.21.15.106:0/4175219306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559ca3f16f20 msgr2=0x559ca3ed2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:46.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.480+0000 7f04fe000640 1 --2- 172.21.15.106:0/4175219306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559ca3f16f20 0x559ca3ed2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.480+0000 7f04fe000640 1 -- 172.21.15.106:0/4175219306 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f800aaf0 con 0x559ca3ef8e40 2024-08-17T02:28:46.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.480+0000 7f04ff400640 1 --2- 172.21.15.106:0/4175219306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559ca3f16f20 0x559ca3ed2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:46.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.481+0000 7f04fe000640 1 --2- 172.21.15.106:0/4175219306 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3ef8e40 0x559ca3f26e50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f04ec02a840 tx=0x7f04ec03d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0b29170f440a83 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:46.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.481+0000 7f04df400640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-08-17T02:28:46.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.481+0000 7f04df400640 1 -- 172.21.15.106:0/4175219306 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec049410 con 0x559ca3ef8e40 2024-08-17T02:28:46.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.481+0000 7f04df400640 1 -- 172.21.15.106:0/4175219306 <== mon.0 v2:172.21.15.106:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f04ec043040 con 0x559ca3ef8e40 2024-08-17T02:28:46.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.481+0000 7f0507bb0740 1 -- 172.21.15.106:0/4175219306 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559ca3e60d20 con 0x559ca3ef8e40 2024-08-17T02:28:46.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.481+0000 7f04df400640 1 -- 172.21.15.106:0/4175219306 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04ec049780 con 0x559ca3ef8e40 2024-08-17T02:28:46.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.481+0000 7f0507bb0740 10 client.5124 fetch_fsmap learned FSMap version 17 2024-08-17T02:28:46.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.481+0000 7f0507bb0740 1 -- 172.21.15.106:0/4175219306 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x559ca3df6ab0 con 0x559ca3ef8e40 2024-08-17T02:28:46.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.481+0000 7f04df400640 1 -- 172.21.15.106:0/4175219306 <== mon.0 v2:172.21.15.106:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559ca3e60d20 con 0x559ca3ef8e40 2024-08-17T02:28:46.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.481+0000 7f04df400640 1 -- 172.21.15.106:0/4175219306 <== mon.0 v2:172.21.15.106:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f04ec0498e0 con 0x559ca3ef8e40 2024-08-17T02:28:46.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.481+0000 7f0507bb0740 10 client.5124 fetch_fsmap finished waiting for FSMap version 17 2024-08-17T02:28:46.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.481+0000 7f0507bb0740 10 client.5124 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-17T02:28:46.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.481+0000 7f0507bb0740 20 client.5124 populate_metadata read hostname 'smithi106' 2024-08-17T02:28:46.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.481+0000 7f0507bb0740 1 --2- 172.21.15.106:0/4175219306 >> [v2:172.21.15.171:6832/754665763,v1:172.21.15.171:6834/754665763] conn(0x559ca3efe3c0 0x559ca3efe790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.481+0000 7f0507bb0740 4 client.5124 mds_command: new command op to 4959 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:28:46.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.481+0000 7f0507bb0740 1 -- 172.21.15.106:0/4175219306 --> [v2:172.21.15.171:6832/754665763,v1:172.21.15.171:6834/754665763] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559ca3b343c0 con 0x559ca3efe3c0 2024-08-17T02:28:46.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.482+0000 7f04fea00640 1 --2- 172.21.15.106:0/4175219306 >> [v2:172.21.15.171:6832/754665763,v1:172.21.15.171:6834/754665763] conn(0x559ca3efe3c0 0x559ca3efe790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.482+0000 7f04fea00640 1 --2- 172.21.15.106:0/4175219306 >> [v2:172.21.15.171:6832/754665763,v1:172.21.15.171:6834/754665763] conn(0x559ca3efe3c0 0x559ca3efe790 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19fa9beac03aaf3b server_cookie=abc37196a9a19661 in_seq=0 out_seq=0 2024-08-17T02:28:46.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.482+0000 7f04df400640 10 client.5124 ms_handle_connect on v2:172.21.15.171:6832/754665763 2024-08-17T02:28:46.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.483+0000 7f04df400640 1 -- 172.21.15.106:0/4175219306 <== mds.0 v2:172.21.15.171:6832/754665763 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x559ca3b343c0 con 0x559ca3efe3c0 2024-08-17T02:28:46.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.483+0000 7f04df400640 10 client.5124 handle_command_reply: tid=0 2024-08-17T02:28:46.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.483+0000 7f0507bb0740 1 client.5124 shutdown 2024-08-17T02:28:46.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.484+0000 7f0507bb0740 1 -- 172.21.15.106:0/4175219306 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3ef8e40 msgr2=0x559ca3f26e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.484+0000 7f0507bb0740 1 --2- 172.21.15.106:0/4175219306 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3ef8e40 0x559ca3f26e50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f04ec02a840 tx=0x7f04ec03d000 comp rx=0 tx=0).stop 2024-08-17T02:28:46.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.484+0000 7f0507bb0740 1 -- 172.21.15.106:0/4175219306 shutdown_connections 2024-08-17T02:28:46.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.484+0000 7f0507bb0740 1 --2- 172.21.15.106:0/4175219306 >> [v2:172.21.15.171:6832/754665763,v1:172.21.15.171:6834/754665763] conn(0x559ca3efe3c0 0x559ca3efe790 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.484+0000 7f0507bb0740 1 --2- 172.21.15.106:0/4175219306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559ca3f16f20 0x559ca3ed2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.484+0000 7f0507bb0740 1 --2- 172.21.15.106:0/4175219306 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3ef8e40 0x559ca3f26e50 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.484+0000 7f0507bb0740 1 --2- 172.21.15.106:0/4175219306 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559ca3ed44b0 0x559ca3f14f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.484+0000 7f04df400640 0 client.5124 ms_handle_reset on v2:172.21.15.171:6832/754665763 2024-08-17T02:28:46.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.484+0000 7f0507bb0740 1 -- 172.21.15.106:0/4175219306 >> 172.21.15.106:0/4175219306 conn(0x559ca3e68030 msgr2=0x559ca3f1ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:46.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.484+0000 7f0507bb0740 1 -- 172.21.15.106:0/4175219306 shutdown_connections 2024-08-17T02:28:46.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.484+0000 7f0507bb0740 1 -- 172.21.15.106:0/4175219306 wait complete. 2024-08-17T02:28:46.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.484+0000 7f0507bb0740 20 client.5124 trim_cache size 0 max 16384 2024-08-17T02:28:46.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.499+0000 7f0507bb0740 1 Processor -- start 2024-08-17T02:28:46.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.499+0000 7f0507bb0740 1 -- start start 2024-08-17T02:28:46.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.500+0000 7f0507bb0740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3ed44b0 0x559ca3f241a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.500+0000 7f0507bb0740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559ca3ef8e40 0x559ca3f1ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.500+0000 7f0507bb0740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559ca3f16f20 0x559ca3ec7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.500+0000 7f0507bb0740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ca3ba7f20 con 0x559ca3ed44b0 2024-08-17T02:28:46.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.500+0000 7f0507bb0740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ca3ecfb20 con 0x559ca3ef8e40 2024-08-17T02:28:46.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.500+0000 7f0507bb0740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ca3efde20 con 0x559ca3f16f20 2024-08-17T02:28:46.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.500+0000 7f04fea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3ed44b0 0x559ca3f241a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.500+0000 7f04fea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3ed44b0 0x559ca3f241a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59970/0 (socket says 172.21.15.106:59970) 2024-08-17T02:28:46.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.500+0000 7f04fea00640 1 -- 172.21.15.106:0/1836888520 learned_addr learned my addr 172.21.15.106:0/1836888520 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:46.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.501+0000 7f04fe000640 1 --2- 172.21.15.106:0/1836888520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559ca3ef8e40 0x559ca3f1ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.501+0000 7f04ff400640 1 --2- 172.21.15.106:0/1836888520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559ca3f16f20 0x559ca3ec7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.501+0000 7f04fea00640 1 -- 172.21.15.106:0/1836888520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559ca3f16f20 msgr2=0x559ca3ec7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:46.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.501+0000 7f04fea00640 1 --2- 172.21.15.106:0/1836888520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559ca3f16f20 0x559ca3ec7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.501+0000 7f04fea00640 1 -- 172.21.15.106:0/1836888520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559ca3ef8e40 msgr2=0x559ca3f1ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:46.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.501+0000 7f04fea00640 1 --2- 172.21.15.106:0/1836888520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559ca3ef8e40 0x559ca3f1ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.501+0000 7f04fea00640 1 -- 172.21.15.106:0/1836888520 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ca3dfa490 con 0x559ca3ed44b0 2024-08-17T02:28:46.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.501+0000 7f04ff400640 1 --2- 172.21.15.106:0/1836888520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559ca3f16f20 0x559ca3ec7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:46.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.501+0000 7f04fea00640 1 --2- 172.21.15.106:0/1836888520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3ed44b0 0x559ca3f241a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f04f0053c60 tx=0x7f04f0067040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c5913d706eda9f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:46.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.501+0000 7f04eb400640 1 -- 172.21.15.106:0/1836888520 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f0056f20 con 0x559ca3ed44b0 2024-08-17T02:28:46.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.501+0000 7f04eb400640 1 -- 172.21.15.106:0/1836888520 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f005ac70 con 0x559ca3ed44b0 2024-08-17T02:28:46.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.501+0000 7f04eb400640 1 -- 172.21.15.106:0/1836888520 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f00801e0 con 0x559ca3ed44b0 2024-08-17T02:28:46.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.502+0000 7f0507bb0740 1 -- 172.21.15.106:0/1836888520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3ed44b0 msgr2=0x559ca3f241a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.502+0000 7f0507bb0740 1 --2- 172.21.15.106:0/1836888520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3ed44b0 0x559ca3f241a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f04f0053c60 tx=0x7f04f0067040 comp rx=0 tx=0).stop 2024-08-17T02:28:46.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.502+0000 7f0507bb0740 1 -- 172.21.15.106:0/1836888520 shutdown_connections 2024-08-17T02:28:46.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.502+0000 7f0507bb0740 1 --2- 172.21.15.106:0/1836888520 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559ca3f16f20 0x559ca3ec7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.502+0000 7f0507bb0740 1 --2- 172.21.15.106:0/1836888520 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559ca3ef8e40 0x559ca3f1ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.502+0000 7f0507bb0740 1 --2- 172.21.15.106:0/1836888520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3ed44b0 0x559ca3f241a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.502+0000 7f0507bb0740 1 -- 172.21.15.106:0/1836888520 >> 172.21.15.106:0/1836888520 conn(0x559ca3e68030 msgr2=0x559ca3ed3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:46.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.502+0000 7f0507bb0740 1 -- 172.21.15.106:0/1836888520 shutdown_connections 2024-08-17T02:28:46.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.502+0000 7f0507bb0740 1 -- 172.21.15.106:0/1836888520 wait complete. 2024-08-17T02:28:46.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.502+0000 7f0507bb0740 1 -- start start 2024-08-17T02:28:46.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.503+0000 7f0507bb0740 1 Processor -- start 2024-08-17T02:28:46.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.503+0000 7f0507bb0740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559ca3ed44b0 0x559ca3f7c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.503+0000 7f0507bb0740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3ef8e40 0x559ca3f829c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.504+0000 7f0507bb0740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559ca3f16f20 0x559ca3f82f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.504+0000 7f0507bb0740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ca3ec4610 con 0x559ca3ef8e40 2024-08-17T02:28:46.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.504+0000 7f0507bb0740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ca3f7ce70 con 0x559ca3f16f20 2024-08-17T02:28:46.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.504+0000 7f0507bb0740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ca3f837c0 con 0x559ca3ed44b0 2024-08-17T02:28:46.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.504+0000 7f0507bb0740 10 client.0 _ll_register_callbacks cb 0x7f04f800a720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:28:46.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.504+0000 7f04fe000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3ef8e40 0x559ca3f829c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.504+0000 7f04fe000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3ef8e40 0x559ca3f829c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59972/0 (socket says 172.21.15.106:59972) 2024-08-17T02:28:46.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.504+0000 7f04fe000640 1 -- 172.21.15.106:0/1030249045 learned_addr learned my addr 172.21.15.106:0/1030249045 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:46.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.504+0000 7f04fea00640 1 --2- 172.21.15.106:0/1030249045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559ca3ed44b0 0x559ca3f7c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.504+0000 7f04ff400640 1 --2- 172.21.15.106:0/1030249045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559ca3f16f20 0x559ca3f82f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.504+0000 7f04fe000640 1 -- 172.21.15.106:0/1030249045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559ca3ed44b0 msgr2=0x559ca3f7c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:46.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.504+0000 7f04fe000640 1 --2- 172.21.15.106:0/1030249045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559ca3ed44b0 0x559ca3f7c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.504+0000 7f04fe000640 1 -- 172.21.15.106:0/1030249045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559ca3f16f20 msgr2=0x559ca3f82f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:46.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.504+0000 7f04fe000640 1 --2- 172.21.15.106:0/1030249045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559ca3f16f20 0x559ca3f82f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.504+0000 7f04fe000640 1 -- 172.21.15.106:0/1030249045 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f050016a9f0 con 0x559ca3ef8e40 2024-08-17T02:28:46.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.505+0000 7f04fe000640 1 --2- 172.21.15.106:0/1030249045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3ef8e40 0x559ca3f829c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f04ec006d90 tx=0x7f04ec00b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b0c194c227ef78 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:46.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.505+0000 7f04df400640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-08-17T02:28:46.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.505+0000 7f04df400640 1 -- 172.21.15.106:0/1030249045 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec049410 con 0x559ca3ef8e40 2024-08-17T02:28:46.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.505+0000 7f04df400640 1 -- 172.21.15.106:0/1030249045 <== mon.0 v2:172.21.15.106:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f04ec043040 con 0x559ca3ef8e40 2024-08-17T02:28:46.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.505+0000 7f0507bb0740 1 -- 172.21.15.106:0/1030249045 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f04f8010050 con 0x559ca3ef8e40 2024-08-17T02:28:46.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.505+0000 7f04df400640 1 -- 172.21.15.106:0/1030249045 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04ec03da60 con 0x559ca3ef8e40 2024-08-17T02:28:46.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.505+0000 7f0507bb0740 10 client.5130 fetch_fsmap learned FSMap version 17 2024-08-17T02:28:46.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.505+0000 7f0507bb0740 1 -- 172.21.15.106:0/1030249045 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x559ca3dfa1e0 con 0x559ca3ef8e40 2024-08-17T02:28:46.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.505+0000 7f04df400640 1 -- 172.21.15.106:0/1030249045 <== mon.0 v2:172.21.15.106:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f8010050 con 0x559ca3ef8e40 2024-08-17T02:28:46.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.505+0000 7f04df400640 1 -- 172.21.15.106:0/1030249045 <== mon.0 v2:172.21.15.106:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f04ec05dcc0 con 0x559ca3ef8e40 2024-08-17T02:28:46.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.505+0000 7f0507bb0740 10 client.5130 fetch_fsmap finished waiting for FSMap version 17 2024-08-17T02:28:46.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.505+0000 7f0507bb0740 10 client.5130 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-17T02:28:46.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.505+0000 7f0507bb0740 20 client.5130 populate_metadata read hostname 'smithi106' 2024-08-17T02:28:46.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.505+0000 7f0507bb0740 1 --2- 172.21.15.106:0/1030249045 >> [v2:172.21.15.171:6832/754665763,v1:172.21.15.171:6834/754665763] conn(0x559ca3f13440 0x559ca3f13810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.505+0000 7f0507bb0740 4 client.5130 mds_command: new command op to 4959 tid=0[{"prefix": "status"}] 2024-08-17T02:28:46.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.505+0000 7f0507bb0740 1 -- 172.21.15.106:0/1030249045 --> [v2:172.21.15.171:6832/754665763,v1:172.21.15.171:6834/754665763] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559ca3b456c0 con 0x559ca3f13440 2024-08-17T02:28:46.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.506+0000 7f04fea00640 1 --2- 172.21.15.106:0/1030249045 >> [v2:172.21.15.171:6832/754665763,v1:172.21.15.171:6834/754665763] conn(0x559ca3f13440 0x559ca3f13810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.506+0000 7f04fea00640 1 --2- 172.21.15.106:0/1030249045 >> [v2:172.21.15.171:6832/754665763,v1:172.21.15.171:6834/754665763] conn(0x559ca3f13440 0x559ca3f13810 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48e00958358c0cc9 server_cookie=d039a88331e924f1 in_seq=0 out_seq=0 2024-08-17T02:28:46.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.506+0000 7f04df400640 10 client.5130 ms_handle_connect on v2:172.21.15.171:6832/754665763 2024-08-17T02:28:46.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.507+0000 7f04df400640 1 -- 172.21.15.106:0/1030249045 <== mds.0 v2:172.21.15.171:6832/754665763 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x559ca3b456c0 con 0x559ca3f13440 2024-08-17T02:28:46.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.507+0000 7f04df400640 10 client.5130 handle_command_reply: tid=0 2024-08-17T02:28:46.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.507+0000 7f0507bb0740 1 client.5130 shutdown 2024-08-17T02:28:46.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.507+0000 7f0507bb0740 1 -- 172.21.15.106:0/1030249045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3ef8e40 msgr2=0x559ca3f829c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.507+0000 7f0507bb0740 1 --2- 172.21.15.106:0/1030249045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3ef8e40 0x559ca3f829c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f04ec006d90 tx=0x7f04ec00b050 comp rx=0 tx=0).stop 2024-08-17T02:28:46.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.507+0000 7f0507bb0740 1 -- 172.21.15.106:0/1030249045 shutdown_connections 2024-08-17T02:28:46.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.507+0000 7f0507bb0740 1 --2- 172.21.15.106:0/1030249045 >> [v2:172.21.15.171:6832/754665763,v1:172.21.15.171:6834/754665763] conn(0x559ca3f13440 0x559ca3f13810 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.507+0000 7f0507bb0740 1 --2- 172.21.15.106:0/1030249045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559ca3f16f20 0x559ca3f82f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.507+0000 7f0507bb0740 1 --2- 172.21.15.106:0/1030249045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ca3ef8e40 0x559ca3f829c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.507+0000 7f0507bb0740 1 --2- 172.21.15.106:0/1030249045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x559ca3ed44b0 0x559ca3f7c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.507+0000 7f0507bb0740 1 -- 172.21.15.106:0/1030249045 >> 172.21.15.106:0/1030249045 conn(0x559ca3e68030 msgr2=0x559ca3efe790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:46.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.507+0000 7f04df400640 0 client.5130 ms_handle_reset on v2:172.21.15.171:6832/754665763 2024-08-17T02:28:46.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.507+0000 7f0507bb0740 1 -- 172.21.15.106:0/1030249045 shutdown_connections 2024-08-17T02:28:46.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.507+0000 7f0507bb0740 1 -- 172.21.15.106:0/1030249045 wait complete. 2024-08-17T02:28:46.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.507+0000 7f0507bb0740 20 client.5130 trim_cache size 0 max 16384 2024-08-17T02:28:46.512 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-08-17T02:28:46.512 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_fsid": "2c52f2d2-3c39-4be0-9e1a-50df01bd49c4", 2024-08-17T02:28:46.512 INFO:teuthology.orchestra.run.smithi106.stdout: "whoami": 0, 2024-08-17T02:28:46.512 INFO:teuthology.orchestra.run.smithi106.stdout: "id": 4959, 2024-08-17T02:28:46.512 INFO:teuthology.orchestra.run.smithi106.stdout: "want_state": "up:active", 2024-08-17T02:28:46.513 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "up:active", 2024-08-17T02:28:46.513 INFO:teuthology.orchestra.run.smithi106.stdout: "fs_name": "cephfs", 2024-08-17T02:28:46.513 INFO:teuthology.orchestra.run.smithi106.stdout: "rank_uptime": 5.9888825460000001, 2024-08-17T02:28:46.513 INFO:teuthology.orchestra.run.smithi106.stdout: "mdsmap_epoch": 17, 2024-08-17T02:28:46.513 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_epoch": 32, 2024-08-17T02:28:46.513 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_epoch_barrier": 32, 2024-08-17T02:28:46.513 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 13.823507656 2024-08-17T02:28:46.513 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-08-17T02:28:46.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.508+0000 7f0505600640 1 -- 172.21.15.106:0/3372196397 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f04e0065180 msgr2=0x7f04e0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.508+0000 7f0505600640 1 --2- 172.21.15.106:0/3372196397 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f04e0065180 0x7f04e0067630 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f04ec034000 tx=0x7f04ec032000 comp rx=0 tx=0).stop 2024-08-17T02:28:46.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.508+0000 7f0505600640 1 -- 172.21.15.106:0/3372196397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f050006e080 msgr2=0x7f05000ac080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.508+0000 7f0505600640 1 --2- 172.21.15.106:0/3372196397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f050006e080 0x7f05000ac080 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f04f00011e0 tx=0x7f04f0007d50 comp rx=0 tx=0).stop 2024-08-17T02:28:46.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.508+0000 7f0505600640 1 -- 172.21.15.106:0/3372196397 shutdown_connections 2024-08-17T02:28:46.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.508+0000 7f0505600640 1 --2- 172.21.15.106:0/3372196397 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0500155550 0x7f05000aa1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.508+0000 7f0505600640 1 --2- 172.21.15.106:0/3372196397 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0500155180 0x7f0500169c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.508+0000 7f0505600640 1 --2- 172.21.15.106:0/3372196397 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f04e0065180 0x7f04e0067630 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.508+0000 7f0505600640 1 --2- 172.21.15.106:0/3372196397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f050006e080 0x7f05000ac080 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.508+0000 7f0505600640 1 -- 172.21.15.106:0/3372196397 >> 172.21.15.106:0/3372196397 conn(0x7f05000cb9b0 msgr2=0x7f05001519b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:46.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.508+0000 7f0505600640 1 -- 172.21.15.106:0/3372196397 shutdown_connections 2024-08-17T02:28:46.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.508+0000 7f0505600640 1 -- 172.21.15.106:0/3372196397 wait complete. 2024-08-17T02:28:46.523 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:28:46.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.670+0000 7f1fd1800640 1 Processor -- start 2024-08-17T02:28:46.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.671+0000 7f1fd1800640 1 -- start start 2024-08-17T02:28:46.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.672+0000 7f1fd1800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1fcc159c40 0x7f1fcc0c8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.672+0000 7f1fd1800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fcc0ae6b0 con 0x7f1fcc0ada20 2024-08-17T02:28:46.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.672+0000 7f1fd1800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fcc0af230 con 0x7f1fcc0addf0 2024-08-17T02:28:46.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.672+0000 7f1fd1800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fcc0ae1e0 con 0x7f1fcc159c40 2024-08-17T02:28:46.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.672+0000 7f1fcbe00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1fcc0ada20 0x7f1fcc0cae60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:52060/0 (socket says 172.21.15.106:52060) 2024-08-17T02:28:46.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.672+0000 7f1fcbe00640 1 -- 172.21.15.106:0/1156035285 learned_addr learned my addr 172.21.15.106:0/1156035285 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:46.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.672+0000 7f1fc3400640 1 --2- 172.21.15.106:0/1156035285 >> v2:172.21.15.171:3300/0 conn(0x7f1fcc159c40 0x7f1fcc0c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.672+0000 7f1fcb400640 1 -- 172.21.15.106:0/1156035285 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360498973 0 0) 0x7f1fcc0ae6b0 con 0x7f1fcc0ada20 2024-08-17T02:28:46.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.673+0000 7f1fcb400640 1 -- 172.21.15.106:0/1156035285 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fb00034e0 con 0x7f1fcc0ada20 2024-08-17T02:28:46.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.673+0000 7f1fcb400640 1 -- 172.21.15.106:0/1156035285 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1376021833 0 0) 0x7f1fb00034e0 con 0x7f1fcc0ada20 2024-08-17T02:28:46.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.673+0000 7f1fcb400640 1 -- 172.21.15.106:0/1156035285 >> v2:172.21.15.171:3300/0 conn(0x7f1fcc159c40 msgr2=0x7f1fcc0c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:46.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.673+0000 7f1fcb400640 1 --2- 172.21.15.106:0/1156035285 >> v2:172.21.15.171:3300/0 conn(0x7f1fcc159c40 0x7f1fcc0c8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.673+0000 7f1fcb400640 1 -- 172.21.15.106:0/1156035285 >> v1:172.21.15.171:6789/0 conn(0x7f1fcc0addf0 legacy=0x7f1fcc154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.673+0000 7f1fcb400640 1 -- 172.21.15.106:0/1156035285 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fcc0ae900 con 0x7f1fcc0ada20 2024-08-17T02:28:46.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.673+0000 7f1fcb400640 1 -- 172.21.15.106:0/1156035285 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7f1fbc001470 con 0x7f1fcc0ada20 2024-08-17T02:28:46.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.673+0000 7f1fcb400640 1 -- 172.21.15.106:0/1156035285 >> v1:172.21.15.106:6789/0 conn(0x7f1fcc0ada20 legacy=0x7f1fcc0cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.673+0000 7f1fcb400640 1 --2- 172.21.15.106:0/1156035285 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fb0003a20 0x7f1fb0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.673+0000 7f1fcb400640 1 --2- 172.21.15.106:0/1156035285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fb0004780 0x7f1fb0004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.673+0000 7f1fcb400640 1 --2- 172.21.15.106:0/1156035285 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fb0005180 0x7f1fb000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.673+0000 7f1fcb400640 1 -- 172.21.15.106:0/1156035285 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb000c0a0 con 0x7f1fb0003a20 2024-08-17T02:28:46.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.673+0000 7f1fcb400640 1 -- 172.21.15.106:0/1156035285 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb000c1e0 con 0x7f1fb0004780 2024-08-17T02:28:46.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.673+0000 7f1fcb400640 1 -- 172.21.15.106:0/1156035285 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb000c3a0 con 0x7f1fb0005180 2024-08-17T02:28:46.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.673+0000 7f1fcbe00640 1 --2- 172.21.15.106:0/1156035285 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fb0003a20 0x7f1fb0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.673+0000 7f1fc3400640 1 --2- 172.21.15.106:0/1156035285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fb0004780 0x7f1fb0004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.673+0000 7f1fd0e00640 1 --2- 172.21.15.106:0/1156035285 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fb0005180 0x7f1fb000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.674+0000 7f1fcbe00640 1 -- 172.21.15.106:0/1156035285 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fb0005180 msgr2=0x7f1fb000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:46.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.674+0000 7f1fcbe00640 1 --2- 172.21.15.106:0/1156035285 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fb0005180 0x7f1fb000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.674+0000 7f1fcbe00640 1 -- 172.21.15.106:0/1156035285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fb0004780 msgr2=0x7f1fb0004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:46.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.674+0000 7f1fcbe00640 1 --2- 172.21.15.106:0/1156035285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fb0004780 0x7f1fb0004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.674+0000 7f1fcbe00640 1 -- 172.21.15.106:0/1156035285 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb00034e0 con 0x7f1fb0003a20 2024-08-17T02:28:46.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.674+0000 7f1fd0e00640 1 -- 172.21.15.106:0/1156035285 reap_dead start 2024-08-17T02:28:46.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.675+0000 7f1fcbe00640 1 --2- 172.21.15.106:0/1156035285 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fb0003a20 0x7f1fb0003e30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc00c190 tx=0x7f1fbc001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a008590507f9fbca server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:46.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.675+0000 7f1fcb400640 1 -- 172.21.15.106:0/1156035285 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc005890 con 0x7f1fb0003a20 2024-08-17T02:28:46.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.675+0000 7f1fcb400640 1 -- 172.21.15.106:0/1156035285 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fbc02d070 con 0x7f1fb0003a20 2024-08-17T02:28:46.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.675+0000 7f1fcb400640 1 -- 172.21.15.106:0/1156035285 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc005a50 con 0x7f1fb0003a20 2024-08-17T02:28:46.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.675+0000 7f1fd1800640 1 -- 172.21.15.106:0/1156035285 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fb0003a20 msgr2=0x7f1fb0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.675+0000 7f1fd1800640 1 --2- 172.21.15.106:0/1156035285 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fb0003a20 0x7f1fb0003e30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc00c190 tx=0x7f1fbc001d80 comp rx=0 tx=0).stop 2024-08-17T02:28:46.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.675+0000 7f1fd1800640 1 -- 172.21.15.106:0/1156035285 shutdown_connections 2024-08-17T02:28:46.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.675+0000 7f1fd1800640 1 --2- 172.21.15.106:0/1156035285 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fb0003a20 0x7f1fb0003e30 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.675+0000 7f1fd1800640 1 -- 172.21.15.106:0/1156035285 >> 172.21.15.106:0/1156035285 conn(0x7f1fcc067750 msgr2=0x7f1fcc0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:46.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.676+0000 7f1fd1800640 1 -- 172.21.15.106:0/1156035285 shutdown_connections 2024-08-17T02:28:46.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.676+0000 7f1fd1800640 1 -- 172.21.15.106:0/1156035285 wait complete. 2024-08-17T02:28:46.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.677+0000 7f1fd1800640 1 Processor -- start 2024-08-17T02:28:46.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.677+0000 7f1fd1800640 1 -- start start 2024-08-17T02:28:46.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.678+0000 7f1fd1800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fb0003a20 0x7f1fcc158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.678+0000 7f1fd1800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fcc1450e0 0x7f1fcc147f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.678+0000 7f1fd1800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fcc148450 0x7f1fcc13f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.678+0000 7f1fd1800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc1443b0 con 0x7f1fcc1450e0 2024-08-17T02:28:46.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.678+0000 7f1fd1800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc144c50 con 0x7f1fb0003a20 2024-08-17T02:28:46.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.678+0000 7f1fd1800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc158090 con 0x7f1fcc148450 2024-08-17T02:28:46.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.678+0000 7f1fc3400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fcc1450e0 0x7f1fcc147f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.678+0000 7f1fc3400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fcc1450e0 0x7f1fcc147f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59998/0 (socket says 172.21.15.106:59998) 2024-08-17T02:28:46.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.678+0000 7f1fc3400640 1 -- 172.21.15.106:0/2467310855 learned_addr learned my addr 172.21.15.106:0/2467310855 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:46.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.678+0000 7f1fcbe00640 1 --2- 172.21.15.106:0/2467310855 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fb0003a20 0x7f1fcc158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.678+0000 7f1fd0e00640 1 --2- 172.21.15.106:0/2467310855 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fcc148450 0x7f1fcc13f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.679+0000 7f1fc3400640 1 -- 172.21.15.106:0/2467310855 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fcc148450 msgr2=0x7f1fcc13f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.679+0000 7f1fc3400640 1 --2- 172.21.15.106:0/2467310855 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fcc148450 0x7f1fcc13f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.679+0000 7f1fc3400640 1 -- 172.21.15.106:0/2467310855 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fb0003a20 msgr2=0x7f1fcc158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.679+0000 7f1fc3400640 1 --2- 172.21.15.106:0/2467310855 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fb0003a20 0x7f1fcc158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.679+0000 7f1fc3400640 1 -- 172.21.15.106:0/2467310855 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fcc144600 con 0x7f1fcc1450e0 2024-08-17T02:28:46.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.679+0000 7f1fc3400640 1 --2- 172.21.15.106:0/2467310855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fcc1450e0 0x7f1fcc147f10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1fb40119b0 tx=0x7f1fb40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:46.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.679+0000 7f1fc3e00640 1 -- 172.21.15.106:0/2467310855 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4013680 con 0x7f1fcc1450e0 2024-08-17T02:28:46.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.679+0000 7f1fc3e00640 1 -- 172.21.15.106:0/2467310855 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb40137e0 con 0x7f1fcc1450e0 2024-08-17T02:28:46.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.679+0000 7f1fd1800640 1 -- 172.21.15.106:0/2467310855 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fcc1448e0 con 0x7f1fcc1450e0 2024-08-17T02:28:46.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.679+0000 7f1fc3e00640 1 -- 172.21.15.106:0/2467310855 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4013ba0 con 0x7f1fcc1450e0 2024-08-17T02:28:46.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.679+0000 7f1fd1800640 1 -- 172.21.15.106:0/2467310855 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fcc157ad0 con 0x7f1fcc1450e0 2024-08-17T02:28:46.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.680+0000 7f1fd1800640 1 -- 172.21.15.106:0/2467310855 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fcc144de0 con 0x7f1fcc1450e0 2024-08-17T02:28:46.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.681+0000 7f1fc3e00640 1 -- 172.21.15.106:0/2467310855 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1fb4014440 con 0x7f1fcc1450e0 2024-08-17T02:28:46.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.682+0000 7f1fc3e00640 1 --2- 172.21.15.106:0/2467310855 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1fa8065180 0x7f1fa8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.682+0000 7f1fc3e00640 1 -- 172.21.15.106:0/2467310855 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1fb4018030 con 0x7f1fcc1450e0 2024-08-17T02:28:46.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.682+0000 7f1fcbe00640 1 --2- 172.21.15.106:0/2467310855 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1fa8065180 0x7f1fa8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.683+0000 7f1fcbe00640 1 --2- 172.21.15.106:0/2467310855 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1fa8065180 0x7f1fa8067630 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc032000 tx=0x7f1fbc033000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:46.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.686+0000 7f1fc3e00640 1 -- 172.21.15.106:0/2467310855 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1fb40509f0 con 0x7f1fcc1450e0 2024-08-17T02:28:46.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.893+0000 7f1fd1800640 1 -- 172.21.15.106:0/2467310855 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1fcc071050 con 0x7f1fcc1450e0 2024-08-17T02:28:46.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.893+0000 7f1fc3e00640 1 -- 172.21.15.106:0/2467310855 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1fb4022070 con 0x7f1fcc1450e0 2024-08-17T02:28:46.894 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:28:46.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.895+0000 7f1fd1800640 1 -- 172.21.15.106:0/2467310855 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1fa8065180 msgr2=0x7f1fa8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.895+0000 7f1fd1800640 1 --2- 172.21.15.106:0/2467310855 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1fa8065180 0x7f1fa8067630 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc032000 tx=0x7f1fbc033000 comp rx=0 tx=0).stop 2024-08-17T02:28:46.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.895+0000 7f1fd1800640 1 -- 172.21.15.106:0/2467310855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fcc1450e0 msgr2=0x7f1fcc147f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.895+0000 7f1fd1800640 1 --2- 172.21.15.106:0/2467310855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fcc1450e0 0x7f1fcc147f10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1fb40119b0 tx=0x7f1fb40090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.895+0000 7f1fd1800640 1 -- 172.21.15.106:0/2467310855 shutdown_connections 2024-08-17T02:28:46.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.895+0000 7f1fd1800640 1 --2- 172.21.15.106:0/2467310855 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fcc148450 0x7f1fcc13f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.895+0000 7f1fd1800640 1 --2- 172.21.15.106:0/2467310855 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1fa8065180 0x7f1fa8067630 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.895+0000 7f1fd1800640 1 --2- 172.21.15.106:0/2467310855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fcc1450e0 0x7f1fcc147f10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.895+0000 7f1fd1800640 1 --2- 172.21.15.106:0/2467310855 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fb0003a20 0x7f1fcc158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.895+0000 7f1fd1800640 1 -- 172.21.15.106:0/2467310855 >> 172.21.15.106:0/2467310855 conn(0x7f1fcc067750 msgr2=0x7f1fcc0ab870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:46.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.895+0000 7f1fd1800640 1 -- 172.21.15.106:0/2467310855 shutdown_connections 2024-08-17T02:28:46.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:46.895+0000 7f1fd1800640 1 -- 172.21.15.106:0/2467310855 wait complete. 2024-08-17T02:28:46.911 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:28:46.911 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:28:46.911 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi106.front.sepia.ceph.com 2024-08-17T02:28:46.911 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:28:46.911 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:28:46.911 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:28:46.911 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:28:46.911 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:28:46.911 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:28:46.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:46.912 DEBUG:teuthology.orchestra.run.smithi106:> ip addr 2024-08-17T02:28:46.947 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:28:46.947 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:28:46.947 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:28:46.947 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:46.947 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2024-08-17T02:28:46.947 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:46.947 INFO:teuthology.orchestra.run.smithi106.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:46.947 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2a brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:46.947 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f0 2024-08-17T02:28:46.948 INFO:teuthology.orchestra.run.smithi106.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:46.948 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:46.948 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f1 2024-08-17T02:28:46.948 INFO:teuthology.orchestra.run.smithi106.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:46.948 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6c brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:46.948 INFO:teuthology.orchestra.run.smithi106.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:28:46.948 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6d brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:46.948 INFO:teuthology.orchestra.run.smithi106.stdout: inet 172.21.15.106/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:28:46.948 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft 42520sec preferred_lft 42520sec 2024-08-17T02:28:46.948 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::ec4:7aff:fe8f:ce6d/64 scope link 2024-08-17T02:28:46.948 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:46.948 INFO:teuthology.orchestra.run.smithi106.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:28:46.948 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 3e:82:b8:2f:59:d8 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:46.948 INFO:teuthology.orchestra.run.smithi106.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:28:46.948 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:46.949 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::a874:9aff:fe78:df5c/64 scope link 2024-08-17T02:28:46.949 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:46.949 INFO:teuthology.orchestra.run.smithi106.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:28:46.949 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 8a:95:df:fe:35:fc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:28:46.949 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::8895:dfff:fefe:35fc/64 scope link 2024-08-17T02:28:46.949 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:46.949 INFO:teuthology.orchestra.run.smithi106.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:28:46.949 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 3e:82:b8:2f:59:d8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:28:46.949 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::3c82:b8ff:fe2f:59d8/64 scope link 2024-08-17T02:28:46.949 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:46.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:46.951 DEBUG:teuthology.orchestra.run.smithi106:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:28:47.044 INFO:teuthology.orchestra.run.smithi106.stdout:1 2024-08-17T02:28:47.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:47.047 DEBUG:teuthology.orchestra.run.smithi106:> route 2024-08-17T02:28:47.083 INFO:teuthology.orchestra.run.smithi106.stdout:Kernel IP routing table 2024-08-17T02:28:47.083 INFO:teuthology.orchestra.run.smithi106.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:28:47.083 INFO:teuthology.orchestra.run.smithi106.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:28:47.083 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:28:47.083 INFO:teuthology.orchestra.run.smithi106.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:28:47.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:47.083 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-08-17T02:28:47.083 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-08-17T02:28:47.084 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:28:47.084 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:28:47.084 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:28:47.084 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-08-17T02:28:47.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:47.229 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-08-17T02:28:47.264 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:28:47.264 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:28:47.264 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:28:47.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:47.264 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set brx.0 up 2024-08-17T02:28:47.360 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:47.360 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:28:47.395 INFO:teuthology.orchestra.run.smithi106.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:28:47.395 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:47.395 DEBUG:teuthology.orchestra.run.smithi106:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:28:47.469 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:28:47.469 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:28:47.470 DEBUG:teuthology.orchestra.run.smithi106:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:47.592 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:47.592 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:28:47.619 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:47.620 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:28:47.620 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-08-17T02:28:47.620 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: trying mount with new device syntax: 0@2c52f2d2-3c39-4be0-9e1a-50df01bd49c4.cephfs=/ 2024-08-17T02:28:47.620 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.106:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-08-17T02:28:47.621 INFO:teuthology.orchestra.run.smithi106.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:28:47.621 INFO:teuthology.orchestra.run.smithi106.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:28:47.621 INFO:teuthology.orchestra.run.smithi106.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:28:47.621 INFO:teuthology.orchestra.run.smithi106.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:28:47.621 INFO:teuthology.orchestra.run.smithi106.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:28:47.624 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:28:47.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:47.624 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:28:47.681 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:28:47.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.829+0000 7f2cdae00640 1 Processor -- start 2024-08-17T02:28:47.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.829+0000 7f2cdae00640 1 -- start start 2024-08-17T02:28:47.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.830+0000 7f2cdae00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2cd4159ca0 0x7f2cd40ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:47.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.830+0000 7f2cdae00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2cd40ca8a0 0x7f2cd40cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:47.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.830+0000 7f2cdae00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2cd40ccad0 0x7f2cd40cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:47.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.830+0000 7f2cdae00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd40cd6e0 con 0x7f2cd40ca8a0 2024-08-17T02:28:47.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.830+0000 7f2cdae00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd40ccf70 con 0x7f2cd40ccad0 2024-08-17T02:28:47.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.830+0000 7f2cdae00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd40cadc0 con 0x7f2cd4159ca0 2024-08-17T02:28:47.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.830+0000 7f2cd9000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2cd40ca8a0 0x7f2cd40cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:47.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.830+0000 7f2cd9000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2cd40ca8a0 0x7f2cd40cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60004/0 (socket says 172.21.15.106:60004) 2024-08-17T02:28:47.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.830+0000 7f2cd9000640 1 -- 172.21.15.106:0/2333108178 learned_addr learned my addr 172.21.15.106:0/2333108178 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:47.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.831+0000 7f2cd9a00640 1 --2- 172.21.15.106:0/2333108178 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2cd4159ca0 0x7f2cd40ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:47.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.831+0000 7f2cda400640 1 --2- 172.21.15.106:0/2333108178 >> v2:172.21.15.171:3300/0 conn(0x7f2cd40ccad0 0x7f2cd40cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:47.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.831+0000 7f2cd9000640 1 -- 172.21.15.106:0/2333108178 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2cd4159ca0 msgr2=0x7f2cd40ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:47.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.831+0000 7f2cd9000640 1 --2- 172.21.15.106:0/2333108178 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2cd4159ca0 0x7f2cd40ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.831+0000 7f2cd9000640 1 -- 172.21.15.106:0/2333108178 >> v2:172.21.15.171:3300/0 conn(0x7f2cd40ccad0 msgr2=0x7f2cd40cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:47.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.831+0000 7f2cd9000640 1 --2- 172.21.15.106:0/2333108178 >> v2:172.21.15.171:3300/0 conn(0x7f2cd40ccad0 0x7f2cd40cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.831+0000 7f2cd9000640 1 -- 172.21.15.106:0/2333108178 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd40cb060 con 0x7f2cd40ca8a0 2024-08-17T02:28:47.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.832+0000 7f2cd9000640 1 --2- 172.21.15.106:0/2333108178 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cd40ca8a0 0x7f2cd40cc590 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40b5c60 tx=0x7f2cc00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a654710bca4447a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:47.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.832+0000 7f2cd3e00640 1 -- 172.21.15.106:0/2333108178 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc002add0 con 0x7f2cd40ca8a0 2024-08-17T02:28:47.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.832+0000 7f2cd3e00640 1 -- 172.21.15.106:0/2333108178 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc0032440 con 0x7f2cd40ca8a0 2024-08-17T02:28:47.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.832+0000 7f2cd3e00640 1 -- 172.21.15.106:0/2333108178 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0032820 con 0x7f2cd40ca8a0 2024-08-17T02:28:47.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.832+0000 7f2cdae00640 1 -- 172.21.15.106:0/2333108178 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cd40ca8a0 msgr2=0x7f2cd40cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:47.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.832+0000 7f2cdae00640 1 --2- 172.21.15.106:0/2333108178 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cd40ca8a0 0x7f2cd40cc590 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40b5c60 tx=0x7f2cc00091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.833+0000 7f2cdae00640 1 -- 172.21.15.106:0/2333108178 shutdown_connections 2024-08-17T02:28:47.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.833+0000 7f2cdae00640 1 --2- 172.21.15.106:0/2333108178 >> v2:172.21.15.171:3300/0 conn(0x7f2cd40ccad0 0x7f2cd40cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.833+0000 7f2cdae00640 1 --2- 172.21.15.106:0/2333108178 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cd40ca8a0 0x7f2cd40cc590 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.833+0000 7f2cdae00640 1 --2- 172.21.15.106:0/2333108178 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2cd4159ca0 0x7f2cd40ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.833+0000 7f2cdae00640 1 -- 172.21.15.106:0/2333108178 >> 172.21.15.106:0/2333108178 conn(0x7f2cd4098e00 msgr2=0x7f2cd406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:47.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.833+0000 7f2cdae00640 1 -- 172.21.15.106:0/2333108178 shutdown_connections 2024-08-17T02:28:47.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.833+0000 7f2cdae00640 1 -- 172.21.15.106:0/2333108178 wait complete. 2024-08-17T02:28:47.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.834+0000 7f2cdae00640 1 Processor -- start 2024-08-17T02:28:47.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.834+0000 7f2cdae00640 1 -- start start 2024-08-17T02:28:47.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.835+0000 7f2cdae00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2cd40ca8a0 0x7f2cd4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:47.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.835+0000 7f2cdae00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cd40ccad0 0x7f2cd4150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:47.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.835+0000 7f2cdae00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cd4159ca0 0x7f2cd4150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:47.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.835+0000 7f2cdae00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd40c8d80 con 0x7f2cd4159ca0 2024-08-17T02:28:47.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.835+0000 7f2cdae00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd4150dd0 con 0x7f2cd40ccad0 2024-08-17T02:28:47.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.835+0000 7f2cdae00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd41510b0 con 0x7f2cd40ca8a0 2024-08-17T02:28:47.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.835+0000 7f2cda400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cd4159ca0 0x7f2cd4150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:47.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.835+0000 7f2cda400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cd4159ca0 0x7f2cd4150750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60014/0 (socket says 172.21.15.106:60014) 2024-08-17T02:28:47.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.835+0000 7f2cda400640 1 -- 172.21.15.106:0/2101308153 learned_addr learned my addr 172.21.15.106:0/2101308153 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:47.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.835+0000 7f2cd9a00640 1 --2- 172.21.15.106:0/2101308153 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2cd40ca8a0 0x7f2cd4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:47.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.835+0000 7f2cd9000640 1 --2- 172.21.15.106:0/2101308153 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cd40ccad0 0x7f2cd4150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:47.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.836+0000 7f2cda400640 1 -- 172.21.15.106:0/2101308153 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2cd40ca8a0 msgr2=0x7f2cd4068760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:47.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.836+0000 7f2cda400640 1 --2- 172.21.15.106:0/2101308153 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2cd40ca8a0 0x7f2cd4068760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.836+0000 7f2cda400640 1 -- 172.21.15.106:0/2101308153 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cd40ccad0 msgr2=0x7f2cd4150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:47.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.836+0000 7f2cda400640 1 --2- 172.21.15.106:0/2101308153 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cd40ccad0 0x7f2cd4150210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.836+0000 7f2cda400640 1 -- 172.21.15.106:0/2101308153 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc0009450 con 0x7f2cd4159ca0 2024-08-17T02:28:47.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.836+0000 7f2cd9000640 1 --2- 172.21.15.106:0/2101308153 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cd40ccad0 0x7f2cd4150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:47.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.836+0000 7f2cda400640 1 --2- 172.21.15.106:0/2101308153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cd4159ca0 0x7f2cd4150750 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc009fa0 tx=0x7f2ccc009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:47.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.836+0000 7f2cd0c00640 1 -- 172.21.15.106:0/2101308153 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc00ee60 con 0x7f2cd4159ca0 2024-08-17T02:28:47.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.836+0000 7f2cd0c00640 1 -- 172.21.15.106:0/2101308153 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ccc014420 con 0x7f2cd4159ca0 2024-08-17T02:28:47.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.836+0000 7f2cd0c00640 1 -- 172.21.15.106:0/2101308153 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc0147e0 con 0x7f2cd4159ca0 2024-08-17T02:28:47.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.836+0000 7f2cdae00640 1 -- 172.21.15.106:0/2101308153 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd4151390 con 0x7f2cd4159ca0 2024-08-17T02:28:47.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.836+0000 7f2cdae00640 1 -- 172.21.15.106:0/2101308153 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd4151950 con 0x7f2cd4159ca0 2024-08-17T02:28:47.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.837+0000 7f2cdae00640 1 -- 172.21.15.106:0/2101308153 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd40691e0 con 0x7f2cd4159ca0 2024-08-17T02:28:47.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.838+0000 7f2cd0c00640 1 -- 172.21.15.106:0/2101308153 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2ccc014b50 con 0x7f2cd4159ca0 2024-08-17T02:28:47.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.839+0000 7f2cd0c00640 1 --2- 172.21.15.106:0/2101308153 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2cb4065150 0x7f2cb4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:47.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.839+0000 7f2cd0c00640 1 -- 172.21.15.106:0/2101308153 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2ccc082c90 con 0x7f2cd4159ca0 2024-08-17T02:28:47.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.840+0000 7f2cd9a00640 1 --2- 172.21.15.106:0/2101308153 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2cb4065150 0x7f2cb4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:47.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.840+0000 7f2cd9a00640 1 --2- 172.21.15.106:0/2101308153 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2cb4065150 0x7f2cb4067600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800bd40 tx=0x7f2cc8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:47.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:47.843+0000 7f2cd0c00640 1 -- 172.21.15.106:0/2101308153 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2cd40691e0 con 0x7f2cd4159ca0 2024-08-17T02:28:48.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:48.052+0000 7f2cdae00640 1 -- 172.21.15.106:0/2101308153 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2cd41566b0 con 0x7f2cd4159ca0 2024-08-17T02:28:48.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:48.052+0000 7f2cd0c00640 1 -- 172.21.15.106:0/2101308153 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2cd41566b0 con 0x7f2cd4159ca0 2024-08-17T02:28:48.053 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:28:48.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:48.054+0000 7f2cdae00640 1 -- 172.21.15.106:0/2101308153 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2cb4065150 msgr2=0x7f2cb4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:48.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:48.054+0000 7f2cdae00640 1 --2- 172.21.15.106:0/2101308153 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2cb4065150 0x7f2cb4067600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800bd40 tx=0x7f2cc8008040 comp rx=0 tx=0).stop 2024-08-17T02:28:48.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:48.054+0000 7f2cdae00640 1 -- 172.21.15.106:0/2101308153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cd4159ca0 msgr2=0x7f2cd4150750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:48.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:48.054+0000 7f2cdae00640 1 --2- 172.21.15.106:0/2101308153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cd4159ca0 0x7f2cd4150750 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc009fa0 tx=0x7f2ccc009900 comp rx=0 tx=0).stop 2024-08-17T02:28:48.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:48.054+0000 7f2cdae00640 1 -- 172.21.15.106:0/2101308153 shutdown_connections 2024-08-17T02:28:48.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:48.054+0000 7f2cdae00640 1 --2- 172.21.15.106:0/2101308153 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2cb4065150 0x7f2cb4067600 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:48.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:48.054+0000 7f2cdae00640 1 --2- 172.21.15.106:0/2101308153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cd4159ca0 0x7f2cd4150750 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:48.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:48.054+0000 7f2cdae00640 1 --2- 172.21.15.106:0/2101308153 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2cd40ccad0 0x7f2cd4150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:48.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:48.054+0000 7f2cdae00640 1 --2- 172.21.15.106:0/2101308153 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2cd40ca8a0 0x7f2cd4068760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:48.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:48.055+0000 7f2cdae00640 1 -- 172.21.15.106:0/2101308153 >> 172.21.15.106:0/2101308153 conn(0x7f2cd4098e00 msgr2=0x7f2cd4158540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:48.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:48.055+0000 7f2cdae00640 1 -- 172.21.15.106:0/2101308153 shutdown_connections 2024-08-17T02:28:48.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:48.055+0000 7f2cdae00640 1 -- 172.21.15.106:0/2101308153 wait complete. 2024-08-17T02:28:48.070 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:28:48.070 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:28:48.070 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2024-08-17T02:28:48.070 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:28:48.070 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:48.070 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:28:48.070 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:28:48.070 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:28:48.071 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:28:48.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:48.071 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2024-08-17T02:28:48.111 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:28:48.111 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:28:48.111 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:28:48.111 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:48.111 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2024-08-17T02:28:48.111 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:48.111 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:48.111 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:48.112 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2024-08-17T02:28:48.112 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:48.112 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:48.112 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2024-08-17T02:28:48.112 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:28:48.112 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:48.112 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:28:48.112 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:48.112 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:28:48.112 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42591sec preferred_lft 42591sec 2024-08-17T02:28:48.112 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link 2024-08-17T02:28:48.112 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:48.112 INFO:teuthology.orchestra.run.smithi171.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:28:48.112 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 9e:a0:8d:1b:5d:53 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:28:48.112 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:28:48.113 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:48.113 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::44f0:85ff:fef1:f4b/64 scope link 2024-08-17T02:28:48.113 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:48.113 INFO:teuthology.orchestra.run.smithi171.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:28:48.113 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether e6:a4:13:42:80:60 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:28:48.113 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::e4a4:13ff:fe42:8060/64 scope link 2024-08-17T02:28:48.113 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:48.113 INFO:teuthology.orchestra.run.smithi171.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:28:48.113 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 9e:a0:8d:1b:5d:53 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:28:48.113 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::9ca0:8dff:fe1b:5d53/64 scope link 2024-08-17T02:28:48.113 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:28:48.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:48.114 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:28:48.212 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-08-17T02:28:48.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:48.215 DEBUG:teuthology.orchestra.run.smithi171:> route 2024-08-17T02:28:48.252 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2024-08-17T02:28:48.252 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:28:48.252 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:28:48.252 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:28:48.252 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:28:48.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:48.253 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec bash -c ' 2024-08-17T02:28:48.253 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2024-08-17T02:28:48.253 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:28:48.253 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:28:48.253 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:28:48.253 DEBUG:teuthology.orchestra.run.smithi171:> ') 2024-08-17T02:28:48.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:48.399 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-08-17T02:28:48.433 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:28:48.433 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:28:48.434 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:28:48.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:48.434 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.0 up 2024-08-17T02:28:48.531 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:48.531 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:48.567 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:28:48.567 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:28:48.567 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:48.642 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:28:48.642 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:28:48.642 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:48.764 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:48.764 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:28:48.790 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:28:48.791 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:28:48.791 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.171:3300,172.21.15.171:3301" 2024-08-17T02:28:48.791 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with new device syntax: 1@2c52f2d2-3c39-4be0-9e1a-50df01bd49c4.cephfs=/ 2024-08-17T02:28:48.791 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.106:3300/172.21.15.171:3300/172.21.15.171:3301" will pass to kernel 2024-08-17T02:28:48.792 INFO:teuthology.orchestra.run.smithi171.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:28:48.792 INFO:teuthology.orchestra.run.smithi171.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:28:48.792 INFO:teuthology.orchestra.run.smithi171.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:28:48.792 INFO:teuthology.orchestra.run.smithi171.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:28:48.792 INFO:teuthology.orchestra.run.smithi171.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:28:48.795 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:28:48.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:48.796 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:48.851 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-08-17T02:28:49.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.006+0000 7fc770a00640 1 Processor -- start 2024-08-17T02:28:49.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.006+0000 7fc770a00640 1 -- start start 2024-08-17T02:28:49.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.007+0000 7fc770a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc76c0b2bb0 0x7fc76c0b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:49.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.007+0000 7fc770a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc76c15c4b0 0x7fc76c0aac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:49.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.007+0000 7fc770a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc76c0d0a80 con 0x7fc76c0b5740 2024-08-17T02:28:49.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.007+0000 7fc770a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc76c0b2130 con 0x7fc76c15c4b0 2024-08-17T02:28:49.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.007+0000 7fc770a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c0b23f0 con 0x7fc76c0b2bb0 2024-08-17T02:28:49.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.008+0000 7fc761e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc76c0b5740 0x7fc76c15bda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:52076/0 (socket says 172.21.15.106:52076) 2024-08-17T02:28:49.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.008+0000 7fc761e00640 1 -- 172.21.15.106:0/1297632803 learned_addr learned my addr 172.21.15.106:0/1297632803 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:49.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.008+0000 7fc76b200640 1 --2- 172.21.15.106:0/1297632803 >> v2:172.21.15.171:3300/0 conn(0x7fc76c15c4b0 0x7fc76c0aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:49.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.008+0000 7fc76a800640 1 --2- 172.21.15.106:0/1297632803 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc76c0b2bb0 0x7fc76c0b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:49.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.008+0000 7fc769e00640 1 -- 172.21.15.106:0/1297632803 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3572095115 0 0) 0x7fc76c0d0a80 con 0x7fc76c0b5740 2024-08-17T02:28:49.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.008+0000 7fc769e00640 1 -- 172.21.15.106:0/1297632803 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7500034e0 con 0x7fc76c0b5740 2024-08-17T02:28:49.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.008+0000 7fc76a800640 1 -- 172.21.15.106:0/1297632803 >> v2:172.21.15.171:3300/0 conn(0x7fc76c15c4b0 msgr2=0x7fc76c0aac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:49.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.008+0000 7fc76a800640 1 --2- 172.21.15.106:0/1297632803 >> v2:172.21.15.171:3300/0 conn(0x7fc76c15c4b0 0x7fc76c0aac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:49.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.008+0000 7fc76a800640 1 -- 172.21.15.106:0/1297632803 >> v1:172.21.15.106:6789/0 conn(0x7fc76c0b5740 legacy=0x7fc76c15bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:49.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.008+0000 7fc769e00640 1 -- 172.21.15.106:0/1297632803 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4124157265 0 0) 0x7fc7500034e0 con 0x7fc76c0b5740 2024-08-17T02:28:49.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.008+0000 7fc76a800640 1 -- 172.21.15.106:0/1297632803 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c0b37a0 con 0x7fc76c0b2bb0 2024-08-17T02:28:49.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.008+0000 7fc76b200640 1 --2- 172.21.15.106:0/1297632803 >> v2:172.21.15.171:3300/0 conn(0x7fc76c15c4b0 0x7fc76c0aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:49.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.009+0000 7fc76a800640 1 --2- 172.21.15.106:0/1297632803 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc76c0b2bb0 0x7fc76c0b2f80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc75c009850 tx=0x7fc75c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be6f8beb20dac51b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:49.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.010+0000 7fc769e00640 1 -- 172.21.15.106:0/1297632803 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc754001470 con 0x7fc76c0b2bb0 2024-08-17T02:28:49.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.010+0000 7fc769e00640 1 -- 172.21.15.106:0/1297632803 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75c02aae0 con 0x7fc76c0b2bb0 2024-08-17T02:28:49.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.010+0000 7fc769e00640 1 -- 172.21.15.106:0/1297632803 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c02ae60 con 0x7fc76c0b2bb0 2024-08-17T02:28:49.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.011+0000 7fc770a00640 1 -- 172.21.15.106:0/1297632803 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc76c0b2bb0 msgr2=0x7fc76c0b2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:49.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.011+0000 7fc770a00640 1 --2- 172.21.15.106:0/1297632803 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc76c0b2bb0 0x7fc76c0b2f80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc75c009850 tx=0x7fc75c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:49.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.011+0000 7fc770a00640 1 -- 172.21.15.106:0/1297632803 shutdown_connections 2024-08-17T02:28:49.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.011+0000 7fc770a00640 1 --2- 172.21.15.106:0/1297632803 >> v2:172.21.15.171:3300/0 conn(0x7fc76c15c4b0 0x7fc76c0aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:49.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.011+0000 7fc770a00640 1 --2- 172.21.15.106:0/1297632803 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc76c0b2bb0 0x7fc76c0b2f80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:49.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.011+0000 7fc770a00640 1 -- 172.21.15.106:0/1297632803 >> 172.21.15.106:0/1297632803 conn(0x7fc76c0cfbc0 msgr2=0x7fc76c0cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:49.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.011+0000 7fc770a00640 1 -- 172.21.15.106:0/1297632803 shutdown_connections 2024-08-17T02:28:49.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.011+0000 7fc770a00640 1 -- 172.21.15.106:0/1297632803 wait complete. 2024-08-17T02:28:49.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.012+0000 7fc770a00640 1 Processor -- start 2024-08-17T02:28:49.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.012+0000 7fc770a00640 1 -- start start 2024-08-17T02:28:49.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.013+0000 7fc770a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc76c0b2bb0 0x7fc76c1530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:49.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.013+0000 7fc770a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc76c0b5740 0x7fc76c09b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:49.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.013+0000 7fc770a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc76c15c4b0 0x7fc76c155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:49.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.013+0000 7fc770a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c09b8e0 con 0x7fc76c15c4b0 2024-08-17T02:28:49.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.013+0000 7fc770a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c09bbc0 con 0x7fc76c0b2bb0 2024-08-17T02:28:49.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.013+0000 7fc770a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c09bea0 con 0x7fc76c0b5740 2024-08-17T02:28:49.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.013+0000 7fc76b200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc76c15c4b0 0x7fc76c155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:49.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.013+0000 7fc76b200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc76c15c4b0 0x7fc76c155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60016/0 (socket says 172.21.15.106:60016) 2024-08-17T02:28:49.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.013+0000 7fc76b200640 1 -- 172.21.15.106:0/3533911672 learned_addr learned my addr 172.21.15.106:0/3533911672 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:49.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.013+0000 7fc76a800640 1 --2- 172.21.15.106:0/3533911672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc76c0b2bb0 0x7fc76c1530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:49.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.013+0000 7fc761e00640 1 --2- 172.21.15.106:0/3533911672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc76c0b5740 0x7fc76c09b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:49.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.014+0000 7fc76b200640 1 -- 172.21.15.106:0/3533911672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc76c0b5740 msgr2=0x7fc76c09b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:49.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.014+0000 7fc76b200640 1 --2- 172.21.15.106:0/3533911672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc76c0b5740 0x7fc76c09b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:49.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.014+0000 7fc76b200640 1 -- 172.21.15.106:0/3533911672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc76c0b2bb0 msgr2=0x7fc76c1530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:49.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.014+0000 7fc76b200640 1 --2- 172.21.15.106:0/3533911672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc76c0b2bb0 0x7fc76c1530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:49.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.014+0000 7fc76b200640 1 -- 172.21.15.106:0/3533911672 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc764009a20 con 0x7fc76c15c4b0 2024-08-17T02:28:49.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.014+0000 7fc76a800640 1 --2- 172.21.15.106:0/3533911672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc76c0b2bb0 0x7fc76c1530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:49.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.014+0000 7fc76b200640 1 --2- 172.21.15.106:0/3533911672 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc76c15c4b0 0x7fc76c155dd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc764009f20 tx=0x7fc76400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:49.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.014+0000 7fc762a00640 1 -- 172.21.15.106:0/3533911672 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76400ce10 con 0x7fc76c15c4b0 2024-08-17T02:28:49.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.014+0000 7fc762a00640 1 -- 172.21.15.106:0/3533911672 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76400f040 con 0x7fc76c15c4b0 2024-08-17T02:28:49.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.014+0000 7fc762a00640 1 -- 172.21.15.106:0/3533911672 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7640146d0 con 0x7fc76c15c4b0 2024-08-17T02:28:49.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.014+0000 7fc770a00640 1 -- 172.21.15.106:0/3533911672 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc75c009390 con 0x7fc76c15c4b0 2024-08-17T02:28:49.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.015+0000 7fc770a00640 1 -- 172.21.15.106:0/3533911672 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc76c09c460 con 0x7fc76c15c4b0 2024-08-17T02:28:49.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.016+0000 7fc770a00640 1 -- 172.21.15.106:0/3533911672 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc76c071050 con 0x7fc76c15c4b0 2024-08-17T02:28:49.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.016+0000 7fc762a00640 1 -- 172.21.15.106:0/3533911672 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc764003020 con 0x7fc76c15c4b0 2024-08-17T02:28:49.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.017+0000 7fc762a00640 1 --2- 172.21.15.106:0/3533911672 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc748065150 0x7fc748067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:49.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.017+0000 7fc762a00640 1 -- 172.21.15.106:0/3533911672 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc764082e70 con 0x7fc76c15c4b0 2024-08-17T02:28:49.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.017+0000 7fc76a800640 1 --2- 172.21.15.106:0/3533911672 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc748065150 0x7fc748067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:49.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.018+0000 7fc76a800640 1 --2- 172.21.15.106:0/3533911672 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc748065150 0x7fc748067600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc75c034000 tx=0x7fc75c032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:49.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.021+0000 7fc762a00640 1 -- 172.21.15.106:0/3533911672 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc764050f40 con 0x7fc76c15c4b0 2024-08-17T02:28:49.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.237+0000 7fc770a00640 1 -- 172.21.15.106:0/3533911672 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc76c066ee0 con 0x7fc76c15c4b0 2024-08-17T02:28:49.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.573+0000 7fc762a00640 1 -- 172.21.15.106:0/3533911672 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 136+0+0 (secure 0 0 0) 0x7fc764054560 con 0x7fc76c15c4b0 2024-08-17T02:28:49.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.575+0000 7fc770a00640 1 -- 172.21.15.106:0/3533911672 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc748065150 msgr2=0x7fc748067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:49.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.575+0000 7fc770a00640 1 --2- 172.21.15.106:0/3533911672 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc748065150 0x7fc748067600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc75c034000 tx=0x7fc75c032000 comp rx=0 tx=0).stop 2024-08-17T02:28:49.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.575+0000 7fc770a00640 1 -- 172.21.15.106:0/3533911672 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc76c15c4b0 msgr2=0x7fc76c155dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:49.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.575+0000 7fc770a00640 1 --2- 172.21.15.106:0/3533911672 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc76c15c4b0 0x7fc76c155dd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc764009f20 tx=0x7fc76400b040 comp rx=0 tx=0).stop 2024-08-17T02:28:49.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.575+0000 7fc770a00640 1 -- 172.21.15.106:0/3533911672 shutdown_connections 2024-08-17T02:28:49.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.575+0000 7fc770a00640 1 --2- 172.21.15.106:0/3533911672 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc748065150 0x7fc748067600 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:49.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.575+0000 7fc770a00640 1 --2- 172.21.15.106:0/3533911672 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc76c15c4b0 0x7fc76c155dd0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:49.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.575+0000 7fc770a00640 1 --2- 172.21.15.106:0/3533911672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc76c0b5740 0x7fc76c09b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:49.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.575+0000 7fc770a00640 1 --2- 172.21.15.106:0/3533911672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc76c0b2bb0 0x7fc76c1530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:49.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.575+0000 7fc770a00640 1 -- 172.21.15.106:0/3533911672 >> 172.21.15.106:0/3533911672 conn(0x7fc76c0cfbc0 msgr2=0x7fc76c0b0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:49.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.575+0000 7fc770a00640 1 -- 172.21.15.106:0/3533911672 shutdown_connections 2024-08-17T02:28:49.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.575+0000 7fc770a00640 1 -- 172.21.15.106:0/3533911672 wait complete. 2024-08-17T02:28:49.590 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:28:49.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.739+0000 7f0001e00640 1 Processor -- start 2024-08-17T02:28:49.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.739+0000 7f0001e00640 1 -- start start 2024-08-17T02:28:49.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.740+0000 7f0001e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efffc155df0 0x7efffc0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:49.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.740+0000 7f0001e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efffc156670 con 0x7efffc06df00 2024-08-17T02:28:49.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.740+0000 7f0001e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efffc06e5e0 con 0x7efffc155a20 2024-08-17T02:28:49.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.740+0000 7f0001e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efffc0b0350 con 0x7efffc155df0 2024-08-17T02:28:49.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.740+0000 7efffb400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efffc155df0 0x7efffc0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:49.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.740+0000 7efffa000640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7efffc06df00 0x7efffc156b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:52088/0 (socket says 172.21.15.106:52088) 2024-08-17T02:28:49.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.740+0000 7efffb400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efffc155df0 0x7efffc0adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60032/0 (socket says 172.21.15.106:60032) 2024-08-17T02:28:49.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.740+0000 7efffa000640 1 -- 172.21.15.106:0/1888216146 learned_addr learned my addr 172.21.15.106:0/1888216146 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:49.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.741+0000 7efffb400640 1 -- 172.21.15.106:0/1888216146 >> v1:172.21.15.171:6789/0 conn(0x7efffc155a20 legacy=0x7efffc06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:49.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.741+0000 7efffb400640 1 -- 172.21.15.106:0/1888216146 >> v1:172.21.15.106:6789/0 conn(0x7efffc06df00 legacy=0x7efffc156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:49.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.741+0000 7efff9600640 1 -- 172.21.15.106:0/1888216146 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316784543 0 0) 0x7efffc156670 con 0x7efffc06df00 2024-08-17T02:28:49.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.741+0000 7efffb400640 1 -- 172.21.15.106:0/1888216146 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc06e8c0 con 0x7efffc155df0 2024-08-17T02:28:49.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.742+0000 7efffb400640 1 --2- 172.21.15.106:0/1888216146 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efffc155df0 0x7efffc0adf10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efff4009e60 tx=0x7efff4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd95916ad6a89996 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:49.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.742+0000 7efff9600640 1 -- 172.21.15.106:0/1888216146 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4033440 con 0x7efffc155df0 2024-08-17T02:28:49.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.742+0000 7efff9600640 1 -- 172.21.15.106:0/1888216146 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff402f070 con 0x7efffc155df0 2024-08-17T02:28:49.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.742+0000 7efff9600640 1 -- 172.21.15.106:0/1888216146 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff40337d0 con 0x7efffc155df0 2024-08-17T02:28:49.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.742+0000 7f0001e00640 1 -- 172.21.15.106:0/1888216146 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efffc155df0 msgr2=0x7efffc0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:49.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.742+0000 7f0001e00640 1 --2- 172.21.15.106:0/1888216146 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efffc155df0 0x7efffc0adf10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efff4009e60 tx=0x7efff4009780 comp rx=0 tx=0).stop 2024-08-17T02:28:49.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.743+0000 7f0001e00640 1 -- 172.21.15.106:0/1888216146 shutdown_connections 2024-08-17T02:28:49.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.743+0000 7f0001e00640 1 --2- 172.21.15.106:0/1888216146 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efffc155df0 0x7efffc0adf10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:49.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.743+0000 7f0001e00640 1 -- 172.21.15.106:0/1888216146 >> 172.21.15.106:0/1888216146 conn(0x7efffc0cb9b0 msgr2=0x7efffc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:49.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.743+0000 7f0001e00640 1 -- 172.21.15.106:0/1888216146 shutdown_connections 2024-08-17T02:28:49.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.743+0000 7f0001e00640 1 -- 172.21.15.106:0/1888216146 wait complete. 2024-08-17T02:28:49.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.744+0000 7f0001e00640 1 Processor -- start 2024-08-17T02:28:49.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.744+0000 7f0001e00640 1 -- start start 2024-08-17T02:28:49.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.745+0000 7f0001e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efffc06df00 0x7efffc0ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:49.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.745+0000 7f0001e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efffc155a20 0x7efffc140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:49.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.745+0000 7f0001e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efffc155df0 0x7efffc0ac0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:49.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.745+0000 7f0001e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efffc1412a0 con 0x7efffc06df00 2024-08-17T02:28:49.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.745+0000 7f0001e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efffc1509b0 con 0x7efffc155df0 2024-08-17T02:28:49.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.745+0000 7f0001e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efffc0ac5f0 con 0x7efffc155a20 2024-08-17T02:28:49.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.745+0000 7efffaa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efffc06df00 0x7efffc0ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:49.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.745+0000 7efffaa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efffc06df00 0x7efffc0ad8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60038/0 (socket says 172.21.15.106:60038) 2024-08-17T02:28:49.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.745+0000 7efffaa00640 1 -- 172.21.15.106:0/3900132423 learned_addr learned my addr 172.21.15.106:0/3900132423 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:49.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.746+0000 7efffb400640 1 --2- 172.21.15.106:0/3900132423 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efffc155df0 0x7efffc0ac0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:49.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.746+0000 7efffa000640 1 --2- 172.21.15.106:0/3900132423 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efffc155a20 0x7efffc140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:49.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.746+0000 7efffaa00640 1 -- 172.21.15.106:0/3900132423 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efffc155a20 msgr2=0x7efffc140d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:49.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.746+0000 7efffaa00640 1 --2- 172.21.15.106:0/3900132423 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efffc155a20 0x7efffc140d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:49.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.746+0000 7efffaa00640 1 -- 172.21.15.106:0/3900132423 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efffc155df0 msgr2=0x7efffc0ac0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:49.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.746+0000 7efffaa00640 1 --2- 172.21.15.106:0/3900132423 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efffc155df0 0x7efffc0ac0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:49.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.746+0000 7efffaa00640 1 -- 172.21.15.106:0/3900132423 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff4009a20 con 0x7efffc06df00 2024-08-17T02:28:49.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.746+0000 7efffb400640 1 --2- 172.21.15.106:0/3900132423 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efffc155df0 0x7efffc0ac0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:49.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.746+0000 7efffa000640 1 --2- 172.21.15.106:0/3900132423 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efffc155a20 0x7efffc140d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:49.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.746+0000 7efffaa00640 1 --2- 172.21.15.106:0/3900132423 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efffc06df00 0x7efffc0ad8d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7effec00c610 tx=0x7effec007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:49.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.746+0000 7efff2000640 1 -- 172.21.15.106:0/3900132423 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec012630 con 0x7efffc06df00 2024-08-17T02:28:49.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.746+0000 7efff2000640 1 -- 172.21.15.106:0/3900132423 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effec0127b0 con 0x7efffc06df00 2024-08-17T02:28:49.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.746+0000 7efff2000640 1 -- 172.21.15.106:0/3900132423 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec012b70 con 0x7efffc06df00 2024-08-17T02:28:49.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.746+0000 7f0001e00640 1 -- 172.21.15.106:0/3900132423 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efffc0ad440 con 0x7efffc06df00 2024-08-17T02:28:49.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.746+0000 7f0001e00640 1 -- 172.21.15.106:0/3900132423 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efffc0acb90 con 0x7efffc06df00 2024-08-17T02:28:49.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.748+0000 7f0001e00640 1 -- 172.21.15.106:0/3900132423 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efffc064db0 con 0x7efffc06df00 2024-08-17T02:28:49.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.749+0000 7efff2000640 1 -- 172.21.15.106:0/3900132423 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7effec01a3b0 con 0x7efffc06df00 2024-08-17T02:28:49.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.749+0000 7efff2000640 1 --2- 172.21.15.106:0/3900132423 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7effdc065150 0x7effdc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:49.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.749+0000 7efff2000640 1 -- 172.21.15.106:0/3900132423 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7effec081fe0 con 0x7efffc06df00 2024-08-17T02:28:49.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.750+0000 7efffa000640 1 --2- 172.21.15.106:0/3900132423 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7effdc065150 0x7effdc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:49.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.750+0000 7efffa000640 1 --2- 172.21.15.106:0/3900132423 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7effdc065150 0x7effdc067600 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efffc15b560 tx=0x7effe8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:49.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.753+0000 7efff2000640 1 -- 172.21.15.106:0/3900132423 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7effec050020 con 0x7efffc06df00 2024-08-17T02:28:49.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.950+0000 7f0001e00640 1 -- 172.21.15.106:0/3900132423 --> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7efffc150f70 con 0x7effdc065150 2024-08-17T02:28:49.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.952+0000 7efff2000640 1 -- 172.21.15.106:0/3900132423 <== mgr.4107 v2:172.21.15.106:6832/36860 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7efffc150f70 con 0x7effdc065150 2024-08-17T02:28:49.953 INFO:teuthology.orchestra.run.smithi106.stdout:[ 2024-08-17T02:28:49.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:49.953 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "cephfs" 2024-08-17T02:28:49.953 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:49.953 INFO:teuthology.orchestra.run.smithi106.stdout:] 2024-08-17T02:28:49.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.954+0000 7f0001e00640 1 -- 172.21.15.106:0/3900132423 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7effdc065150 msgr2=0x7effdc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:49.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.954+0000 7f0001e00640 1 --2- 172.21.15.106:0/3900132423 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7effdc065150 0x7effdc067600 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efffc15b560 tx=0x7effe8009040 comp rx=0 tx=0).stop 2024-08-17T02:28:49.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.954+0000 7f0001e00640 1 -- 172.21.15.106:0/3900132423 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efffc06df00 msgr2=0x7efffc0ad8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:49.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.954+0000 7f0001e00640 1 --2- 172.21.15.106:0/3900132423 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efffc06df00 0x7efffc0ad8d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7effec00c610 tx=0x7effec007ed0 comp rx=0 tx=0).stop 2024-08-17T02:28:49.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.954+0000 7f0001e00640 1 -- 172.21.15.106:0/3900132423 shutdown_connections 2024-08-17T02:28:49.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.954+0000 7f0001e00640 1 --2- 172.21.15.106:0/3900132423 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efffc155df0 0x7efffc0ac0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:49.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.954+0000 7f0001e00640 1 --2- 172.21.15.106:0/3900132423 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efffc155a20 0x7efffc140d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:49.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.954+0000 7f0001e00640 1 --2- 172.21.15.106:0/3900132423 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7effdc065150 0x7effdc067600 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:49.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.954+0000 7f0001e00640 1 --2- 172.21.15.106:0/3900132423 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efffc06df00 0x7efffc0ad8d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:49.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.954+0000 7f0001e00640 1 -- 172.21.15.106:0/3900132423 >> 172.21.15.106:0/3900132423 conn(0x7efffc0cb9b0 msgr2=0x7efffc157010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:49.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.954+0000 7f0001e00640 1 -- 172.21.15.106:0/3900132423 shutdown_connections 2024-08-17T02:28:49.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:49.954+0000 7f0001e00640 1 -- 172.21.15.106:0/3900132423 wait complete. 2024-08-17T02:28:49.970 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:28:50.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.119+0000 7fb53fe00640 1 Processor -- start 2024-08-17T02:28:50.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.119+0000 7fb53fe00640 1 -- start start 2024-08-17T02:28:50.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.120+0000 7fb53fe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb538155550 0x7fb538069e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:50.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.120+0000 7fb53fe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5380c7e50 0x7fb53806a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:50.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.120+0000 7fb53fe00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb53806d470 con 0x7fb538069a60 2024-08-17T02:28:50.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.120+0000 7fb53fe00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5380c8250 con 0x7fb538155550 2024-08-17T02:28:50.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.120+0000 7fb53fe00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5380aec60 con 0x7fb5380c7e50 2024-08-17T02:28:50.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.120+0000 7fb53ca00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb538155550 0x7fb538069e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:50.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.120+0000 7fb53ca00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb538155550 0x7fb538069e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59550/0 (socket says 172.21.15.106:59550) 2024-08-17T02:28:50.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.120+0000 7fb53ca00640 1 -- 172.21.15.106:0/2835824746 learned_addr learned my addr 172.21.15.106:0/2835824746 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:50.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.121+0000 7fb53de00640 1 --2- 172.21.15.106:0/2835824746 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5380c7e50 0x7fb53806a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:50.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.121+0000 7fb53ca00640 1 -- 172.21.15.106:0/2835824746 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5380c7e50 msgr2=0x7fb53806a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:50.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.121+0000 7fb53ca00640 1 --2- 172.21.15.106:0/2835824746 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5380c7e50 0x7fb53806a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:50.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.121+0000 7fb53ca00640 1 -- 172.21.15.106:0/2835824746 >> v1:172.21.15.171:6789/0 conn(0x7fb538069a60 legacy=0x7fb538154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:50.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.121+0000 7fb53ca00640 1 -- 172.21.15.106:0/2835824746 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53806c860 con 0x7fb538155550 2024-08-17T02:28:50.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.121+0000 7fb53de00640 1 --2- 172.21.15.106:0/2835824746 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5380c7e50 0x7fb53806a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:50.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.122+0000 7fb53ca00640 1 --2- 172.21.15.106:0/2835824746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb538155550 0x7fb538069e30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb524009910 tx=0x7fb5240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34343ba5d1d1a8b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:50.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.122+0000 7fb537e00640 1 -- 172.21.15.106:0/2835824746 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52402ad30 con 0x7fb538155550 2024-08-17T02:28:50.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.122+0000 7fb537e00640 1 -- 172.21.15.106:0/2835824746 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52402ae90 con 0x7fb538155550 2024-08-17T02:28:50.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.122+0000 7fb537e00640 1 -- 172.21.15.106:0/2835824746 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb524032670 con 0x7fb538155550 2024-08-17T02:28:50.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.122+0000 7fb53fe00640 1 -- 172.21.15.106:0/2835824746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb538155550 msgr2=0x7fb538069e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:50.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.122+0000 7fb53fe00640 1 --2- 172.21.15.106:0/2835824746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb538155550 0x7fb538069e30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb524009910 tx=0x7fb5240091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:50.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.123+0000 7fb53fe00640 1 -- 172.21.15.106:0/2835824746 shutdown_connections 2024-08-17T02:28:50.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.123+0000 7fb53fe00640 1 --2- 172.21.15.106:0/2835824746 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb5380c7e50 0x7fb53806a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:50.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.123+0000 7fb53fe00640 1 --2- 172.21.15.106:0/2835824746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb538155550 0x7fb538069e30 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:50.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.123+0000 7fb53fe00640 1 -- 172.21.15.106:0/2835824746 >> 172.21.15.106:0/2835824746 conn(0x7fb538067750 msgr2=0x7fb5380c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:50.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.123+0000 7fb53fe00640 1 -- 172.21.15.106:0/2835824746 shutdown_connections 2024-08-17T02:28:50.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.123+0000 7fb53fe00640 1 -- 172.21.15.106:0/2835824746 wait complete. 2024-08-17T02:28:50.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.124+0000 7fb53fe00640 1 Processor -- start 2024-08-17T02:28:50.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.124+0000 7fb53fe00640 1 -- start start 2024-08-17T02:28:50.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.125+0000 7fb53fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb538069a60 0x7fb53813fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:50.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.125+0000 7fb53fe00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5380c7e50 0x7fb5380a7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:50.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.125+0000 7fb53fe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb538155550 0x7fb5380a8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:50.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.125+0000 7fb53fe00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb538156f10 con 0x7fb538069a60 2024-08-17T02:28:50.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.125+0000 7fb53fe00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5380aa9b0 con 0x7fb5380c7e50 2024-08-17T02:28:50.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.125+0000 7fb53fe00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5380aac90 con 0x7fb538155550 2024-08-17T02:28:50.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.125+0000 7fb53d400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb538069a60 0x7fb53813fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:50.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.125+0000 7fb53d400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb538069a60 0x7fb53813fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59552/0 (socket says 172.21.15.106:59552) 2024-08-17T02:28:50.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.125+0000 7fb53d400640 1 -- 172.21.15.106:0/2109077667 learned_addr learned my addr 172.21.15.106:0/2109077667 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:50.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.126+0000 7fb53d400640 1 -- 172.21.15.106:0/2109077667 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb538155550 msgr2=0x7fb5380a8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:50.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.126+0000 7fb53d400640 1 --2- 172.21.15.106:0/2109077667 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb538155550 0x7fb5380a8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:50.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.126+0000 7fb53d400640 1 -- 172.21.15.106:0/2109077667 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5380c7e50 msgr2=0x7fb5380a7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:50.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.126+0000 7fb53d400640 1 --2- 172.21.15.106:0/2109077667 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5380c7e50 0x7fb5380a7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:50.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.126+0000 7fb53d400640 1 -- 172.21.15.106:0/2109077667 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb524009450 con 0x7fb538069a60 2024-08-17T02:28:50.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.126+0000 7fb53d400640 1 --2- 172.21.15.106:0/2109077667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb538069a60 0x7fb53813fa50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb52c00c5e0 tx=0x7fb52c007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:50.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.126+0000 7fb534c00640 1 -- 172.21.15.106:0/2109077667 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c012630 con 0x7fb538069a60 2024-08-17T02:28:50.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.126+0000 7fb534c00640 1 -- 172.21.15.106:0/2109077667 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52c0127b0 con 0x7fb538069a60 2024-08-17T02:28:50.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.126+0000 7fb53fe00640 1 -- 172.21.15.106:0/2109077667 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5380aaf70 con 0x7fb538069a60 2024-08-17T02:28:50.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.126+0000 7fb534c00640 1 -- 172.21.15.106:0/2109077667 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c012bb0 con 0x7fb538069a60 2024-08-17T02:28:50.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.126+0000 7fb53fe00640 1 -- 172.21.15.106:0/2109077667 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb53813ff90 con 0x7fb538069a60 2024-08-17T02:28:50.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.127+0000 7fb53fe00640 1 -- 172.21.15.106:0/2109077667 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb538071050 con 0x7fb538069a60 2024-08-17T02:28:50.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.128+0000 7fb534c00640 1 -- 172.21.15.106:0/2109077667 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb52c01a3b0 con 0x7fb538069a60 2024-08-17T02:28:50.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.129+0000 7fb534c00640 1 --2- 172.21.15.106:0/2109077667 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb518065150 0x7fb518067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:50.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.129+0000 7fb534c00640 1 -- 172.21.15.106:0/2109077667 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb52c081ff0 con 0x7fb538069a60 2024-08-17T02:28:50.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.129+0000 7fb53ca00640 1 --2- 172.21.15.106:0/2109077667 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb518065150 0x7fb518067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:50.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.130+0000 7fb53ca00640 1 --2- 172.21.15.106:0/2109077667 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb518065150 0x7fb518067600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb524034000 tx=0x7fb524032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:50.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.133+0000 7fb534c00640 1 -- 172.21.15.106:0/2109077667 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb52c050070 con 0x7fb538069a60 2024-08-17T02:28:50.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.305+0000 7fb53fe00640 1 -- 172.21.15.106:0/2109077667 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb5380ca3d0 con 0x7fb538069a60 2024-08-17T02:28:50.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.305+0000 7fb534c00640 1 -- 172.21.15.106:0/2109077667 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb52c053690 con 0x7fb538069a60 2024-08-17T02:28:50.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.307+0000 7fb53fe00640 1 -- 172.21.15.106:0/2109077667 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb518065150 msgr2=0x7fb518067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:50.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.307+0000 7fb53fe00640 1 --2- 172.21.15.106:0/2109077667 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb518065150 0x7fb518067600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb524034000 tx=0x7fb524032000 comp rx=0 tx=0).stop 2024-08-17T02:28:50.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.307+0000 7fb53fe00640 1 -- 172.21.15.106:0/2109077667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb538069a60 msgr2=0x7fb53813fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:50.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.307+0000 7fb53fe00640 1 --2- 172.21.15.106:0/2109077667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb538069a60 0x7fb53813fa50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb52c00c5e0 tx=0x7fb52c007ed0 comp rx=0 tx=0).stop 2024-08-17T02:28:50.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.307+0000 7fb53fe00640 1 -- 172.21.15.106:0/2109077667 shutdown_connections 2024-08-17T02:28:50.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.307+0000 7fb53fe00640 1 --2- 172.21.15.106:0/2109077667 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb538155550 0x7fb5380a8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:50.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.307+0000 7fb53fe00640 1 --2- 172.21.15.106:0/2109077667 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb5380c7e50 0x7fb5380a7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:50.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.307+0000 7fb53fe00640 1 --2- 172.21.15.106:0/2109077667 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fb518065150 0x7fb518067600 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:50.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.307+0000 7fb53fe00640 1 --2- 172.21.15.106:0/2109077667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb538069a60 0x7fb53813fa50 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:50.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.307+0000 7fb53fe00640 1 -- 172.21.15.106:0/2109077667 >> 172.21.15.106:0/2109077667 conn(0x7fb538067750 msgr2=0x7fb5380ca5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:50.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.307+0000 7fb53fe00640 1 -- 172.21.15.106:0/2109077667 shutdown_connections 2024-08-17T02:28:50.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.307+0000 7fb53fe00640 1 -- 172.21.15.106:0/2109077667 wait complete. 2024-08-17T02:28:50.324 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000123149 2024-08-17T02:28:50.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.471+0000 7f0d15200640 1 Processor -- start 2024-08-17T02:28:50.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.471+0000 7f0d15200640 1 -- start start 2024-08-17T02:28:50.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.472+0000 7f0d15200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0d100adec0 0x7f0d10161890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:50.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.472+0000 7f0d15200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d1015b030 con 0x7f0d10156990 2024-08-17T02:28:50.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.472+0000 7f0d15200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d100cc2e0 con 0x7f0d10156d60 2024-08-17T02:28:50.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.472+0000 7f0d15200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d100af950 con 0x7f0d100adec0 2024-08-17T02:28:50.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.473+0000 7f0d0de00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f0d10156990 0x7f0d100b05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41960/0 (socket says 172.21.15.106:41960) 2024-08-17T02:28:50.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.473+0000 7f0d0de00640 1 -- 172.21.15.106:0/3137797804 learned_addr learned my addr 172.21.15.106:0/3137797804 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:50.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.473+0000 7f0d0e800640 1 --2- 172.21.15.106:0/3137797804 >> v2:172.21.15.171:3300/0 conn(0x7f0d100adec0 0x7f0d10161890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:50.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.473+0000 7f0d0ca00640 1 -- 172.21.15.106:0/3137797804 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40540935 0 0) 0x7f0d1015b030 con 0x7f0d10156990 2024-08-17T02:28:50.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.473+0000 7f0d0ca00640 1 -- 172.21.15.106:0/3137797804 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cf40034e0 con 0x7f0d10156990 2024-08-17T02:28:50.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.473+0000 7f0d0ca00640 1 -- 172.21.15.106:0/3137797804 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3121660969 0 0) 0x7f0d100cc2e0 con 0x7f0d10156d60 2024-08-17T02:28:50.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.473+0000 7f0d0ca00640 1 -- 172.21.15.106:0/3137797804 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d1015b030 con 0x7f0d10156d60 2024-08-17T02:28:50.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.473+0000 7f0d0e800640 1 -- 172.21.15.106:0/3137797804 >> v1:172.21.15.171:6789/0 conn(0x7f0d10156d60 legacy=0x7f0d100ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:50.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.473+0000 7f0d0e800640 1 -- 172.21.15.106:0/3137797804 >> v1:172.21.15.106:6789/0 conn(0x7f0d10156990 legacy=0x7f0d100b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:50.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.473+0000 7f0d0e800640 1 -- 172.21.15.106:0/3137797804 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d100b1110 con 0x7f0d100adec0 2024-08-17T02:28:50.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.474+0000 7f0d0e800640 1 --2- 172.21.15.106:0/3137797804 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d100adec0 0x7f0d10161890 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0d08009e60 tx=0x7f0d08009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=452648c994517446 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:50.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.475+0000 7f0d0ca00640 1 -- 172.21.15.106:0/3137797804 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d08007550 con 0x7f0d100adec0 2024-08-17T02:28:50.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.475+0000 7f0d0ca00640 1 -- 172.21.15.106:0/3137797804 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0802d050 con 0x7f0d100adec0 2024-08-17T02:28:50.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.475+0000 7f0d0ca00640 1 -- 172.21.15.106:0/3137797804 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d08007900 con 0x7f0d100adec0 2024-08-17T02:28:50.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.475+0000 7f0d15200640 1 -- 172.21.15.106:0/3137797804 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d100adec0 msgr2=0x7f0d10161890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:50.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.475+0000 7f0d15200640 1 --2- 172.21.15.106:0/3137797804 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d100adec0 0x7f0d10161890 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0d08009e60 tx=0x7f0d08009780 comp rx=0 tx=0).stop 2024-08-17T02:28:50.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.475+0000 7f0d15200640 1 -- 172.21.15.106:0/3137797804 shutdown_connections 2024-08-17T02:28:50.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.475+0000 7f0d15200640 1 --2- 172.21.15.106:0/3137797804 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d100adec0 0x7f0d10161890 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:50.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.475+0000 7f0d15200640 1 -- 172.21.15.106:0/3137797804 >> 172.21.15.106:0/3137797804 conn(0x7f0d10067750 msgr2=0x7f0d100cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:50.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.475+0000 7f0d15200640 1 -- 172.21.15.106:0/3137797804 shutdown_connections 2024-08-17T02:28:50.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.475+0000 7f0d15200640 1 -- 172.21.15.106:0/3137797804 wait complete. 2024-08-17T02:28:50.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.477+0000 7f0d15200640 1 Processor -- start 2024-08-17T02:28:50.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.477+0000 7f0d15200640 1 -- start start 2024-08-17T02:28:50.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.478+0000 7f0d15200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d100adec0 0x7f0d10155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:50.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.478+0000 7f0d15200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d10156990 0x7f0d10154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:50.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.478+0000 7f0d15200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d10156d60 0x7f0d101550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:50.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.478+0000 7f0d15200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d10068700 con 0x7f0d10156990 2024-08-17T02:28:50.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.478+0000 7f0d15200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d10150880 con 0x7f0d100adec0 2024-08-17T02:28:50.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.478+0000 7f0d15200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d10156080 con 0x7f0d10156d60 2024-08-17T02:28:50.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.478+0000 7f0d0d400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d10156990 0x7f0d10154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:50.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.478+0000 7f0d0d400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d10156990 0x7f0d10154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59556/0 (socket says 172.21.15.106:59556) 2024-08-17T02:28:50.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.478+0000 7f0d0d400640 1 -- 172.21.15.106:0/778740227 learned_addr learned my addr 172.21.15.106:0/778740227 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:50.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.478+0000 7f0d0de00640 1 --2- 172.21.15.106:0/778740227 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d100adec0 0x7f0d10155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:50.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.478+0000 7f0d0e800640 1 --2- 172.21.15.106:0/778740227 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d10156d60 0x7f0d101550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:50.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.479+0000 7f0d0d400640 1 -- 172.21.15.106:0/778740227 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d10156d60 msgr2=0x7f0d101550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:50.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.479+0000 7f0d0d400640 1 --2- 172.21.15.106:0/778740227 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d10156d60 0x7f0d101550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:50.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.479+0000 7f0d0d400640 1 -- 172.21.15.106:0/778740227 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d100adec0 msgr2=0x7f0d10155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:50.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.479+0000 7f0d0d400640 1 --2- 172.21.15.106:0/778740227 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d100adec0 0x7f0d10155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:50.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.479+0000 7f0d0d400640 1 -- 172.21.15.106:0/778740227 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d08009a20 con 0x7f0d10156990 2024-08-17T02:28:50.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.479+0000 7f0d0d400640 1 --2- 172.21.15.106:0/778740227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d10156990 0x7f0d10154b80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00c540 tx=0x7f0cfc007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:50.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.479+0000 7f0d05600640 1 -- 172.21.15.106:0/778740227 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc016070 con 0x7f0d10156990 2024-08-17T02:28:50.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.479+0000 7f0d05600640 1 -- 172.21.15.106:0/778740227 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cfc011590 con 0x7f0d10156990 2024-08-17T02:28:50.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.479+0000 7f0d05600640 1 -- 172.21.15.106:0/778740227 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc011950 con 0x7f0d10156990 2024-08-17T02:28:50.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.479+0000 7f0d15200640 1 -- 172.21.15.106:0/778740227 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d10069240 con 0x7f0d10156990 2024-08-17T02:28:50.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.479+0000 7f0d15200640 1 -- 172.21.15.106:0/778740227 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d10068bf0 con 0x7f0d10156990 2024-08-17T02:28:50.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.480+0000 7f0d15200640 1 -- 172.21.15.106:0/778740227 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d10071050 con 0x7f0d10156990 2024-08-17T02:28:50.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.481+0000 7f0d05600640 1 -- 172.21.15.106:0/778740227 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0cfc011d40 con 0x7f0d10156990 2024-08-17T02:28:50.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.482+0000 7f0d05600640 1 --2- 172.21.15.106:0/778740227 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0cf0065150 0x7f0cf0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:50.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.482+0000 7f0d05600640 1 -- 172.21.15.106:0/778740227 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0cfc081de0 con 0x7f0d10156990 2024-08-17T02:28:50.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.482+0000 7f0d0de00640 1 --2- 172.21.15.106:0/778740227 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0cf0065150 0x7f0cf0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:50.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.483+0000 7f0d0de00640 1 --2- 172.21.15.106:0/778740227 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0cf0065150 0x7f0cf0067600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0d00005840 tx=0x7f0d00009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:50.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.485+0000 7f0d05600640 1 -- 172.21.15.106:0/778740227 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0cfc04ff50 con 0x7f0d10156990 2024-08-17T02:28:50.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:50.680+0000 7f0d15200640 1 -- 172.21.15.106:0/778740227 --> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000123149", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d100abee0 con 0x7f0cf0065150 2024-08-17T02:28:53.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.610+0000 7f0d05600640 1 -- 172.21.15.106:0/778740227 <== mgr.4107 v2:172.21.15.106:6832/36860 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f0d100abee0 con 0x7f0cf0065150 2024-08-17T02:28:53.612 INFO:teuthology.orchestra.run.smithi106.stderr:Volume created successfully (no MDS daemons created) 2024-08-17T02:28:53.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.613+0000 7f0d15200640 1 -- 172.21.15.106:0/778740227 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0cf0065150 msgr2=0x7f0cf0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:53.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.613+0000 7f0d15200640 1 --2- 172.21.15.106:0/778740227 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0cf0065150 0x7f0cf0067600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0d00005840 tx=0x7f0d00009040 comp rx=0 tx=0).stop 2024-08-17T02:28:53.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.613+0000 7f0d15200640 1 -- 172.21.15.106:0/778740227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d10156990 msgr2=0x7f0d10154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:53.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.613+0000 7f0d15200640 1 --2- 172.21.15.106:0/778740227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d10156990 0x7f0d10154b80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00c540 tx=0x7f0cfc007d80 comp rx=0 tx=0).stop 2024-08-17T02:28:53.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.613+0000 7f0d15200640 1 -- 172.21.15.106:0/778740227 shutdown_connections 2024-08-17T02:28:53.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.613+0000 7f0d15200640 1 --2- 172.21.15.106:0/778740227 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d10156d60 0x7f0d101550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.613+0000 7f0d15200640 1 --2- 172.21.15.106:0/778740227 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0cf0065150 0x7f0cf0067600 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.613+0000 7f0d15200640 1 --2- 172.21.15.106:0/778740227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d10156990 0x7f0d10154b80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.613+0000 7f0d15200640 1 --2- 172.21.15.106:0/778740227 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d100adec0 0x7f0d10155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.614+0000 7f0d15200640 1 -- 172.21.15.106:0/778740227 >> 172.21.15.106:0/778740227 conn(0x7f0d10067750 msgr2=0x7f0d1006ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:53.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.614+0000 7f0d15200640 1 -- 172.21.15.106:0/778740227 shutdown_connections 2024-08-17T02:28:53.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.614+0000 7f0d15200640 1 -- 172.21.15.106:0/778740227 wait complete. 2024-08-17T02:28:53.640 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:28:53.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.793+0000 7f4ad0000640 1 Processor -- start 2024-08-17T02:28:53.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.793+0000 7f4ad0000640 1 -- start start 2024-08-17T02:28:53.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.794+0000 7f4ad0000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4ac80b1440 0x7f4ac80caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:53.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.794+0000 7f4ad0000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f4ac8140580 0x7f4ac80c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:53.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.794+0000 7f4ad0000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac80caa80 con 0x7f4ac81401b0 2024-08-17T02:28:53.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.794+0000 7f4ad0000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac80cb450 con 0x7f4ac80b1440 2024-08-17T02:28:53.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.794+0000 7f4ad0000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac80c9e70 con 0x7f4ac8140580 2024-08-17T02:28:53.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.794+0000 7f4accc00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4ac80b1440 0x7f4ac80caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:53.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.794+0000 7f4accc00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4ac80b1440 0x7f4ac80caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59562/0 (socket says 172.21.15.106:59562) 2024-08-17T02:28:53.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.794+0000 7f4accc00640 1 -- 172.21.15.106:0/3395676574 learned_addr learned my addr 172.21.15.106:0/3395676574 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:53.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.794+0000 7f4acd600640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f4ac81401b0 0x7f4ac80b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41976/0 (socket says 172.21.15.106:41976) 2024-08-17T02:28:53.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.795+0000 7f4accc00640 1 -- 172.21.15.106:0/3395676574 >> v2:172.21.15.171:3300/0 conn(0x7f4ac8140580 msgr2=0x7f4ac80c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:53.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.795+0000 7f4accc00640 1 --2- 172.21.15.106:0/3395676574 >> v2:172.21.15.171:3300/0 conn(0x7f4ac8140580 0x7f4ac80c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.795+0000 7f4accc00640 1 -- 172.21.15.106:0/3395676574 >> v1:172.21.15.106:6789/0 conn(0x7f4ac81401b0 legacy=0x7f4ac80b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:53.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.795+0000 7f4ac7e00640 1 -- 172.21.15.106:0/3395676574 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3759592956 0 0) 0x7f4ac80caa80 con 0x7f4ac81401b0 2024-08-17T02:28:53.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.795+0000 7f4accc00640 1 -- 172.21.15.106:0/3395676574 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac80ca150 con 0x7f4ac80b1440 2024-08-17T02:28:53.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.796+0000 7f4accc00640 1 --2- 172.21.15.106:0/3395676574 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ac80b1440 0x7f4ac80caf10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80ca9f0 tx=0x7f4ab40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b084e6ef889a11fc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:53.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.796+0000 7f4ac7e00640 1 -- 172.21.15.106:0/3395676574 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab402ae80 con 0x7f4ac80b1440 2024-08-17T02:28:53.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.796+0000 7f4ac7e00640 1 -- 172.21.15.106:0/3395676574 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab4032440 con 0x7f4ac80b1440 2024-08-17T02:28:53.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.796+0000 7f4ac7e00640 1 -- 172.21.15.106:0/3395676574 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab40327c0 con 0x7f4ac80b1440 2024-08-17T02:28:53.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.797+0000 7f4ad0000640 1 -- 172.21.15.106:0/3395676574 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ac80b1440 msgr2=0x7f4ac80caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:53.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.797+0000 7f4ad0000640 1 --2- 172.21.15.106:0/3395676574 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ac80b1440 0x7f4ac80caf10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80ca9f0 tx=0x7f4ab40091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.797+0000 7f4ad0000640 1 -- 172.21.15.106:0/3395676574 shutdown_connections 2024-08-17T02:28:53.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.797+0000 7f4ad0000640 1 --2- 172.21.15.106:0/3395676574 >> v2:172.21.15.171:3300/0 conn(0x7f4ac8140580 0x7f4ac80c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.797+0000 7f4ad0000640 1 --2- 172.21.15.106:0/3395676574 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ac80b1440 0x7f4ac80caf10 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.797+0000 7f4ad0000640 1 -- 172.21.15.106:0/3395676574 >> 172.21.15.106:0/3395676574 conn(0x7f4ac80cb9b0 msgr2=0x7f4ac80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:53.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.797+0000 7f4ad0000640 1 -- 172.21.15.106:0/3395676574 shutdown_connections 2024-08-17T02:28:53.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.797+0000 7f4ad0000640 1 -- 172.21.15.106:0/3395676574 wait complete. 2024-08-17T02:28:53.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.798+0000 7f4ad0000640 1 Processor -- start 2024-08-17T02:28:53.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.798+0000 7f4ad0000640 1 -- start start 2024-08-17T02:28:53.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.799+0000 7f4ad0000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ac80b1440 0x7f4ac8131d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:53.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.799+0000 7f4ad0000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ac81401b0 0x7f4ac80c11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:53.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.799+0000 7f4ad0000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ac8140580 0x7f4ac80abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:53.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.799+0000 7f4ad0000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac80ab830 con 0x7f4ac8140580 2024-08-17T02:28:53.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.799+0000 7f4ad0000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac80aac20 con 0x7f4ac80b1440 2024-08-17T02:28:53.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.799+0000 7f4ad0000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac80aaf00 con 0x7f4ac81401b0 2024-08-17T02:28:53.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.799+0000 7f4ace000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ac8140580 0x7f4ac80abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:53.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.799+0000 7f4ace000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ac8140580 0x7f4ac80abcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59578/0 (socket says 172.21.15.106:59578) 2024-08-17T02:28:53.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.800+0000 7f4ace000640 1 -- 172.21.15.106:0/453856426 learned_addr learned my addr 172.21.15.106:0/453856426 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:53.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.800+0000 7f4accc00640 1 --2- 172.21.15.106:0/453856426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ac81401b0 0x7f4ac80c11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:53.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.800+0000 7f4acd600640 1 --2- 172.21.15.106:0/453856426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ac80b1440 0x7f4ac8131d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:53.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.800+0000 7f4ace000640 1 -- 172.21.15.106:0/453856426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ac81401b0 msgr2=0x7f4ac80c11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:53.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.800+0000 7f4ace000640 1 --2- 172.21.15.106:0/453856426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ac81401b0 0x7f4ac80c11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.800+0000 7f4ace000640 1 -- 172.21.15.106:0/453856426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ac80b1440 msgr2=0x7f4ac8131d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:53.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.800+0000 7f4ace000640 1 --2- 172.21.15.106:0/453856426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ac80b1440 0x7f4ac8131d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.800+0000 7f4ace000640 1 -- 172.21.15.106:0/453856426 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab4009450 con 0x7f4ac8140580 2024-08-17T02:28:53.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.800+0000 7f4acd600640 1 --2- 172.21.15.106:0/453856426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ac80b1440 0x7f4ac8131d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:53.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.800+0000 7f4ace000640 1 --2- 172.21.15.106:0/453856426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ac8140580 0x7f4ac80abcc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4ac000bc30 tx=0x7f4ac0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:53.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.800+0000 7f4ac4c00640 1 -- 172.21.15.106:0/453856426 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac00092e0 con 0x7f4ac8140580 2024-08-17T02:28:53.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.800+0000 7f4ac4c00640 1 -- 172.21.15.106:0/453856426 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac000c860 con 0x7f4ac8140580 2024-08-17T02:28:53.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.800+0000 7f4ac4c00640 1 -- 172.21.15.106:0/453856426 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac000cc40 con 0x7f4ac8140580 2024-08-17T02:28:53.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.800+0000 7f4ad0000640 1 -- 172.21.15.106:0/453856426 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac80ab1e0 con 0x7f4ac8140580 2024-08-17T02:28:53.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.801+0000 7f4ad0000640 1 -- 172.21.15.106:0/453856426 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac80c0b80 con 0x7f4ac8140580 2024-08-17T02:28:53.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.801+0000 7f4ad0000640 1 -- 172.21.15.106:0/453856426 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac80ab9a0 con 0x7f4ac8140580 2024-08-17T02:28:53.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.802+0000 7f4ac4c00640 1 -- 172.21.15.106:0/453856426 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4ac0012070 con 0x7f4ac8140580 2024-08-17T02:28:53.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.803+0000 7f4ac4c00640 1 --2- 172.21.15.106:0/453856426 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4aa8065150 0x7f4aa8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:53.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.803+0000 7f4ac4c00640 1 -- 172.21.15.106:0/453856426 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f4ac00824f0 con 0x7f4ac8140580 2024-08-17T02:28:53.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.803+0000 7f4acd600640 1 --2- 172.21.15.106:0/453856426 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4aa8065150 0x7f4aa8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:53.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.804+0000 7f4acd600640 1 --2- 172.21.15.106:0/453856426 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4aa8065150 0x7f4aa8067600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4abc001840 tx=0x7f4abc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:53.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:53.808+0000 7f4ac4c00640 1 -- 172.21.15.106:0/453856426 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4ac0053c20 con 0x7f4ac8140580 2024-08-17T02:28:54.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.004+0000 7f4ad0000640 1 -- 172.21.15.106:0/453856426 --> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ac8064db0 con 0x7f4aa8065150 2024-08-17T02:28:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.005+0000 7f4ac4c00640 1 -- 172.21.15.106:0/453856426 <== mgr.4107 v2:172.21.15.106:6832/36860 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+96 (secure 0 0 0) 0x7f4ac8064db0 con 0x7f4aa8065150 2024-08-17T02:28:54.007 INFO:teuthology.orchestra.run.smithi106.stdout:[ 2024-08-17T02:28:54.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:54.007 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "cephfs" 2024-08-17T02:28:54.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-17T02:28:54.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-08-17T02:28:54.007 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "volume_0000000000123149" 2024-08-17T02:28:54.008 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-17T02:28:54.008 INFO:teuthology.orchestra.run.smithi106.stdout:] 2024-08-17T02:28:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.007+0000 7f4ad0000640 1 -- 172.21.15.106:0/453856426 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4aa8065150 msgr2=0x7f4aa8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.007+0000 7f4ad0000640 1 --2- 172.21.15.106:0/453856426 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4aa8065150 0x7f4aa8067600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4abc001840 tx=0x7f4abc009040 comp rx=0 tx=0).stop 2024-08-17T02:28:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.007+0000 7f4ad0000640 1 -- 172.21.15.106:0/453856426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ac8140580 msgr2=0x7f4ac80abcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.007+0000 7f4ad0000640 1 --2- 172.21.15.106:0/453856426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ac8140580 0x7f4ac80abcc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4ac000bc30 tx=0x7f4ac0009840 comp rx=0 tx=0).stop 2024-08-17T02:28:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.008+0000 7f4ad0000640 1 -- 172.21.15.106:0/453856426 shutdown_connections 2024-08-17T02:28:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.008+0000 7f4ad0000640 1 --2- 172.21.15.106:0/453856426 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4aa8065150 0x7f4aa8067600 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.008+0000 7f4ad0000640 1 --2- 172.21.15.106:0/453856426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ac8140580 0x7f4ac80abcc0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.008+0000 7f4ad0000640 1 --2- 172.21.15.106:0/453856426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4ac81401b0 0x7f4ac80c11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.008+0000 7f4ad0000640 1 --2- 172.21.15.106:0/453856426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ac80b1440 0x7f4ac8131d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.008+0000 7f4ad0000640 1 -- 172.21.15.106:0/453856426 >> 172.21.15.106:0/453856426 conn(0x7f4ac80cb9b0 msgr2=0x7f4ac806cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.008+0000 7f4ad0000640 1 -- 172.21.15.106:0/453856426 shutdown_connections 2024-08-17T02:28:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.008+0000 7f4ad0000640 1 -- 172.21.15.106:0/453856426 wait complete. 2024-08-17T02:28:54.024 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2024-08-17T02:28:54.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.173+0000 7ff8d0e00640 1 Processor -- start 2024-08-17T02:28:54.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.173+0000 7ff8d0e00640 1 -- start start 2024-08-17T02:28:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.174+0000 7ff8d0e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff8cc157640 0x7ff8cc15b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.174+0000 7ff8d0e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff8cc157a10 0x7ff8cc0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.174+0000 7ff8d0e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8cc0ae910 0x7ff8cc0aed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.174+0000 7ff8d0e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8cc15a790 con 0x7ff8cc157640 2024-08-17T02:28:54.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.174+0000 7ff8d0e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8cc0af250 con 0x7ff8cc157a10 2024-08-17T02:28:54.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.174+0000 7ff8d0e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc0b2010 con 0x7ff8cc0ae910 2024-08-17T02:28:54.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.174+0000 7ff8c9e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff8cc157640 0x7ff8cc15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:54.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.174+0000 7ff8c9e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff8cc157640 0x7ff8cc15b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59584/0 (socket says 172.21.15.106:59584) 2024-08-17T02:28:54.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.174+0000 7ff8c9e00640 1 -- 172.21.15.106:0/1826462469 learned_addr learned my addr 172.21.15.106:0/1826462469 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:54.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.174+0000 7ff8ca800640 1 --2- 172.21.15.106:0/1826462469 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8cc0ae910 0x7ff8cc0aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:54.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.174+0000 7ff8c3e00640 1 --2- 172.21.15.106:0/1826462469 >> v2:172.21.15.171:3300/0 conn(0x7ff8cc157a10 0x7ff8cc0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:54.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.175+0000 7ff8c9e00640 1 -- 172.21.15.106:0/1826462469 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8cc0ae910 msgr2=0x7ff8cc0aed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:54.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.175+0000 7ff8c9e00640 1 --2- 172.21.15.106:0/1826462469 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8cc0ae910 0x7ff8cc0aed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.175+0000 7ff8c9e00640 1 -- 172.21.15.106:0/1826462469 >> v2:172.21.15.171:3300/0 conn(0x7ff8cc157a10 msgr2=0x7ff8cc0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:54.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.175+0000 7ff8c9e00640 1 --2- 172.21.15.106:0/1826462469 >> v2:172.21.15.171:3300/0 conn(0x7ff8cc157a10 0x7ff8cc0b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.175+0000 7ff8c9e00640 1 -- 172.21.15.106:0/1826462469 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8cc15aa00 con 0x7ff8cc157640 2024-08-17T02:28:54.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.175+0000 7ff8ca800640 1 --2- 172.21.15.106:0/1826462469 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8cc0ae910 0x7ff8cc0aed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:54.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.175+0000 7ff8c3e00640 1 --2- 172.21.15.106:0/1826462469 >> v2:172.21.15.171:3300/0 conn(0x7ff8cc157a10 0x7ff8cc0b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:54.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.176+0000 7ff8c9e00640 1 --2- 172.21.15.106:0/1826462469 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8cc157640 0x7ff8cc15b200 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc0b1640 tx=0x7ff8bc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dbf7e28d6ea357d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:54.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.176+0000 7ff8c9400640 1 -- 172.21.15.106:0/1826462469 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc02add0 con 0x7ff8cc157640 2024-08-17T02:28:54.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.176+0000 7ff8c9400640 1 -- 172.21.15.106:0/1826462469 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8bc032440 con 0x7ff8cc157640 2024-08-17T02:28:54.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.176+0000 7ff8c9400640 1 -- 172.21.15.106:0/1826462469 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc032820 con 0x7ff8cc157640 2024-08-17T02:28:54.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.176+0000 7ff8d0e00640 1 -- 172.21.15.106:0/1826462469 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8cc157640 msgr2=0x7ff8cc15b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:54.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.176+0000 7ff8d0e00640 1 --2- 172.21.15.106:0/1826462469 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8cc157640 0x7ff8cc15b200 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc0b1640 tx=0x7ff8bc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.177+0000 7ff8d0e00640 1 -- 172.21.15.106:0/1826462469 shutdown_connections 2024-08-17T02:28:54.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.177+0000 7ff8d0e00640 1 --2- 172.21.15.106:0/1826462469 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8cc0ae910 0x7ff8cc0aed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.177+0000 7ff8d0e00640 1 --2- 172.21.15.106:0/1826462469 >> v2:172.21.15.171:3300/0 conn(0x7ff8cc157a10 0x7ff8cc0b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.177+0000 7ff8d0e00640 1 --2- 172.21.15.106:0/1826462469 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8cc157640 0x7ff8cc15b200 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.177+0000 7ff8d0e00640 1 -- 172.21.15.106:0/1826462469 >> 172.21.15.106:0/1826462469 conn(0x7ff8cc0cca50 msgr2=0x7ff8cc0cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:54.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.177+0000 7ff8d0e00640 1 -- 172.21.15.106:0/1826462469 shutdown_connections 2024-08-17T02:28:54.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.177+0000 7ff8d0e00640 1 -- 172.21.15.106:0/1826462469 wait complete. 2024-08-17T02:28:54.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.178+0000 7ff8d0e00640 1 Processor -- start 2024-08-17T02:28:54.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.178+0000 7ff8d0e00640 1 -- start start 2024-08-17T02:28:54.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.179+0000 7ff8d0e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8cc0ae910 0x7ff8cc169f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:54.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.179+0000 7ff8d0e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8cc157640 0x7ff8cc0c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:54.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.179+0000 7ff8d0e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8cc157a10 0x7ff8cc13fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:54.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.179+0000 7ff8d0e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc0c8450 con 0x7ff8cc157a10 2024-08-17T02:28:54.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.179+0000 7ff8d0e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc0c8c20 con 0x7ff8cc0ae910 2024-08-17T02:28:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.179+0000 7ff8d0e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc140340 con 0x7ff8cc157640 2024-08-17T02:28:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.179+0000 7ff8ca800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8cc157a10 0x7ff8cc13fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.179+0000 7ff8ca800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8cc157a10 0x7ff8cc13fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59588/0 (socket says 172.21.15.106:59588) 2024-08-17T02:28:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.179+0000 7ff8ca800640 1 -- 172.21.15.106:0/1690942320 learned_addr learned my addr 172.21.15.106:0/1690942320 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.179+0000 7ff8c9e00640 1 --2- 172.21.15.106:0/1690942320 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8cc0ae910 0x7ff8cc169f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.180+0000 7ff8c3e00640 1 --2- 172.21.15.106:0/1690942320 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8cc157640 0x7ff8cc0c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.180+0000 7ff8ca800640 1 -- 172.21.15.106:0/1690942320 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8cc157640 msgr2=0x7ff8cc0c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.180+0000 7ff8ca800640 1 --2- 172.21.15.106:0/1690942320 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8cc157640 0x7ff8cc0c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.180+0000 7ff8ca800640 1 -- 172.21.15.106:0/1690942320 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8cc0ae910 msgr2=0x7ff8cc169f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.180+0000 7ff8ca800640 1 --2- 172.21.15.106:0/1690942320 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8cc0ae910 0x7ff8cc169f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.180+0000 7ff8ca800640 1 -- 172.21.15.106:0/1690942320 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc009450 con 0x7ff8cc157a10 2024-08-17T02:28:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.180+0000 7ff8c3e00640 1 --2- 172.21.15.106:0/1690942320 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8cc157640 0x7ff8cc0c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.180+0000 7ff8ca800640 1 --2- 172.21.15.106:0/1690942320 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8cc157a10 0x7ff8cc13fe00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff8c400d180 tx=0x7ff8c4009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.180+0000 7ff8c1600640 1 -- 172.21.15.106:0/1690942320 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4015440 con 0x7ff8cc157a10 2024-08-17T02:28:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.180+0000 7ff8c1600640 1 -- 172.21.15.106:0/1690942320 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c400f040 con 0x7ff8cc157a10 2024-08-17T02:28:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.180+0000 7ff8c1600640 1 -- 172.21.15.106:0/1690942320 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4015810 con 0x7ff8cc157a10 2024-08-17T02:28:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.180+0000 7ff8d0e00640 1 -- 172.21.15.106:0/1690942320 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8cc0c8660 con 0x7ff8cc157a10 2024-08-17T02:28:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.180+0000 7ff8d0e00640 1 -- 172.21.15.106:0/1690942320 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8cc16a700 con 0x7ff8cc157a10 2024-08-17T02:28:54.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.181+0000 7ff8d0e00640 1 -- 172.21.15.106:0/1690942320 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8cc16a560 con 0x7ff8cc157a10 2024-08-17T02:28:54.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.182+0000 7ff8c1600640 1 -- 172.21.15.106:0/1690942320 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff8c401e3b0 con 0x7ff8cc157a10 2024-08-17T02:28:54.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.183+0000 7ff8c1600640 1 --2- 172.21.15.106:0/1690942320 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ff8a8065180 0x7ff8a8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:54.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.183+0000 7ff8c1600640 1 -- 172.21.15.106:0/1690942320 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7ff8c4083190 con 0x7ff8cc157a10 2024-08-17T02:28:54.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.183+0000 7ff8c9e00640 1 --2- 172.21.15.106:0/1690942320 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ff8a8065180 0x7ff8a8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:54.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.184+0000 7ff8c9e00640 1 --2- 172.21.15.106:0/1690942320 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ff8a8065180 0x7ff8a8067630 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc034000 tx=0x7ff8bc032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:54.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.187+0000 7ff8c1600640 1 -- 172.21.15.106:0/1690942320 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff8cc16a560 con 0x7ff8cc157a10 2024-08-17T02:28:54.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.359+0000 7ff8d0e00640 1 -- 172.21.15.106:0/1690942320 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7ff8cc16a560 con 0x7ff8cc157a10 2024-08-17T02:28:54.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.360+0000 7ff8c1600640 1 -- 172.21.15.106:0/1690942320 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v35) v1 ==== 97+0+8050 (secure 0 0 0) 0x7ff8cc16a560 con 0x7ff8cc157a10 2024-08-17T02:28:54.362 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.362+0000 7ff8d0e00640 1 -- 172.21.15.106:0/1690942320 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ff8a8065180 msgr2=0x7ff8a8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.362+0000 7ff8d0e00640 1 --2- 172.21.15.106:0/1690942320 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ff8a8065180 0x7ff8a8067630 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc034000 tx=0x7ff8bc032000 comp rx=0 tx=0).stop 2024-08-17T02:28:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.362+0000 7ff8d0e00640 1 -- 172.21.15.106:0/1690942320 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8cc157a10 msgr2=0x7ff8cc13fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.362+0000 7ff8d0e00640 1 --2- 172.21.15.106:0/1690942320 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8cc157a10 0x7ff8cc13fe00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff8c400d180 tx=0x7ff8c4009a50 comp rx=0 tx=0).stop 2024-08-17T02:28:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.362+0000 7ff8d0e00640 1 -- 172.21.15.106:0/1690942320 shutdown_connections 2024-08-17T02:28:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.362+0000 7ff8d0e00640 1 --2- 172.21.15.106:0/1690942320 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ff8a8065180 0x7ff8a8067630 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.362+0000 7ff8d0e00640 1 --2- 172.21.15.106:0/1690942320 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8cc157a10 0x7ff8cc13fe00 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.362+0000 7ff8d0e00640 1 --2- 172.21.15.106:0/1690942320 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff8cc157640 0x7ff8cc0c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.362+0000 7ff8d0e00640 1 --2- 172.21.15.106:0/1690942320 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8cc0ae910 0x7ff8cc169f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.362+0000 7ff8d0e00640 1 -- 172.21.15.106:0/1690942320 >> 172.21.15.106:0/1690942320 conn(0x7ff8cc0cca50 msgr2=0x7ff8cc0697e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.362+0000 7ff8d0e00640 1 -- 172.21.15.106:0/1690942320 shutdown_connections 2024-08-17T02:28:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.362+0000 7ff8d0e00640 1 -- 172.21.15.106:0/1690942320 wait complete. 2024-08-17T02:28:54.379 INFO:teuthology.orchestra.run.smithi106.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:37.880632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:38.897913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool_id":6,"pool_name":"cephfs.volume_0000000000123149.meta","create_time":"2024-08-17T02:28:50.720877+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000123149"}}},{"pool_id":7,"pool_name":"cephfs.volume_0000000000123149.data","create_time":"2024-08-17T02:28:51.638596+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000123149"}}}] 2024-08-17T02:28:54.379 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get volume_0000000000123149 --format=json 2024-08-17T02:28:54.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.528+0000 7f6beac00640 1 Processor -- start 2024-08-17T02:28:54.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.528+0000 7f6beac00640 1 -- start start 2024-08-17T02:28:54.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.529+0000 7f6beac00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6be40aa7d0 0x7f6be406ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:54.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.529+0000 7f6beac00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6be4158fa0 0x7f6be40ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:54.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.529+0000 7f6beac00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be40a9a10 con 0x7f6be406da20 2024-08-17T02:28:54.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.529+0000 7f6beac00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be40ac400 con 0x7f6be4158fa0 2024-08-17T02:28:54.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.529+0000 7f6beac00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be40a9cf0 con 0x7f6be40aa7d0 2024-08-17T02:28:54.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.530+0000 7f6be3e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6be406da20 0x7f6be4158890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41986/0 (socket says 172.21.15.106:41986) 2024-08-17T02:28:54.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.530+0000 7f6be3e00640 1 -- 172.21.15.106:0/3888457973 learned_addr learned my addr 172.21.15.106:0/3888457973 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:28:54.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.530+0000 7f6be3400640 1 --2- 172.21.15.106:0/3888457973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6be40aa7d0 0x7f6be406ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:54.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.530+0000 7f6be8c00640 1 --2- 172.21.15.106:0/3888457973 >> v2:172.21.15.171:3300/0 conn(0x7f6be4158fa0 0x7f6be40ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:54.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.530+0000 7f6be2a00640 1 -- 172.21.15.106:0/3888457973 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438213409 0 0) 0x7f6be40a9a10 con 0x7f6be406da20 2024-08-17T02:28:54.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.530+0000 7f6be2a00640 1 -- 172.21.15.106:0/3888457973 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bc80034e0 con 0x7f6be406da20 2024-08-17T02:28:54.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.530+0000 7f6be2a00640 1 -- 172.21.15.106:0/3888457973 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2270998159 0 0) 0x7f6bc80034e0 con 0x7f6be406da20 2024-08-17T02:28:54.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.530+0000 7f6be2a00640 1 -- 172.21.15.106:0/3888457973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6be40aa7d0 msgr2=0x7f6be406ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:54.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.530+0000 7f6be2a00640 1 --2- 172.21.15.106:0/3888457973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6be40aa7d0 0x7f6be406ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.530+0000 7f6be2a00640 1 -- 172.21.15.106:0/3888457973 >> v2:172.21.15.171:3300/0 conn(0x7f6be4158fa0 msgr2=0x7f6be40ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:54.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.530+0000 7f6be2a00640 1 --2- 172.21.15.106:0/3888457973 >> v2:172.21.15.171:3300/0 conn(0x7f6be4158fa0 0x7f6be40ab6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.530+0000 7f6be2a00640 1 -- 172.21.15.106:0/3888457973 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be40a9fd0 con 0x7f6be406da20 2024-08-17T02:28:54.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.530+0000 7f6be2a00640 1 -- 172.21.15.106:0/3888457973 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7f6bd4001470 con 0x7f6be406da20 2024-08-17T02:28:54.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.530+0000 7f6be8c00640 1 --2- 172.21.15.106:0/3888457973 >> v2:172.21.15.171:3300/0 conn(0x7f6be4158fa0 0x7f6be40ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:54.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.530+0000 7f6be2a00640 1 -- 172.21.15.106:0/3888457973 >> v1:172.21.15.106:6789/0 conn(0x7f6be406da20 legacy=0x7f6be4158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:54.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.530+0000 7f6be2a00640 1 --2- 172.21.15.106:0/3888457973 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6bc80039d0 0x7f6bc8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:54.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.530+0000 7f6be2a00640 1 --2- 172.21.15.106:0/3888457973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6be40aa7d0 0x7f6bc8004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:54.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.531+0000 7f6be2a00640 1 --2- 172.21.15.106:0/3888457973 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6bc8004cc0 0x7f6bc8005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:54.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.531+0000 7f6be2a00640 1 -- 172.21.15.106:0/3888457973 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be40ac400 con 0x7f6bc80039d0 2024-08-17T02:28:54.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.531+0000 7f6be2a00640 1 -- 172.21.15.106:0/3888457973 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be40a9cf0 con 0x7f6bc8004cc0 2024-08-17T02:28:54.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.531+0000 7f6be2a00640 1 -- 172.21.15.106:0/3888457973 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc800b9d0 con 0x7f6be40aa7d0 2024-08-17T02:28:54.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.531+0000 7f6be3e00640 1 --2- 172.21.15.106:0/3888457973 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6bc80039d0 0x7f6bc8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:54.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.531+0000 7f6be3400640 1 --2- 172.21.15.106:0/3888457973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6be40aa7d0 0x7f6bc8004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:54.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.531+0000 7f6be8c00640 1 --2- 172.21.15.106:0/3888457973 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6bc8004cc0 0x7f6bc8005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:54.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.531+0000 7f6be3e00640 1 -- 172.21.15.106:0/3888457973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6be40aa7d0 msgr2=0x7f6bc8004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:54.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.531+0000 7f6be3e00640 1 --2- 172.21.15.106:0/3888457973 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6be40aa7d0 0x7f6bc8004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.531+0000 7f6be3e00640 1 -- 172.21.15.106:0/3888457973 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6bc8004cc0 msgr2=0x7f6bc8005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:54.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.531+0000 7f6be3e00640 1 --2- 172.21.15.106:0/3888457973 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6bc8004cc0 0x7f6bc8005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.531+0000 7f6be3e00640 1 -- 172.21.15.106:0/3888457973 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc80034e0 con 0x7f6bc80039d0 2024-08-17T02:28:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.532+0000 7f6be3e00640 1 --2- 172.21.15.106:0/3888457973 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6bc80039d0 0x7f6bc8003de0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6bd400c2a0 tx=0x7f6bd4001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83041dcc7a72948c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.532+0000 7f6be2a00640 1 -- 172.21.15.106:0/3888457973 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd4005890 con 0x7f6bc80039d0 2024-08-17T02:28:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.532+0000 7f6be2a00640 1 -- 172.21.15.106:0/3888457973 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd4005a30 con 0x7f6bc80039d0 2024-08-17T02:28:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.532+0000 7f6be2a00640 1 -- 172.21.15.106:0/3888457973 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd4005e30 con 0x7f6bc80039d0 2024-08-17T02:28:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.533+0000 7f6beac00640 1 -- 172.21.15.106:0/3888457973 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6bc80039d0 msgr2=0x7f6bc8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.533+0000 7f6beac00640 1 --2- 172.21.15.106:0/3888457973 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6bc80039d0 0x7f6bc8003de0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6bd400c2a0 tx=0x7f6bd4001e90 comp rx=0 tx=0).stop 2024-08-17T02:28:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.533+0000 7f6be8c00640 1 -- 172.21.15.106:0/3888457973 reap_dead start 2024-08-17T02:28:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.533+0000 7f6beac00640 1 -- 172.21.15.106:0/3888457973 shutdown_connections 2024-08-17T02:28:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.533+0000 7f6beac00640 1 -- 172.21.15.106:0/3888457973 >> 172.21.15.106:0/3888457973 conn(0x7f6be40cb9b0 msgr2=0x7f6be40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.533+0000 7f6beac00640 1 -- 172.21.15.106:0/3888457973 shutdown_connections 2024-08-17T02:28:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.533+0000 7f6beac00640 1 -- 172.21.15.106:0/3888457973 wait complete. 2024-08-17T02:28:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.534+0000 7f6beac00640 1 Processor -- start 2024-08-17T02:28:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.535+0000 7f6beac00640 1 -- start start 2024-08-17T02:28:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.535+0000 7f6beac00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bc80039d0 0x7f6be4152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.535+0000 7f6beac00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6be415e970 0x7f6be414b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.535+0000 7f6beac00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6be4154c10 0x7f6be41550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.536+0000 7f6beac00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be41555f0 con 0x7f6be415e970 2024-08-17T02:28:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.536+0000 7f6beac00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be41560e0 con 0x7f6be4154c10 2024-08-17T02:28:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.536+0000 7f6beac00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be415f110 con 0x7f6bc80039d0 2024-08-17T02:28:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.536+0000 7f6be3400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6be415e970 0x7f6be414b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.536+0000 7f6be3400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6be415e970 0x7f6be414b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59614/0 (socket says 172.21.15.106:59614) 2024-08-17T02:28:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.536+0000 7f6be3400640 1 -- 172.21.15.106:0/421832329 learned_addr learned my addr 172.21.15.106:0/421832329 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.536+0000 7f6be8c00640 1 --2- 172.21.15.106:0/421832329 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6be4154c10 0x7f6be41550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.536+0000 7f6be3e00640 1 --2- 172.21.15.106:0/421832329 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bc80039d0 0x7f6be4152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.536+0000 7f6be3400640 1 -- 172.21.15.106:0/421832329 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bc80039d0 msgr2=0x7f6be4152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:54.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.536+0000 7f6be3400640 1 --2- 172.21.15.106:0/421832329 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bc80039d0 0x7f6be4152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.536+0000 7f6be3400640 1 -- 172.21.15.106:0/421832329 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6be4154c10 msgr2=0x7f6be41550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:54.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.536+0000 7f6be3400640 1 --2- 172.21.15.106:0/421832329 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6be4154c10 0x7f6be41550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.536+0000 7f6be3400640 1 -- 172.21.15.106:0/421832329 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be4156380 con 0x7f6be415e970 2024-08-17T02:28:54.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.536+0000 7f6be3400640 1 --2- 172.21.15.106:0/421832329 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6be415e970 0x7f6be414b360 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0011b40 tx=0x7f6bd00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:54.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.537+0000 7f6bdb400640 1 -- 172.21.15.106:0/421832329 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd000fa80 con 0x7f6be415e970 2024-08-17T02:28:54.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.537+0000 7f6bdb400640 1 -- 172.21.15.106:0/421832329 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd000fbe0 con 0x7f6be415e970 2024-08-17T02:28:54.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.537+0000 7f6beac00640 1 -- 172.21.15.106:0/421832329 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be4156660 con 0x7f6be415e970 2024-08-17T02:28:54.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.537+0000 7f6bdb400640 1 -- 172.21.15.106:0/421832329 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0014440 con 0x7f6be415e970 2024-08-17T02:28:54.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.537+0000 7f6beac00640 1 -- 172.21.15.106:0/421832329 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be415ede0 con 0x7f6be415e970 2024-08-17T02:28:54.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.538+0000 7f6beac00640 1 -- 172.21.15.106:0/421832329 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be4064db0 con 0x7f6be415e970 2024-08-17T02:28:54.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.539+0000 7f6bdb400640 1 -- 172.21.15.106:0/421832329 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6bd00147b0 con 0x7f6be415e970 2024-08-17T02:28:54.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.540+0000 7f6bdb400640 1 --2- 172.21.15.106:0/421832329 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6bc4065180 0x7f6bc4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:54.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.540+0000 7f6bdb400640 1 -- 172.21.15.106:0/421832329 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f6bd0018030 con 0x7f6be415e970 2024-08-17T02:28:54.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.540+0000 7f6be3e00640 1 --2- 172.21.15.106:0/421832329 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6bc4065180 0x7f6bc4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:54.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.541+0000 7f6be3e00640 1 --2- 172.21.15.106:0/421832329 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6bc4065180 0x7f6bc4067630 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4033000 tx=0x7f6bd4034000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:54.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.544+0000 7f6bdb400640 1 -- 172.21.15.106:0/421832329 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6bd0050f60 con 0x7f6be415e970 2024-08-17T02:28:54.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.768+0000 7f6beac00640 1 -- 172.21.15.106:0/421832329 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs get", "fs_name": "volume_0000000000123149", "format": "json"} v 0) v1 -- 0x7f6be406c360 con 0x7f6be415e970 2024-08-17T02:28:54.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.769+0000 7f6bdb400640 1 -- 172.21.15.106:0/421832329 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "volume_0000000000123149", "format": "json"}]=0 v20) v1 ==== 110+0+1847 (secure 0 0 0) 0x7f6bd00220b0 con 0x7f6be415e970 2024-08-17T02:28:54.771 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:28:54.771 INFO:teuthology.orchestra.run.smithi106.stdout:{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:52.606548+0000","modified":"2024-08-17T02:28:54.512181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4909},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4909":{"gid":4909,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.171:6835/3251295288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6833","nonce":3251295288},{"type":"v1","addr":"172.21.15.171:6835","nonce":3251295288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000123149","balancer":"","standby_count_wanted":1},"id":3} 2024-08-17T02:28:54.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.771+0000 7f6beac00640 1 -- 172.21.15.106:0/421832329 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6bc4065180 msgr2=0x7f6bc4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:54.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.771+0000 7f6beac00640 1 --2- 172.21.15.106:0/421832329 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6bc4065180 0x7f6bc4067630 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4033000 tx=0x7f6bd4034000 comp rx=0 tx=0).stop 2024-08-17T02:28:54.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.771+0000 7f6beac00640 1 -- 172.21.15.106:0/421832329 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6be415e970 msgr2=0x7f6be414b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:54.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.771+0000 7f6beac00640 1 --2- 172.21.15.106:0/421832329 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6be415e970 0x7f6be414b360 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0011b40 tx=0x7f6bd00090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.771+0000 7f6beac00640 1 -- 172.21.15.106:0/421832329 shutdown_connections 2024-08-17T02:28:54.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.771+0000 7f6beac00640 1 --2- 172.21.15.106:0/421832329 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6be4154c10 0x7f6be41550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.771+0000 7f6beac00640 1 --2- 172.21.15.106:0/421832329 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6bc4065180 0x7f6bc4067630 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.771+0000 7f6beac00640 1 --2- 172.21.15.106:0/421832329 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6be415e970 0x7f6be414b360 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.771+0000 7f6beac00640 1 --2- 172.21.15.106:0/421832329 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bc80039d0 0x7f6be4152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.771+0000 7f6beac00640 1 -- 172.21.15.106:0/421832329 >> 172.21.15.106:0/421832329 conn(0x7f6be40cb9b0 msgr2=0x7f6be40ac5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:54.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.771+0000 7f6beac00640 1 -- 172.21.15.106:0/421832329 shutdown_connections 2024-08-17T02:28:54.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.771+0000 7f6beac00640 1 -- 172.21.15.106:0/421832329 wait complete. 2024-08-17T02:28:54.787 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000123149 --yes-i-really-mean-it 2024-08-17T02:28:54.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.936+0000 7f0d25600640 1 Processor -- start 2024-08-17T02:28:54.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.936+0000 7f0d25600640 1 -- start start 2024-08-17T02:28:54.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.938+0000 7f0d25600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0d20158ce0 0x7f0d2006a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:54.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.938+0000 7f0d25600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d200c92e0 0x7f0d200aee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:54.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.938+0000 7f0d25600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2006d790 con 0x7f0d201590b0 2024-08-17T02:28:54.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.938+0000 7f0d25600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2006a730 con 0x7f0d20158ce0 2024-08-17T02:28:54.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.938+0000 7f0d25600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2006cb80 con 0x7f0d200c92e0 2024-08-17T02:28:54.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.938+0000 7f0d1ea00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0d20158ce0 0x7f0d2006a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:54.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.938+0000 7f0d1ea00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0d20158ce0 0x7f0d2006a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59630/0 (socket says 172.21.15.106:59630) 2024-08-17T02:28:54.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.938+0000 7f0d1ea00640 1 -- 172.21.15.106:0/3951140729 learned_addr learned my addr 172.21.15.106:0/3951140729 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:54.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.938+0000 7f0d1f400640 1 --2- 172.21.15.106:0/3951140729 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d200c92e0 0x7f0d200aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:54.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.938+0000 7f0d1ea00640 1 -- 172.21.15.106:0/3951140729 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d200c92e0 msgr2=0x7f0d200aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:54.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.938+0000 7f0d1ea00640 1 --2- 172.21.15.106:0/3951140729 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d200c92e0 0x7f0d200aee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.938+0000 7f0d1ea00640 1 -- 172.21.15.106:0/3951140729 >> v1:172.21.15.171:6789/0 conn(0x7f0d201590b0 legacy=0x7f0d200c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:54.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.938+0000 7f0d1ea00640 1 -- 172.21.15.106:0/3951140729 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2006ce60 con 0x7f0d20158ce0 2024-08-17T02:28:54.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.939+0000 7f0d1ea00640 1 --2- 172.21.15.106:0/3951140729 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d20158ce0 0x7f0d2006a1f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009910 tx=0x7f0d100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64dcf38eb8820265 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:54.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.940+0000 7f0d1d600640 1 -- 172.21.15.106:0/3951140729 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1002ae40 con 0x7f0d20158ce0 2024-08-17T02:28:54.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.940+0000 7f0d1d600640 1 -- 172.21.15.106:0/3951140729 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d10032440 con 0x7f0d20158ce0 2024-08-17T02:28:54.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.940+0000 7f0d1d600640 1 -- 172.21.15.106:0/3951140729 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d10032820 con 0x7f0d20158ce0 2024-08-17T02:28:54.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.940+0000 7f0d25600640 1 -- 172.21.15.106:0/3951140729 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d20158ce0 msgr2=0x7f0d2006a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:54.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.940+0000 7f0d25600640 1 --2- 172.21.15.106:0/3951140729 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d20158ce0 0x7f0d2006a1f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009910 tx=0x7f0d100091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.940+0000 7f0d25600640 1 -- 172.21.15.106:0/3951140729 shutdown_connections 2024-08-17T02:28:54.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.940+0000 7f0d25600640 1 --2- 172.21.15.106:0/3951140729 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d200c92e0 0x7f0d200aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.940+0000 7f0d25600640 1 --2- 172.21.15.106:0/3951140729 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d20158ce0 0x7f0d2006a1f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.940+0000 7f0d25600640 1 -- 172.21.15.106:0/3951140729 >> 172.21.15.106:0/3951140729 conn(0x7f0d20067750 msgr2=0x7f0d200c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:54.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.940+0000 7f0d25600640 1 -- 172.21.15.106:0/3951140729 shutdown_connections 2024-08-17T02:28:54.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.940+0000 7f0d25600640 1 -- 172.21.15.106:0/3951140729 wait complete. 2024-08-17T02:28:54.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.942+0000 7f0d25600640 1 Processor -- start 2024-08-17T02:28:54.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.942+0000 7f0d25600640 1 -- start start 2024-08-17T02:28:54.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.943+0000 7f0d25600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d200c92e0 0x7f0d20159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:54.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.943+0000 7f0d25600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d20158ce0 0x7f0d200af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:54.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.943+0000 7f0d25600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d201590b0 0x7f0d20145f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:54.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.943+0000 7f0d25600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2015d3e0 con 0x7f0d20158ce0 2024-08-17T02:28:54.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.943+0000 7f0d25600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2015cb40 con 0x7f0d201590b0 2024-08-17T02:28:54.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.943+0000 7f0d25600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2015ce20 con 0x7f0d200c92e0 2024-08-17T02:28:54.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.943+0000 7f0d1e000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d20158ce0 0x7f0d200af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:54.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.943+0000 7f0d1e000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d20158ce0 0x7f0d200af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59634/0 (socket says 172.21.15.106:59634) 2024-08-17T02:28:54.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.943+0000 7f0d1e000640 1 -- 172.21.15.106:0/2615060967 learned_addr learned my addr 172.21.15.106:0/2615060967 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:28:54.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.943+0000 7f0d1f400640 1 --2- 172.21.15.106:0/2615060967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d201590b0 0x7f0d20145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:54.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.943+0000 7f0d1ea00640 1 --2- 172.21.15.106:0/2615060967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d200c92e0 0x7f0d20159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:54.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.943+0000 7f0d1e000640 1 -- 172.21.15.106:0/2615060967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d200c92e0 msgr2=0x7f0d20159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:54.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.943+0000 7f0d1e000640 1 --2- 172.21.15.106:0/2615060967 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d200c92e0 0x7f0d20159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.943+0000 7f0d1e000640 1 -- 172.21.15.106:0/2615060967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d201590b0 msgr2=0x7f0d20145f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:54.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.943+0000 7f0d1e000640 1 --2- 172.21.15.106:0/2615060967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d201590b0 0x7f0d20145f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.943+0000 7f0d1e000640 1 -- 172.21.15.106:0/2615060967 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d10009450 con 0x7f0d20158ce0 2024-08-17T02:28:54.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.943+0000 7f0d1f400640 1 --2- 172.21.15.106:0/2615060967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d201590b0 0x7f0d20145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:54.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.944+0000 7f0d1e000640 1 --2- 172.21.15.106:0/2615060967 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d20158ce0 0x7f0d200af030 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00c4c0 tx=0x7f0d0c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:54.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.944+0000 7f0d16000640 1 -- 172.21.15.106:0/2615060967 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c011590 con 0x7f0d20158ce0 2024-08-17T02:28:54.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.944+0000 7f0d16000640 1 -- 172.21.15.106:0/2615060967 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0c011710 con 0x7f0d20158ce0 2024-08-17T02:28:54.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.944+0000 7f0d16000640 1 -- 172.21.15.106:0/2615060967 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c011ad0 con 0x7f0d20158ce0 2024-08-17T02:28:54.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.944+0000 7f0d25600640 1 -- 172.21.15.106:0/2615060967 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d2015d100 con 0x7f0d20158ce0 2024-08-17T02:28:54.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.944+0000 7f0d25600640 1 -- 172.21.15.106:0/2615060967 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2015a500 con 0x7f0d20158ce0 2024-08-17T02:28:54.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.945+0000 7f0d25600640 1 -- 172.21.15.106:0/2615060967 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d20071050 con 0x7f0d20158ce0 2024-08-17T02:28:54.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.946+0000 7f0d16000640 1 -- 172.21.15.106:0/2615060967 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0d0c01b3b0 con 0x7f0d20158ce0 2024-08-17T02:28:54.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.947+0000 7f0d16000640 1 --2- 172.21.15.106:0/2615060967 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0d00065150 0x7f0d00067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:54.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.947+0000 7f0d16000640 1 -- 172.21.15.106:0/2615060967 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f0d0c081be0 con 0x7f0d20158ce0 2024-08-17T02:28:54.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.947+0000 7f0d1ea00640 1 --2- 172.21.15.106:0/2615060967 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0d00065150 0x7f0d00067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:54.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.948+0000 7f0d1ea00640 1 --2- 172.21.15.106:0/2615060967 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0d00065150 0x7f0d00067600 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0d10034000 tx=0x7f0d10032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:54.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:54.951+0000 7f0d16000640 1 -- 172.21.15.106:0/2615060967 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0d0c04f9d0 con 0x7f0d20158ce0 2024-08-17T02:28:55.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:28:55.144+0000 7f0d25600640 1 -- 172.21.15.106:0/2615060967 --> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000123149", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d2006a910 con 0x7f0d00065150 2024-08-17T02:28:59.491 INFO:tasks.ceph.mds.d.smithi171.stderr:2024-08-17T02:28:59.490+0000 7effe8600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:29:11.435 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:11.440 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:41.536 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:41.541 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:11.635 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:11.640 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:41.739 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:41.744 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:54.855 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-08-17T02:30:54.856 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:30:54.857 DEBUG:teuthology.orchestra.run.smithi106:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:30:54.951 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:30:55.044 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:30:55.044 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:30:55.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:30:55.044 DEBUG:teuthology.orchestra.run.smithi106:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-17T02:30:55.111 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2024-08-17T02:30:55.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:55.112 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:30:55.148 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:30:55.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:30:55.148 DEBUG:teuthology.orchestra.run.smithi171:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-08-17T02:30:55.214 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2024-08-17T02:30:55.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:55.214 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:30:55.250 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:55.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.398+0000 7f290bc00640 1 Processor -- start 2024-08-17T02:30:55.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.398+0000 7f290bc00640 1 -- start start 2024-08-17T02:30:55.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.399+0000 7f290bc00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f290406da20 0x7f290406ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.399+0000 7f290bc00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2904158fa0 0x7f29040ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.399+0000 7f290bc00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29040a9a10 con 0x7f29040aa7d0 2024-08-17T02:30:55.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.399+0000 7f290bc00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29040ac400 con 0x7f2904158fa0 2024-08-17T02:30:55.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.399+0000 7f290bc00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29040a9cf0 con 0x7f290406da20 2024-08-17T02:30:55.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.400+0000 7f2909c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2904158fa0 0x7f29040ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.400+0000 7f2909200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f290406da20 0x7f290406ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.400+0000 7f2909c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2904158fa0 0x7f29040ab6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:49504/0 (socket says 172.21.15.106:49504) 2024-08-17T02:30:55.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.400+0000 7f2909c00640 1 -- 172.21.15.106:0/1515797334 learned_addr learned my addr 172.21.15.106:0/1515797334 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:30:55.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.400+0000 7f2909c00640 1 -- 172.21.15.106:0/1515797334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f290406da20 msgr2=0x7f290406ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:55.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.400+0000 7f2909c00640 1 --2- 172.21.15.106:0/1515797334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f290406da20 0x7f290406ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.400+0000 7f2909c00640 1 -- 172.21.15.106:0/1515797334 >> v1:172.21.15.171:6789/0 conn(0x7f29040aa7d0 legacy=0x7f2904158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.400+0000 7f2909c00640 1 -- 172.21.15.106:0/1515797334 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29040a9fd0 con 0x7f2904158fa0 2024-08-17T02:30:55.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.400+0000 7f2909200640 1 --2- 172.21.15.106:0/1515797334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f290406da20 0x7f290406ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:30:55.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.401+0000 7f2909c00640 1 --2- 172.21.15.106:0/1515797334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2904158fa0 0x7f29040ab6d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f28fc009f20 tx=0x7f28fc009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c77e8b0b6bc456e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:55.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.402+0000 7f2903400640 1 -- 172.21.15.106:0/1515797334 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28fc031400 con 0x7f2904158fa0 2024-08-17T02:30:55.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.402+0000 7f2903400640 1 -- 172.21.15.106:0/1515797334 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28fc02d050 con 0x7f2904158fa0 2024-08-17T02:30:55.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.402+0000 7f2903400640 1 -- 172.21.15.106:0/1515797334 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28fc0317d0 con 0x7f2904158fa0 2024-08-17T02:30:55.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.402+0000 7f290bc00640 1 -- 172.21.15.106:0/1515797334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2904158fa0 msgr2=0x7f29040ab6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.402+0000 7f290bc00640 1 --2- 172.21.15.106:0/1515797334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2904158fa0 0x7f29040ab6d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f28fc009f20 tx=0x7f28fc009840 comp rx=0 tx=0).stop 2024-08-17T02:30:55.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.402+0000 7f290bc00640 1 -- 172.21.15.106:0/1515797334 shutdown_connections 2024-08-17T02:30:55.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.402+0000 7f290bc00640 1 --2- 172.21.15.106:0/1515797334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2904158fa0 0x7f29040ab6d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.402+0000 7f290bc00640 1 --2- 172.21.15.106:0/1515797334 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f290406da20 0x7f290406ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.402+0000 7f290bc00640 1 -- 172.21.15.106:0/1515797334 >> 172.21.15.106:0/1515797334 conn(0x7f29040cb9b0 msgr2=0x7f29040cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:55.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.402+0000 7f290bc00640 1 -- 172.21.15.106:0/1515797334 shutdown_connections 2024-08-17T02:30:55.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.402+0000 7f290bc00640 1 -- 172.21.15.106:0/1515797334 wait complete. 2024-08-17T02:30:55.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.404+0000 7f290bc00640 1 Processor -- start 2024-08-17T02:30:55.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.404+0000 7f290bc00640 1 -- start start 2024-08-17T02:30:55.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.405+0000 7f290bc00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f290406da20 0x7f290415d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.405+0000 7f290bc00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29040aa7d0 0x7f29041593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.405+0000 7f290bc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2904158fa0 0x7f290414b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.405+0000 7f290bc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290414bb70 con 0x7f2904158fa0 2024-08-17T02:30:55.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.405+0000 7f290bc00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2904156ab0 con 0x7f290406da20 2024-08-17T02:30:55.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.405+0000 7f290bc00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f290415ed00 con 0x7f29040aa7d0 2024-08-17T02:30:55.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.405+0000 7f2909c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2904158fa0 0x7f290414b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.405+0000 7f2909c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2904158fa0 0x7f290414b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38402/0 (socket says 172.21.15.106:38402) 2024-08-17T02:30:55.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.405+0000 7f2909c00640 1 -- 172.21.15.106:0/3109717343 learned_addr learned my addr 172.21.15.106:0/3109717343 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:30:55.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.405+0000 7f2903e00640 1 --2- 172.21.15.106:0/3109717343 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29040aa7d0 0x7f29041593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.405+0000 7f2909200640 1 --2- 172.21.15.106:0/3109717343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f290406da20 0x7f290415d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.406+0000 7f2909c00640 1 -- 172.21.15.106:0/3109717343 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29040aa7d0 msgr2=0x7f29041593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.406+0000 7f2909c00640 1 --2- 172.21.15.106:0/3109717343 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29040aa7d0 0x7f29041593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.406+0000 7f2909c00640 1 -- 172.21.15.106:0/3109717343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f290406da20 msgr2=0x7f290415d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.406+0000 7f2909c00640 1 --2- 172.21.15.106:0/3109717343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f290406da20 0x7f290415d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.406+0000 7f2909c00640 1 -- 172.21.15.106:0/3109717343 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f8009390 con 0x7f2904158fa0 2024-08-17T02:30:55.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.406+0000 7f2903e00640 1 --2- 172.21.15.106:0/3109717343 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29040aa7d0 0x7f29041593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:55.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.406+0000 7f2909200640 1 --2- 172.21.15.106:0/3109717343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f290406da20 0x7f290415d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:55.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.406+0000 7f2909c00640 1 --2- 172.21.15.106:0/3109717343 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2904158fa0 0x7f290414b630 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f28fc009f80 tx=0x7f28fc036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:55.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.406+0000 7f28f7e00640 1 -- 172.21.15.106:0/3109717343 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28fc008e50 con 0x7f2904158fa0 2024-08-17T02:30:55.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.406+0000 7f28f7e00640 1 -- 172.21.15.106:0/3109717343 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28fc03b410 con 0x7f2904158fa0 2024-08-17T02:30:55.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.406+0000 7f28f7e00640 1 -- 172.21.15.106:0/3109717343 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28fc03b7d0 con 0x7f2904158fa0 2024-08-17T02:30:55.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.406+0000 7f290bc00640 1 -- 172.21.15.106:0/3109717343 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28fc009ae0 con 0x7f2904158fa0 2024-08-17T02:30:55.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.406+0000 7f290bc00640 1 -- 172.21.15.106:0/3109717343 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2904156460 con 0x7f2904158fa0 2024-08-17T02:30:55.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.407+0000 7f290bc00640 1 -- 172.21.15.106:0/3109717343 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2904156c20 con 0x7f2904158fa0 2024-08-17T02:30:55.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.408+0000 7f28f7e00640 1 -- 172.21.15.106:0/3109717343 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f28fc038050 con 0x7f2904158fa0 2024-08-17T02:30:55.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.409+0000 7f28f7e00640 1 --2- 172.21.15.106:0/3109717343 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f28e4065150 0x7f28e4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.409+0000 7f28f7e00640 1 -- 172.21.15.106:0/3109717343 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f28fc0a3400 con 0x7f2904158fa0 2024-08-17T02:30:55.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.409+0000 7f2909200640 1 --2- 172.21.15.106:0/3109717343 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f28e4065150 0x7f28e4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.410+0000 7f2909200640 1 --2- 172.21.15.106:0/3109717343 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f28e4065150 0x7f28e4067600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009360 tx=0x7f28f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:55.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.413+0000 7f28f7e00640 1 -- 172.21.15.106:0/3109717343 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f28fc0710a0 con 0x7f2904158fa0 2024-08-17T02:30:55.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.623+0000 7f290bc00640 1 -- 172.21.15.106:0/3109717343 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2904064db0 con 0x7f2904158fa0 2024-08-17T02:30:55.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.623+0000 7f28f7e00640 1 -- 172.21.15.106:0/3109717343 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+5693 (secure 0 0 0) 0x7f28fc0746c0 con 0x7f2904158fa0 2024-08-17T02:30:55.624 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:30:55.624 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4900,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1137148711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1137148711},{"type":"v1","addr":"172.21.15.106:6836","nonce":1137148711}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4903,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3136131297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":3136131297},{"type":"v1","addr":"172.21.15.106:6837","nonce":3136131297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:39.908382+0000","modified":"2024-08-17T02:28:43.540030+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6834/754665763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":754665763},{"type":"v1","addr":"172.21.15.171:6834","nonce":754665763}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:52.606548+0000","modified":"2024-08-17T02:28:54.512181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4909},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4909":{"gid":4909,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.171:6835/3251295288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6833","nonce":3251295288},{"type":"v1","addr":"172.21.15.171:6835","nonce":3251295288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000123149","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:30:55.624 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 20 2024-08-17T02:30:55.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.625+0000 7f290bc00640 1 -- 172.21.15.106:0/3109717343 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f28e4065150 msgr2=0x7f28e4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.625+0000 7f290bc00640 1 --2- 172.21.15.106:0/3109717343 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f28e4065150 0x7f28e4067600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009360 tx=0x7f28f8008040 comp rx=0 tx=0).stop 2024-08-17T02:30:55.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.625+0000 7f290bc00640 1 -- 172.21.15.106:0/3109717343 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2904158fa0 msgr2=0x7f290414b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.625+0000 7f290bc00640 1 --2- 172.21.15.106:0/3109717343 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2904158fa0 0x7f290414b630 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f28fc009f80 tx=0x7f28fc036000 comp rx=0 tx=0).stop 2024-08-17T02:30:55.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.625+0000 7f290bc00640 1 -- 172.21.15.106:0/3109717343 shutdown_connections 2024-08-17T02:30:55.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.625+0000 7f290bc00640 1 --2- 172.21.15.106:0/3109717343 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f28e4065150 0x7f28e4067600 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.625+0000 7f290bc00640 1 --2- 172.21.15.106:0/3109717343 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2904158fa0 0x7f290414b630 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.625+0000 7f290bc00640 1 --2- 172.21.15.106:0/3109717343 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f29040aa7d0 0x7f29041593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.625+0000 7f290bc00640 1 --2- 172.21.15.106:0/3109717343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f290406da20 0x7f290415d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.625+0000 7f290bc00640 1 -- 172.21.15.106:0/3109717343 >> 172.21.15.106:0/3109717343 conn(0x7f29040cb9b0 msgr2=0x7f2904153930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:55.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.626+0000 7f290bc00640 1 -- 172.21.15.106:0/3109717343 shutdown_connections 2024-08-17T02:30:55.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.626+0000 7f290bc00640 1 -- 172.21.15.106:0/3109717343 wait complete. 2024-08-17T02:30:55.641 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:30:55.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.789+0000 7f88ab000640 1 Processor -- start 2024-08-17T02:30:55.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.789+0000 7f88ab000640 1 -- start start 2024-08-17T02:30:55.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.790+0000 7f88ab000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f88a40cc430 0x7f88a40cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.790+0000 7f88ab000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88a4062da0 0x7f88a4067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.790+0000 7f88ab000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f88a4159820 0x7f88a40cab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.790+0000 7f88ab000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a40ca700 con 0x7f88a40cc430 2024-08-17T02:30:55.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.790+0000 7f88ab000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a40684f0 con 0x7f88a4159820 2024-08-17T02:30:55.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.790+0000 7f88ab000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a40c9dd0 con 0x7f88a4062da0 2024-08-17T02:30:55.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.790+0000 7f88a3e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f88a40cc430 0x7f88a40cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.790+0000 7f88a3e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f88a40cc430 0x7f88a40cc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38412/0 (socket says 172.21.15.106:38412) 2024-08-17T02:30:55.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.791+0000 7f88a3e00640 1 -- 172.21.15.106:0/1516043717 learned_addr learned my addr 172.21.15.106:0/1516043717 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:30:55.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.791+0000 7f88a3400640 1 --2- 172.21.15.106:0/1516043717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88a4062da0 0x7f88a4067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.791+0000 7f88a9000640 1 --2- 172.21.15.106:0/1516043717 >> v2:172.21.15.171:3300/0 conn(0x7f88a4159820 0x7f88a40cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.791+0000 7f88a3e00640 1 -- 172.21.15.106:0/1516043717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88a4062da0 msgr2=0x7f88a4067ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:55.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.791+0000 7f88a3e00640 1 --2- 172.21.15.106:0/1516043717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88a4062da0 0x7f88a4067ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.791+0000 7f88a3e00640 1 -- 172.21.15.106:0/1516043717 >> v2:172.21.15.171:3300/0 conn(0x7f88a4159820 msgr2=0x7f88a40cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:55.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.791+0000 7f88a3e00640 1 --2- 172.21.15.106:0/1516043717 >> v2:172.21.15.171:3300/0 conn(0x7f88a4159820 0x7f88a40cab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.791+0000 7f88a3e00640 1 -- 172.21.15.106:0/1516043717 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a40ca0b0 con 0x7f88a40cc430 2024-08-17T02:30:55.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.791+0000 7f88a9000640 1 --2- 172.21.15.106:0/1516043717 >> v2:172.21.15.171:3300/0 conn(0x7f88a4159820 0x7f88a40cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:55.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.791+0000 7f88a3400640 1 --2- 172.21.15.106:0/1516043717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88a4062da0 0x7f88a4067ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:55.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.792+0000 7f88a3e00640 1 --2- 172.21.15.106:0/1516043717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88a40cc430 0x7f88a40cc800 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f88a406be60 tx=0x7f88940091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2748b6cf90c7cdf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:55.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.792+0000 7f88a2a00640 1 -- 172.21.15.106:0/1516043717 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889402ad40 con 0x7f88a40cc430 2024-08-17T02:30:55.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.792+0000 7f88a2a00640 1 -- 172.21.15.106:0/1516043717 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8894032440 con 0x7f88a40cc430 2024-08-17T02:30:55.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.792+0000 7f88a2a00640 1 -- 172.21.15.106:0/1516043717 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889402aea0 con 0x7f88a40cc430 2024-08-17T02:30:55.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.793+0000 7f88ab000640 1 -- 172.21.15.106:0/1516043717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88a40cc430 msgr2=0x7f88a40cc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.793+0000 7f88ab000640 1 --2- 172.21.15.106:0/1516043717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88a40cc430 0x7f88a40cc800 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f88a406be60 tx=0x7f88940091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.793+0000 7f88ab000640 1 -- 172.21.15.106:0/1516043717 shutdown_connections 2024-08-17T02:30:55.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.793+0000 7f88ab000640 1 --2- 172.21.15.106:0/1516043717 >> v2:172.21.15.171:3300/0 conn(0x7f88a4159820 0x7f88a40cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.793+0000 7f88ab000640 1 --2- 172.21.15.106:0/1516043717 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88a4062da0 0x7f88a4067ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.793+0000 7f88ab000640 1 --2- 172.21.15.106:0/1516043717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88a40cc430 0x7f88a40cc800 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.793+0000 7f88ab000640 1 -- 172.21.15.106:0/1516043717 >> 172.21.15.106:0/1516043717 conn(0x7f88a40afc30 msgr2=0x7f88a40b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:55.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.793+0000 7f88ab000640 1 -- 172.21.15.106:0/1516043717 shutdown_connections 2024-08-17T02:30:55.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.793+0000 7f88ab000640 1 -- 172.21.15.106:0/1516043717 wait complete. 2024-08-17T02:30:55.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.794+0000 7f88ab000640 1 Processor -- start 2024-08-17T02:30:55.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.794+0000 7f88ab000640 1 -- start start 2024-08-17T02:30:55.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.795+0000 7f88ab000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88a4062da0 0x7f88a414f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.795+0000 7f88ab000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88a40cc430 0x7f88a414ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.795+0000 7f88ab000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88a4159820 0x7f88a4152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.795+0000 7f88ab000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a4150dc0 con 0x7f88a4062da0 2024-08-17T02:30:55.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.795+0000 7f88ab000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a41501b0 con 0x7f88a4159820 2024-08-17T02:30:55.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.795+0000 7f88ab000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a4150490 con 0x7f88a40cc430 2024-08-17T02:30:55.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.795+0000 7f88a3e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88a4062da0 0x7f88a414f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.795+0000 7f88a3e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88a4062da0 0x7f88a414f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38428/0 (socket says 172.21.15.106:38428) 2024-08-17T02:30:55.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.795+0000 7f88a3e00640 1 -- 172.21.15.106:0/3151462678 learned_addr learned my addr 172.21.15.106:0/3151462678 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:30:55.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.796+0000 7f88a3400640 1 --2- 172.21.15.106:0/3151462678 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88a40cc430 0x7f88a414ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.796+0000 7f88a9000640 1 --2- 172.21.15.106:0/3151462678 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88a4159820 0x7f88a4152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.796+0000 7f88a3e00640 1 -- 172.21.15.106:0/3151462678 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88a40cc430 msgr2=0x7f88a414ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.796+0000 7f88a3e00640 1 --2- 172.21.15.106:0/3151462678 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88a40cc430 0x7f88a414ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.796+0000 7f88a3e00640 1 -- 172.21.15.106:0/3151462678 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88a4159820 msgr2=0x7f88a4152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.796+0000 7f88a3e00640 1 --2- 172.21.15.106:0/3151462678 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88a4159820 0x7f88a4152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.796+0000 7f88a3e00640 1 -- 172.21.15.106:0/3151462678 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8894009450 con 0x7f88a4062da0 2024-08-17T02:30:55.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.796+0000 7f88a3e00640 1 --2- 172.21.15.106:0/3151462678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88a4062da0 0x7f88a414f840 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8894035040 tx=0x7f8894032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:55.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.796+0000 7f889b400640 1 -- 172.21.15.106:0/3151462678 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8894031a60 con 0x7f88a4062da0 2024-08-17T02:30:55.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.796+0000 7f889b400640 1 -- 172.21.15.106:0/3151462678 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8894031be0 con 0x7f88a4062da0 2024-08-17T02:30:55.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.796+0000 7f889b400640 1 -- 172.21.15.106:0/3151462678 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889403d420 con 0x7f88a4062da0 2024-08-17T02:30:55.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.796+0000 7f88ab000640 1 -- 172.21.15.106:0/3151462678 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a4150770 con 0x7f88a4062da0 2024-08-17T02:30:55.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.797+0000 7f88ab000640 1 -- 172.21.15.106:0/3151462678 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a414fd80 con 0x7f88a4062da0 2024-08-17T02:30:55.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.798+0000 7f88ab000640 1 -- 172.21.15.106:0/3151462678 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a414ff70 con 0x7f88a4062da0 2024-08-17T02:30:55.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.798+0000 7f889b400640 1 -- 172.21.15.106:0/3151462678 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8894039040 con 0x7f88a4062da0 2024-08-17T02:30:55.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.799+0000 7f889b400640 1 --2- 172.21.15.106:0/3151462678 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8884065150 0x7f8884067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:55.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.799+0000 7f889b400640 1 -- 172.21.15.106:0/3151462678 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f88940a22f0 con 0x7f88a4062da0 2024-08-17T02:30:55.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.799+0000 7f88a3400640 1 --2- 172.21.15.106:0/3151462678 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8884065150 0x7f8884067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:55.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.800+0000 7f88a3400640 1 --2- 172.21.15.106:0/3151462678 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8884065150 0x7f8884067600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f88a406a800 tx=0x7f8890008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:55.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.803+0000 7f889b400640 1 -- 172.21.15.106:0/3151462678 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f88a414ff70 con 0x7f88a4062da0 2024-08-17T02:30:55.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.976+0000 7f88ab000640 1 -- 172.21.15.106:0/3151462678 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88a41505d0 con 0x7f88a4062da0 2024-08-17T02:30:55.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.977+0000 7f889b400640 1 -- 172.21.15.106:0/3151462678 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18647 (secure 0 0 0) 0x7f88a41505d0 con 0x7f88a4062da0 2024-08-17T02:30:55.978 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:30:55.978 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":37,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:28:55.604010+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:37.880632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:38.897913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000123149.meta","create_time":"2024-08-17T02:28:50.720877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000123149"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000123149.data","create_time":"2024-08-17T02:28:51.638596+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000123149"}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:30:55.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.979+0000 7f88ab000640 1 -- 172.21.15.106:0/3151462678 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8884065150 msgr2=0x7f8884067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.979+0000 7f88ab000640 1 --2- 172.21.15.106:0/3151462678 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8884065150 0x7f8884067600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f88a406a800 tx=0x7f8890008040 comp rx=0 tx=0).stop 2024-08-17T02:30:55.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.979+0000 7f88ab000640 1 -- 172.21.15.106:0/3151462678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88a4062da0 msgr2=0x7f88a414f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:55.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.979+0000 7f88ab000640 1 --2- 172.21.15.106:0/3151462678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88a4062da0 0x7f88a414f840 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8894035040 tx=0x7f8894032000 comp rx=0 tx=0).stop 2024-08-17T02:30:55.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.979+0000 7f88ab000640 1 -- 172.21.15.106:0/3151462678 shutdown_connections 2024-08-17T02:30:55.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.979+0000 7f88ab000640 1 --2- 172.21.15.106:0/3151462678 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88a4159820 0x7f88a4152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.979+0000 7f88ab000640 1 --2- 172.21.15.106:0/3151462678 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88a40cc430 0x7f88a414ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.979+0000 7f88ab000640 1 --2- 172.21.15.106:0/3151462678 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8884065150 0x7f8884067600 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.979+0000 7f88ab000640 1 --2- 172.21.15.106:0/3151462678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88a4062da0 0x7f88a414f840 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:55.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.979+0000 7f88ab000640 1 -- 172.21.15.106:0/3151462678 >> 172.21.15.106:0/3151462678 conn(0x7f88a40afc30 msgr2=0x7f88a406a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:55.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.980+0000 7f88ab000640 1 -- 172.21.15.106:0/3151462678 shutdown_connections 2024-08-17T02:30:55.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:55.980+0000 7f88ab000640 1 -- 172.21.15.106:0/3151462678 wait complete. 2024-08-17T02:30:55.995 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:37.928826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:28:37.880632+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:28:38.897913+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000123149.meta', 'create_time': '2024-08-17T02:28:50.720877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000123149'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000123149.data', 'create_time': '2024-08-17T02:28:51.638596+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000123149'}}}] 2024-08-17T02:30:55.996 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:30:56.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.145+0000 7f9bb9e00640 1 Processor -- start 2024-08-17T02:30:56.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.145+0000 7f9bb9e00640 1 -- start start 2024-08-17T02:30:56.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.146+0000 7f9bb9e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bb40accf0 0x7f9bb40b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.146+0000 7f9bb9e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb40ae540 con 0x7f9bb40afd90 2024-08-17T02:30:56.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.146+0000 7f9bb9e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb40ad930 con 0x7f9bb4159610 2024-08-17T02:30:56.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.146+0000 7f9bb9e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb40adc10 con 0x7f9bb40accf0 2024-08-17T02:30:56.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.147+0000 7f9bb3400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f9bb40afd90 0x7f9bb4157690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47524/0 (socket says 172.21.15.106:47524) 2024-08-17T02:30:56.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.147+0000 7f9bb3400640 1 -- 172.21.15.106:0/3188024086 learned_addr learned my addr 172.21.15.106:0/3188024086 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:30:56.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.147+0000 7f9bb2a00640 1 --2- 172.21.15.106:0/3188024086 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bb40accf0 0x7f9bb40b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.147+0000 7f9bb2000640 1 -- 172.21.15.106:0/3188024086 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1200619179 0 0) 0x7f9bb40ae540 con 0x7f9bb40afd90 2024-08-17T02:30:56.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.147+0000 7f9bb2000640 1 -- 172.21.15.106:0/3188024086 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b980034e0 con 0x7f9bb40afd90 2024-08-17T02:30:56.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.147+0000 7f9bb2a00640 1 -- 172.21.15.106:0/3188024086 >> v1:172.21.15.171:6789/0 conn(0x7f9bb4159610 legacy=0x7f9bb40af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.147+0000 7f9bb2000640 1 -- 172.21.15.106:0/3188024086 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945025283 0 0) 0x7f9bb40ad930 con 0x7f9bb4159610 2024-08-17T02:30:56.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.147+0000 7f9bb2a00640 1 -- 172.21.15.106:0/3188024086 >> v1:172.21.15.106:6789/0 conn(0x7f9bb40afd90 legacy=0x7f9bb4157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.147+0000 7f9bb2a00640 1 -- 172.21.15.106:0/3188024086 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb40adef0 con 0x7f9bb40accf0 2024-08-17T02:30:56.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.148+0000 7f9bb2a00640 1 --2- 172.21.15.106:0/3188024086 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bb40accf0 0x7f9bb40b1670 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4009880 tx=0x7f9ba40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cccf61cad3008841 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:56.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.149+0000 7f9bb2000640 1 -- 172.21.15.106:0/3188024086 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba402ad70 con 0x7f9bb40accf0 2024-08-17T02:30:56.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.149+0000 7f9bb2000640 1 -- 172.21.15.106:0/3188024086 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba4032440 con 0x7f9bb40accf0 2024-08-17T02:30:56.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.149+0000 7f9bb2000640 1 -- 172.21.15.106:0/3188024086 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba40327c0 con 0x7f9bb40accf0 2024-08-17T02:30:56.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.149+0000 7f9bb9e00640 1 -- 172.21.15.106:0/3188024086 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bb40accf0 msgr2=0x7f9bb40b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.149+0000 7f9bb9e00640 1 --2- 172.21.15.106:0/3188024086 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bb40accf0 0x7f9bb40b1670 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4009880 tx=0x7f9ba40090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.149+0000 7f9bb9e00640 1 -- 172.21.15.106:0/3188024086 shutdown_connections 2024-08-17T02:30:56.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.149+0000 7f9bb9e00640 1 --2- 172.21.15.106:0/3188024086 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bb40accf0 0x7f9bb40b1670 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.149+0000 7f9bb9e00640 1 -- 172.21.15.106:0/3188024086 >> 172.21.15.106:0/3188024086 conn(0x7f9bb4067750 msgr2=0x7f9bb40cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:56.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.149+0000 7f9bb9e00640 1 -- 172.21.15.106:0/3188024086 shutdown_connections 2024-08-17T02:30:56.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.149+0000 7f9bb9e00640 1 -- 172.21.15.106:0/3188024086 wait complete. 2024-08-17T02:30:56.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.151+0000 7f9bb9e00640 1 Processor -- start 2024-08-17T02:30:56.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.151+0000 7f9bb9e00640 1 -- start start 2024-08-17T02:30:56.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.152+0000 7f9bb9e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bb40accf0 0x7f9bb415c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.152+0000 7f9bb9e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bb40afd90 0x7f9bb4162970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.152+0000 7f9bb9e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bb4159610 0x7f9bb4157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.152+0000 7f9bb9e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb415cdf0 con 0x7f9bb4159610 2024-08-17T02:30:56.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.152+0000 7f9bb9e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb416c1e0 con 0x7f9bb40afd90 2024-08-17T02:30:56.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.152+0000 7f9bb9e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb416c4c0 con 0x7f9bb40accf0 2024-08-17T02:30:56.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.152+0000 7f9bb3400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bb4159610 0x7f9bb4157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.152+0000 7f9bb3400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bb4159610 0x7f9bb4157db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38434/0 (socket says 172.21.15.106:38434) 2024-08-17T02:30:56.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.152+0000 7f9bb3400640 1 -- 172.21.15.106:0/2959917654 learned_addr learned my addr 172.21.15.106:0/2959917654 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:30:56.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.152+0000 7f9bb2a00640 1 --2- 172.21.15.106:0/2959917654 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bb40accf0 0x7f9bb415c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.152+0000 7f9babe00640 1 --2- 172.21.15.106:0/2959917654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bb40afd90 0x7f9bb4162970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.152+0000 7f9bb3400640 1 -- 172.21.15.106:0/2959917654 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bb40accf0 msgr2=0x7f9bb415c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.152+0000 7f9bb3400640 1 --2- 172.21.15.106:0/2959917654 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bb40accf0 0x7f9bb415c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.152+0000 7f9bb3400640 1 -- 172.21.15.106:0/2959917654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bb40afd90 msgr2=0x7f9bb4162970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.152+0000 7f9bb3400640 1 --2- 172.21.15.106:0/2959917654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bb40afd90 0x7f9bb4162970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.153+0000 7f9bb3400640 1 -- 172.21.15.106:0/2959917654 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba4009390 con 0x7f9bb4159610 2024-08-17T02:30:56.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.153+0000 7f9bb3400640 1 --2- 172.21.15.106:0/2959917654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bb4159610 0x7f9bb4157db0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9bac001460 tx=0x7f9bac001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:56.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.153+0000 7f9baa000640 1 -- 172.21.15.106:0/2959917654 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00ce30 con 0x7f9bb4159610 2024-08-17T02:30:56.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.153+0000 7f9baa000640 1 -- 172.21.15.106:0/2959917654 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac00a850 con 0x7f9bb4159610 2024-08-17T02:30:56.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.153+0000 7f9bb9e00640 1 -- 172.21.15.106:0/2959917654 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb416c7a0 con 0x7f9bb4159610 2024-08-17T02:30:56.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.153+0000 7f9baa000640 1 -- 172.21.15.106:0/2959917654 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00ac50 con 0x7f9bb4159610 2024-08-17T02:30:56.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.153+0000 7f9bb9e00640 1 -- 172.21.15.106:0/2959917654 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb416cd60 con 0x7f9bb4159610 2024-08-17T02:30:56.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.154+0000 7f9bb9e00640 1 -- 172.21.15.106:0/2959917654 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb4064db0 con 0x7f9bb4159610 2024-08-17T02:30:56.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.155+0000 7f9baa000640 1 -- 172.21.15.106:0/2959917654 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9bac007300 con 0x7f9bb4159610 2024-08-17T02:30:56.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.156+0000 7f9baa000640 1 --2- 172.21.15.106:0/2959917654 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9b90065150 0x7f9b90067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.156+0000 7f9baa000640 1 -- 172.21.15.106:0/2959917654 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f9bac082930 con 0x7f9bb4159610 2024-08-17T02:30:56.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.156+0000 7f9bb2a00640 1 --2- 172.21.15.106:0/2959917654 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9b90065150 0x7f9b90067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.157+0000 7f9bb2a00640 1 --2- 172.21.15.106:0/2959917654 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9b90065150 0x7f9b90067600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4034000 tx=0x7f9ba4032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:56.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.160+0000 7f9baa000640 1 -- 172.21.15.106:0/2959917654 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9bac050670 con 0x7f9bb4159610 2024-08-17T02:30:56.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.333+0000 7f9bb9e00640 1 -- 172.21.15.106:0/2959917654 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9bb40cc480 con 0x7f9bb4159610 2024-08-17T02:30:56.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.333+0000 7f9baa000640 1 -- 172.21.15.106:0/2959917654 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9bac053c90 con 0x7f9bb4159610 2024-08-17T02:30:56.334 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-08-17T02:30:56.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.335+0000 7f9bb9e00640 1 -- 172.21.15.106:0/2959917654 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9b90065150 msgr2=0x7f9b90067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.335+0000 7f9bb9e00640 1 --2- 172.21.15.106:0/2959917654 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9b90065150 0x7f9b90067600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4034000 tx=0x7f9ba4032000 comp rx=0 tx=0).stop 2024-08-17T02:30:56.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.335+0000 7f9bb9e00640 1 -- 172.21.15.106:0/2959917654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bb4159610 msgr2=0x7f9bb4157db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.335+0000 7f9bb9e00640 1 --2- 172.21.15.106:0/2959917654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bb4159610 0x7f9bb4157db0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9bac001460 tx=0x7f9bac001a80 comp rx=0 tx=0).stop 2024-08-17T02:30:56.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.335+0000 7f9bb9e00640 1 -- 172.21.15.106:0/2959917654 shutdown_connections 2024-08-17T02:30:56.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.335+0000 7f9bb9e00640 1 --2- 172.21.15.106:0/2959917654 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9b90065150 0x7f9b90067600 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.335+0000 7f9bb9e00640 1 --2- 172.21.15.106:0/2959917654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9bb4159610 0x7f9bb4157db0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.335+0000 7f9bb9e00640 1 --2- 172.21.15.106:0/2959917654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9bb40afd90 0x7f9bb4162970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.335+0000 7f9bb9e00640 1 --2- 172.21.15.106:0/2959917654 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9bb40accf0 0x7f9bb415c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.336+0000 7f9bb9e00640 1 -- 172.21.15.106:0/2959917654 >> 172.21.15.106:0/2959917654 conn(0x7f9bb4067750 msgr2=0x7f9bb4156900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:56.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.336+0000 7f9bb9e00640 1 -- 172.21.15.106:0/2959917654 shutdown_connections 2024-08-17T02:30:56.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.336+0000 7f9bb9e00640 1 -- 172.21.15.106:0/2959917654 wait complete. 2024-08-17T02:30:56.351 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:30:56.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.500+0000 7ff5bb200640 1 Processor -- start 2024-08-17T02:30:56.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.501+0000 7ff5bb200640 1 -- start start 2024-08-17T02:30:56.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.502+0000 7ff5bb200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5bc155a30 0x7ff5bc06dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.502+0000 7ff5bb200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5bc0afc40 con 0x7ff5bc0adfb0 2024-08-17T02:30:56.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.502+0000 7ff5bb200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5bc0af030 con 0x7ff5bc155660 2024-08-17T02:30:56.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.502+0000 7ff5bb200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc0af310 con 0x7ff5bc155a30 2024-08-17T02:30:56.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.502+0000 7ff5b1400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff5bc0adfb0 0x7ff5bc0ae750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47532/0 (socket says 172.21.15.106:47532) 2024-08-17T02:30:56.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.502+0000 7ff5b1400640 1 -- 172.21.15.106:0/3376634336 learned_addr learned my addr 172.21.15.106:0/3376634336 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:30:56.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.502+0000 7ff5ba800640 1 --2- 172.21.15.106:0/3376634336 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5bc155a30 0x7ff5bc06dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.502+0000 7ff5b9400640 1 -- 172.21.15.106:0/3376634336 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3031000276 0 0) 0x7ff5bc0afc40 con 0x7ff5bc0adfb0 2024-08-17T02:30:56.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.503+0000 7ff5b9400640 1 -- 172.21.15.106:0/3376634336 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5a00034e0 con 0x7ff5bc0adfb0 2024-08-17T02:30:56.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.503+0000 7ff5b9400640 1 -- 172.21.15.106:0/3376634336 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 812550638 0 0) 0x7ff5bc0af030 con 0x7ff5bc155660 2024-08-17T02:30:56.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.503+0000 7ff5b9400640 1 -- 172.21.15.106:0/3376634336 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5bc0afc40 con 0x7ff5bc155660 2024-08-17T02:30:56.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.503+0000 7ff5ba800640 1 -- 172.21.15.106:0/3376634336 >> v1:172.21.15.171:6789/0 conn(0x7ff5bc155660 legacy=0x7ff5bc0c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.503+0000 7ff5ba800640 1 -- 172.21.15.106:0/3376634336 >> v1:172.21.15.106:6789/0 conn(0x7ff5bc0adfb0 legacy=0x7ff5bc0ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.503+0000 7ff5b9400640 1 -- 172.21.15.106:0/3376634336 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3982401165 0 0) 0x7ff5a00034e0 con 0x7ff5bc0adfb0 2024-08-17T02:30:56.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.503+0000 7ff5ba800640 1 -- 172.21.15.106:0/3376634336 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5bc0af5f0 con 0x7ff5bc155a30 2024-08-17T02:30:56.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.504+0000 7ff5ba800640 1 --2- 172.21.15.106:0/3376634336 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5bc155a30 0x7ff5bc06dec0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009e90 tx=0x7ff5b4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e7a19af8a7246db server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:56.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.504+0000 7ff5b9400640 1 -- 172.21.15.106:0/3376634336 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4001470 con 0x7ff5bc155a30 2024-08-17T02:30:56.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.504+0000 7ff5b9400640 1 -- 172.21.15.106:0/3376634336 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b402d050 con 0x7ff5bc155a30 2024-08-17T02:30:56.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.504+0000 7ff5b9400640 1 -- 172.21.15.106:0/3376634336 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4031630 con 0x7ff5bc155a30 2024-08-17T02:30:56.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.505+0000 7ff5bb200640 1 -- 172.21.15.106:0/3376634336 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5bc155a30 msgr2=0x7ff5bc06dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.505+0000 7ff5bb200640 1 --2- 172.21.15.106:0/3376634336 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5bc155a30 0x7ff5bc06dec0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009e90 tx=0x7ff5b4009780 comp rx=0 tx=0).stop 2024-08-17T02:30:56.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.505+0000 7ff5bb200640 1 -- 172.21.15.106:0/3376634336 shutdown_connections 2024-08-17T02:30:56.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.505+0000 7ff5bb200640 1 --2- 172.21.15.106:0/3376634336 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5bc155a30 0x7ff5bc06dec0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.505+0000 7ff5bb200640 1 -- 172.21.15.106:0/3376634336 >> 172.21.15.106:0/3376634336 conn(0x7ff5bc066cd0 msgr2=0x7ff5bc0670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:56.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.505+0000 7ff5bb200640 1 -- 172.21.15.106:0/3376634336 shutdown_connections 2024-08-17T02:30:56.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.505+0000 7ff5bb200640 1 -- 172.21.15.106:0/3376634336 wait complete. 2024-08-17T02:30:56.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.506+0000 7ff5bb200640 1 Processor -- start 2024-08-17T02:30:56.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.506+0000 7ff5bb200640 1 -- start start 2024-08-17T02:30:56.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.507+0000 7ff5bb200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff5bc0adfb0 0x7ff5bc156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.507+0000 7ff5bb200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5bc155660 0x7ff5bc1462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.507+0000 7ff5bb200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5bc155a30 0x7ff5bc15a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.507+0000 7ff5bb200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc15cb90 con 0x7ff5bc0adfb0 2024-08-17T02:30:56.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.507+0000 7ff5bb200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc15bf80 con 0x7ff5bc155a30 2024-08-17T02:30:56.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.507+0000 7ff5bb200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc15c260 con 0x7ff5bc155660 2024-08-17T02:30:56.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.508+0000 7ff5b9e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff5bc0adfb0 0x7ff5bc156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.508+0000 7ff5b9e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff5bc0adfb0 0x7ff5bc156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38448/0 (socket says 172.21.15.106:38448) 2024-08-17T02:30:56.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.508+0000 7ff5b9e00640 1 -- 172.21.15.106:0/174708028 learned_addr learned my addr 172.21.15.106:0/174708028 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:30:56.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.508+0000 7ff5ba800640 1 --2- 172.21.15.106:0/174708028 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5bc155a30 0x7ff5bc15a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.508+0000 7ff5b1400640 1 --2- 172.21.15.106:0/174708028 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5bc155660 0x7ff5bc1462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.508+0000 7ff5b9e00640 1 -- 172.21.15.106:0/174708028 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5bc155660 msgr2=0x7ff5bc1462c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.508+0000 7ff5b9e00640 1 --2- 172.21.15.106:0/174708028 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5bc155660 0x7ff5bc1462c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.508+0000 7ff5b9e00640 1 -- 172.21.15.106:0/174708028 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5bc155a30 msgr2=0x7ff5bc15a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.508+0000 7ff5b9e00640 1 --2- 172.21.15.106:0/174708028 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5bc155a30 0x7ff5bc15a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.508+0000 7ff5b9e00640 1 -- 172.21.15.106:0/174708028 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b4009a20 con 0x7ff5bc0adfb0 2024-08-17T02:30:56.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.508+0000 7ff5b9e00640 1 --2- 172.21.15.106:0/174708028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff5bc0adfb0 0x7ff5bc156990 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac00c590 tx=0x7ff5ac007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:56.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.509+0000 7ff5b2000640 1 -- 172.21.15.106:0/174708028 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac012630 con 0x7ff5bc0adfb0 2024-08-17T02:30:56.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.509+0000 7ff5b2000640 1 -- 172.21.15.106:0/174708028 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ac0127b0 con 0x7ff5bc0adfb0 2024-08-17T02:30:56.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.509+0000 7ff5b2000640 1 -- 172.21.15.106:0/174708028 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac012bb0 con 0x7ff5bc0adfb0 2024-08-17T02:30:56.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.509+0000 7ff5bb200640 1 -- 172.21.15.106:0/174708028 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5bc15c540 con 0x7ff5bc0adfb0 2024-08-17T02:30:56.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.509+0000 7ff5bb200640 1 -- 172.21.15.106:0/174708028 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5bc146800 con 0x7ff5bc0adfb0 2024-08-17T02:30:56.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.510+0000 7ff5bb200640 1 -- 172.21.15.106:0/174708028 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5bc071050 con 0x7ff5bc0adfb0 2024-08-17T02:30:56.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.511+0000 7ff5b2000640 1 -- 172.21.15.106:0/174708028 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff5ac01a3b0 con 0x7ff5bc0adfb0 2024-08-17T02:30:56.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.511+0000 7ff5b2000640 1 --2- 172.21.15.106:0/174708028 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ff598065150 0x7ff598067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.512+0000 7ff5b2000640 1 -- 172.21.15.106:0/174708028 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7ff5ac082670 con 0x7ff5bc0adfb0 2024-08-17T02:30:56.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.512+0000 7ff5b1400640 1 --2- 172.21.15.106:0/174708028 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ff598065150 0x7ff598067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.512+0000 7ff5b1400640 1 --2- 172.21.15.106:0/174708028 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ff598065150 0x7ff598067600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc1593b0 tx=0x7ff5a4000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:56.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.515+0000 7ff5b2000640 1 -- 172.21.15.106:0/174708028 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff5ac0503c0 con 0x7ff5bc0adfb0 2024-08-17T02:30:56.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.689+0000 7ff5bb200640 1 -- 172.21.15.106:0/174708028 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff5bc0c77e0 con 0x7ff5bc0adfb0 2024-08-17T02:30:56.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.689+0000 7ff5b2000640 1 -- 172.21.15.106:0/174708028 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff5ac0539e0 con 0x7ff5bc0adfb0 2024-08-17T02:30:56.690 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-08-17T02:30:56.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.691+0000 7ff5bb200640 1 -- 172.21.15.106:0/174708028 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ff598065150 msgr2=0x7ff598067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.691+0000 7ff5bb200640 1 --2- 172.21.15.106:0/174708028 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ff598065150 0x7ff598067600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc1593b0 tx=0x7ff5a4000bc0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.691+0000 7ff5bb200640 1 -- 172.21.15.106:0/174708028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff5bc0adfb0 msgr2=0x7ff5bc156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.691+0000 7ff5bb200640 1 --2- 172.21.15.106:0/174708028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff5bc0adfb0 0x7ff5bc156990 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac00c590 tx=0x7ff5ac007d80 comp rx=0 tx=0).stop 2024-08-17T02:30:56.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.691+0000 7ff5bb200640 1 -- 172.21.15.106:0/174708028 shutdown_connections 2024-08-17T02:30:56.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.691+0000 7ff5bb200640 1 --2- 172.21.15.106:0/174708028 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5bc155a30 0x7ff5bc15a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.691+0000 7ff5bb200640 1 --2- 172.21.15.106:0/174708028 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff5bc155660 0x7ff5bc1462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.691+0000 7ff5bb200640 1 --2- 172.21.15.106:0/174708028 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ff598065150 0x7ff598067600 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.691+0000 7ff5bb200640 1 --2- 172.21.15.106:0/174708028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff5bc0adfb0 0x7ff5bc156990 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.691+0000 7ff5bb200640 1 -- 172.21.15.106:0/174708028 >> 172.21.15.106:0/174708028 conn(0x7ff5bc066cd0 msgr2=0x7ff5bc0ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:56.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.691+0000 7ff5bb200640 1 -- 172.21.15.106:0/174708028 shutdown_connections 2024-08-17T02:30:56.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.692+0000 7ff5bb200640 1 -- 172.21.15.106:0/174708028 wait complete. 2024-08-17T02:30:56.707 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:30:56.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.856+0000 7fdcf6c00640 1 Processor -- start 2024-08-17T02:30:56.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.856+0000 7fdcf6c00640 1 -- start start 2024-08-17T02:30:56.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.857+0000 7fdcf6c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdcf00c7db0 0x7fdcf00c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.857+0000 7fdcf6c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fdcf0155e50 0x7fdcf00c9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.857+0000 7fdcf6c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf01598f0 con 0x7fdcf0155a80 2024-08-17T02:30:56.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.857+0000 7fdcf6c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcf0159bd0 con 0x7fdcf00c7db0 2024-08-17T02:30:56.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.857+0000 7fdcf6c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcf0159eb0 con 0x7fdcf0155e50 2024-08-17T02:30:56.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.858+0000 7fdce7400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdcf00c7db0 0x7fdcf00c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.858+0000 7fdce7400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdcf00c7db0 0x7fdcf00c8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38464/0 (socket says 172.21.15.106:38464) 2024-08-17T02:30:56.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.858+0000 7fdce7400640 1 -- 172.21.15.106:0/1872013274 learned_addr learned my addr 172.21.15.106:0/1872013274 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:30:56.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.858+0000 7fdcf4c00640 1 --2- 172.21.15.106:0/1872013274 >> v2:172.21.15.171:3300/0 conn(0x7fdcf0155e50 0x7fdcf00c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.858+0000 7fdce7400640 1 -- 172.21.15.106:0/1872013274 >> v2:172.21.15.171:3300/0 conn(0x7fdcf0155e50 msgr2=0x7fdcf00c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:56.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.858+0000 7fdce7400640 1 --2- 172.21.15.106:0/1872013274 >> v2:172.21.15.171:3300/0 conn(0x7fdcf0155e50 0x7fdcf00c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.858+0000 7fdce7400640 1 -- 172.21.15.106:0/1872013274 >> v1:172.21.15.171:6789/0 conn(0x7fdcf0155a80 legacy=0x7fdcf006dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.858+0000 7fdce7400640 1 -- 172.21.15.106:0/1872013274 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf015a190 con 0x7fdcf00c7db0 2024-08-17T02:30:56.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.859+0000 7fdce7400640 1 --2- 172.21.15.106:0/1872013274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcf00c7db0 0x7fdcf00c8bd0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00b1c60 tx=0x7fdcd80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc19004faa83d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:56.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.859+0000 7fdcef400640 1 -- 172.21.15.106:0/1872013274 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8032440 con 0x7fdcf00c7db0 2024-08-17T02:30:56.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.860+0000 7fdcef400640 1 -- 172.21.15.106:0/1872013274 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd80325a0 con 0x7fdcf00c7db0 2024-08-17T02:30:56.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.860+0000 7fdcef400640 1 -- 172.21.15.106:0/1872013274 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8032980 con 0x7fdcf00c7db0 2024-08-17T02:30:56.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.860+0000 7fdcf6c00640 1 -- 172.21.15.106:0/1872013274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcf00c7db0 msgr2=0x7fdcf00c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.860+0000 7fdcf6c00640 1 --2- 172.21.15.106:0/1872013274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcf00c7db0 0x7fdcf00c8bd0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00b1c60 tx=0x7fdcd80091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.860+0000 7fdcf6c00640 1 -- 172.21.15.106:0/1872013274 shutdown_connections 2024-08-17T02:30:56.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.860+0000 7fdcf6c00640 1 --2- 172.21.15.106:0/1872013274 >> v2:172.21.15.171:3300/0 conn(0x7fdcf0155e50 0x7fdcf00c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.860+0000 7fdcf6c00640 1 --2- 172.21.15.106:0/1872013274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcf00c7db0 0x7fdcf00c8bd0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.860+0000 7fdcf6c00640 1 -- 172.21.15.106:0/1872013274 >> 172.21.15.106:0/1872013274 conn(0x7fdcf0067750 msgr2=0x7fdcf00c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:56.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.860+0000 7fdcf6c00640 1 -- 172.21.15.106:0/1872013274 shutdown_connections 2024-08-17T02:30:56.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.860+0000 7fdcf6c00640 1 -- 172.21.15.106:0/1872013274 wait complete. 2024-08-17T02:30:56.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.862+0000 7fdcf6c00640 1 Processor -- start 2024-08-17T02:30:56.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.862+0000 7fdcf6c00640 1 -- start start 2024-08-17T02:30:56.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.863+0000 7fdcf6c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcf00c7db0 0x7fdcf01562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.863+0000 7fdcf6c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcf0155a80 0x7fdcf01442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.863+0000 7fdcf6c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcf0155e50 0x7fdcf0156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.863+0000 7fdcf6c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf0154ac0 con 0x7fdcf0155a80 2024-08-17T02:30:56.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.863+0000 7fdcf6c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf00ac5d0 con 0x7fdcf00c7db0 2024-08-17T02:30:56.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.863+0000 7fdcf6c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf0153f40 con 0x7fdcf0155e50 2024-08-17T02:30:56.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.863+0000 7fdce7400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcf0155a80 0x7fdcf01442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.863+0000 7fdce7400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcf0155a80 0x7fdcf01442a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38480/0 (socket says 172.21.15.106:38480) 2024-08-17T02:30:56.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.863+0000 7fdce7400640 1 -- 172.21.15.106:0/1021503236 learned_addr learned my addr 172.21.15.106:0/1021503236 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:30:56.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.863+0000 7fdcefe00640 1 --2- 172.21.15.106:0/1021503236 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcf00c7db0 0x7fdcf01562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.863+0000 7fdcf4c00640 1 --2- 172.21.15.106:0/1021503236 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcf0155e50 0x7fdcf0156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.863+0000 7fdce7400640 1 -- 172.21.15.106:0/1021503236 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcf0155e50 msgr2=0x7fdcf0156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.863+0000 7fdce7400640 1 --2- 172.21.15.106:0/1021503236 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcf0155e50 0x7fdcf0156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.863+0000 7fdce7400640 1 -- 172.21.15.106:0/1021503236 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcf00c7db0 msgr2=0x7fdcf01562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:56.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.863+0000 7fdce7400640 1 --2- 172.21.15.106:0/1021503236 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcf00c7db0 0x7fdcf01562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:56.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.863+0000 7fdce7400640 1 -- 172.21.15.106:0/1021503236 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd8009450 con 0x7fdcf0155a80 2024-08-17T02:30:56.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.864+0000 7fdce7400640 1 --2- 172.21.15.106:0/1021503236 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcf0155a80 0x7fdcf01442a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8035040 tx=0x7fdcd8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:56.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.864+0000 7fdce7e00640 1 -- 172.21.15.106:0/1021503236 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8031a60 con 0x7fdcf0155a80 2024-08-17T02:30:56.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.864+0000 7fdce7e00640 1 -- 172.21.15.106:0/1021503236 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd8031be0 con 0x7fdcf0155a80 2024-08-17T02:30:56.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.864+0000 7fdce7e00640 1 -- 172.21.15.106:0/1021503236 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd803d420 con 0x7fdcf0155a80 2024-08-17T02:30:56.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.864+0000 7fdcf6c00640 1 -- 172.21.15.106:0/1021503236 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf0154220 con 0x7fdcf0155a80 2024-08-17T02:30:56.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.864+0000 7fdcf6c00640 1 -- 172.21.15.106:0/1021503236 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf01547e0 con 0x7fdcf0155a80 2024-08-17T02:30:56.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.865+0000 7fdcf6c00640 1 -- 172.21.15.106:0/1021503236 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf0071050 con 0x7fdcf0155a80 2024-08-17T02:30:56.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.866+0000 7fdce7e00640 1 -- 172.21.15.106:0/1021503236 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdcd8039040 con 0x7fdcf0155a80 2024-08-17T02:30:56.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.867+0000 7fdce7e00640 1 --2- 172.21.15.106:0/1021503236 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fdccc065180 0x7fdccc067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:56.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.867+0000 7fdce7e00640 1 -- 172.21.15.106:0/1021503236 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fdcd80a2440 con 0x7fdcf0155a80 2024-08-17T02:30:56.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.867+0000 7fdcefe00640 1 --2- 172.21.15.106:0/1021503236 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fdccc065180 0x7fdccc067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:56.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.868+0000 7fdcefe00640 1 --2- 172.21.15.106:0/1021503236 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fdccc065180 0x7fdccc067630 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdce0007fd0 tx=0x7fdce0007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:56.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:56.871+0000 7fdce7e00640 1 -- 172.21.15.106:0/1021503236 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdcd8070190 con 0x7fdcf0155a80 2024-08-17T02:30:57.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.042+0000 7fdcf6c00640 1 -- 172.21.15.106:0/1021503236 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdcf006aa10 con 0x7fdcf0155a80 2024-08-17T02:30:57.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.042+0000 7fdce7e00640 1 -- 172.21.15.106:0/1021503236 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdcd80737b0 con 0x7fdcf0155a80 2024-08-17T02:30:57.043 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2024-08-17T02:30:57.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.044+0000 7fdcf6c00640 1 -- 172.21.15.106:0/1021503236 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fdccc065180 msgr2=0x7fdccc067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:57.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.044+0000 7fdcf6c00640 1 --2- 172.21.15.106:0/1021503236 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fdccc065180 0x7fdccc067630 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdce0007fd0 tx=0x7fdce0007e30 comp rx=0 tx=0).stop 2024-08-17T02:30:57.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.044+0000 7fdcf6c00640 1 -- 172.21.15.106:0/1021503236 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcf0155a80 msgr2=0x7fdcf01442a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:57.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.044+0000 7fdcf6c00640 1 --2- 172.21.15.106:0/1021503236 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcf0155a80 0x7fdcf01442a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8035040 tx=0x7fdcd8032000 comp rx=0 tx=0).stop 2024-08-17T02:30:57.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.044+0000 7fdcf6c00640 1 -- 172.21.15.106:0/1021503236 shutdown_connections 2024-08-17T02:30:57.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.044+0000 7fdcf6c00640 1 --2- 172.21.15.106:0/1021503236 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdcf0155e50 0x7fdcf0156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.044+0000 7fdcf6c00640 1 --2- 172.21.15.106:0/1021503236 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fdccc065180 0x7fdccc067630 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.044+0000 7fdcf6c00640 1 --2- 172.21.15.106:0/1021503236 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcf0155a80 0x7fdcf01442a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.044+0000 7fdcf6c00640 1 --2- 172.21.15.106:0/1021503236 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcf00c7db0 0x7fdcf01562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.044+0000 7fdcf6c00640 1 -- 172.21.15.106:0/1021503236 >> 172.21.15.106:0/1021503236 conn(0x7fdcf0067750 msgr2=0x7fdcf01512b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:57.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.044+0000 7fdcf6c00640 1 -- 172.21.15.106:0/1021503236 shutdown_connections 2024-08-17T02:30:57.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.044+0000 7fdcf6c00640 1 -- 172.21.15.106:0/1021503236 wait complete. 2024-08-17T02:30:57.060 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000123149.meta pg_num 2024-08-17T02:30:57.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.212+0000 7f2fb6200640 1 Processor -- start 2024-08-17T02:30:57.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.212+0000 7f2fb6200640 1 -- start start 2024-08-17T02:30:57.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.213+0000 7f2fb6200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2fb00c4950 0x7f2fb00ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:57.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.213+0000 7f2fb6200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fb00cb980 0x7f2fb0158730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:57.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.213+0000 7f2fb6200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb00c5a40 con 0x7f2fb00ce250 2024-08-17T02:30:57.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.213+0000 7f2fb6200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb00c4e30 con 0x7f2fb00c4950 2024-08-17T02:30:57.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.213+0000 7f2fb6200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb00c5110 con 0x7f2fb00cb980 2024-08-17T02:30:57.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.213+0000 7f2fa7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2fb00c4950 0x7f2fb00ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:57.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.213+0000 7f2fb5800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fb00cb980 0x7f2fb0158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:57.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.213+0000 7f2fa7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2fb00c4950 0x7f2fb00ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:49584/0 (socket says 172.21.15.106:49584) 2024-08-17T02:30:57.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.213+0000 7f2fa7e00640 1 -- 172.21.15.106:0/1673157558 learned_addr learned my addr 172.21.15.106:0/1673157558 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:30:57.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.214+0000 7f2fa7e00640 1 -- 172.21.15.106:0/1673157558 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fb00cb980 msgr2=0x7f2fb0158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:57.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.214+0000 7f2fa7e00640 1 --2- 172.21.15.106:0/1673157558 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fb00cb980 0x7f2fb0158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.214+0000 7f2fa7e00640 1 -- 172.21.15.106:0/1673157558 >> v1:172.21.15.171:6789/0 conn(0x7f2fb00ce250 legacy=0x7f2fb00b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:57.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.214+0000 7f2fa7e00640 1 -- 172.21.15.106:0/1673157558 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb00c53f0 con 0x7f2fb00c4950 2024-08-17T02:30:57.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.215+0000 7f2fa7e00640 1 --2- 172.21.15.106:0/1673157558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fb00c4950 0x7f2fb00ce620 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2f98009910 tx=0x7f2f980091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98bc05e15d5e7fe5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:57.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.215+0000 7f2fafe00640 1 -- 172.21.15.106:0/1673157558 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9802adb0 con 0x7f2fb00c4950 2024-08-17T02:30:57.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.215+0000 7f2fafe00640 1 -- 172.21.15.106:0/1673157558 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f98032440 con 0x7f2fb00c4950 2024-08-17T02:30:57.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.215+0000 7f2fafe00640 1 -- 172.21.15.106:0/1673157558 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f98032820 con 0x7f2fb00c4950 2024-08-17T02:30:57.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.216+0000 7f2fb6200640 1 -- 172.21.15.106:0/1673157558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fb00c4950 msgr2=0x7f2fb00ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:57.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.216+0000 7f2fb6200640 1 --2- 172.21.15.106:0/1673157558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fb00c4950 0x7f2fb00ce620 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2f98009910 tx=0x7f2f980091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.216+0000 7f2fb6200640 1 -- 172.21.15.106:0/1673157558 shutdown_connections 2024-08-17T02:30:57.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.216+0000 7f2fb6200640 1 --2- 172.21.15.106:0/1673157558 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fb00cb980 0x7f2fb0158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.216+0000 7f2fb6200640 1 --2- 172.21.15.106:0/1673157558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fb00c4950 0x7f2fb00ce620 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.216+0000 7f2fb6200640 1 -- 172.21.15.106:0/1673157558 >> 172.21.15.106:0/1673157558 conn(0x7f2fb0098e30 msgr2=0x7f2fb006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:57.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.216+0000 7f2fb6200640 1 -- 172.21.15.106:0/1673157558 shutdown_connections 2024-08-17T02:30:57.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.216+0000 7f2fb6200640 1 -- 172.21.15.106:0/1673157558 wait complete. 2024-08-17T02:30:57.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.217+0000 7f2fb6200640 1 Processor -- start 2024-08-17T02:30:57.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.217+0000 7f2fb6200640 1 -- start start 2024-08-17T02:30:57.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.218+0000 7f2fb6200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fb00c4950 0x7f2fb0145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:57.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.218+0000 7f2fb6200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fb00cb980 0x7f2fb00c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:57.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.218+0000 7f2fb6200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fb00ce250 0x7f2fb00c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:57.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.218+0000 7f2fb6200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb00c7c70 con 0x7f2fb00cb980 2024-08-17T02:30:57.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.218+0000 7f2fb6200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb009c770 con 0x7f2fb00ce250 2024-08-17T02:30:57.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.218+0000 7f2fb6200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb009c160 con 0x7f2fb00c4950 2024-08-17T02:30:57.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.218+0000 7f2fa7e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fb00cb980 0x7f2fb00c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:57.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.218+0000 7f2fa7e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fb00cb980 0x7f2fb00c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38496/0 (socket says 172.21.15.106:38496) 2024-08-17T02:30:57.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.218+0000 7f2fa7e00640 1 -- 172.21.15.106:0/251621702 learned_addr learned my addr 172.21.15.106:0/251621702 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:30:57.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.219+0000 7f2fb5800640 1 --2- 172.21.15.106:0/251621702 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fb00ce250 0x7f2fb00c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:57.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.219+0000 7f2fa7e00640 1 -- 172.21.15.106:0/251621702 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fb00c4950 msgr2=0x7f2fb0145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:57.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.219+0000 7f2fb4e00640 1 --2- 172.21.15.106:0/251621702 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fb00c4950 0x7f2fb0145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:57.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.219+0000 7f2fa7e00640 1 --2- 172.21.15.106:0/251621702 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fb00c4950 0x7f2fb0145700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.219+0000 7f2fa7e00640 1 -- 172.21.15.106:0/251621702 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fb00ce250 msgr2=0x7f2fb00c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:57.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.219+0000 7f2fa7e00640 1 --2- 172.21.15.106:0/251621702 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fb00ce250 0x7f2fb00c6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.219+0000 7f2fa7e00640 1 -- 172.21.15.106:0/251621702 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f98009450 con 0x7f2fb00cb980 2024-08-17T02:30:57.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.219+0000 7f2fb5800640 1 --2- 172.21.15.106:0/251621702 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fb00ce250 0x7f2fb00c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:57.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.219+0000 7f2fb4e00640 1 --2- 172.21.15.106:0/251621702 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fb00c4950 0x7f2fb0145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:57.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.219+0000 7f2fa7e00640 1 --2- 172.21.15.106:0/251621702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fb00cb980 0x7f2fb00c8020 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2f98035040 tx=0x7f2f98032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:57.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.219+0000 7f2facc00640 1 -- 172.21.15.106:0/251621702 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f98031c80 con 0x7f2fb00cb980 2024-08-17T02:30:57.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.219+0000 7f2facc00640 1 -- 172.21.15.106:0/251621702 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f98031e40 con 0x7f2fb00cb980 2024-08-17T02:30:57.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.219+0000 7f2fb6200640 1 -- 172.21.15.106:0/251621702 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb00c76b0 con 0x7f2fb00cb980 2024-08-17T02:30:57.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.219+0000 7f2facc00640 1 -- 172.21.15.106:0/251621702 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9803d670 con 0x7f2fb00cb980 2024-08-17T02:30:57.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.220+0000 7f2fb6200640 1 -- 172.21.15.106:0/251621702 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb009c400 con 0x7f2fb00cb980 2024-08-17T02:30:57.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.221+0000 7f2fb6200640 1 -- 172.21.15.106:0/251621702 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb0071050 con 0x7f2fb00cb980 2024-08-17T02:30:57.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.221+0000 7f2facc00640 1 -- 172.21.15.106:0/251621702 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2f98039040 con 0x7f2fb00cb980 2024-08-17T02:30:57.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.222+0000 7f2facc00640 1 --2- 172.21.15.106:0/251621702 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2f8c065150 0x7f2f8c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:57.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.222+0000 7f2facc00640 1 -- 172.21.15.106:0/251621702 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f2f980a29e0 con 0x7f2fb00cb980 2024-08-17T02:30:57.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.222+0000 7f2fb4e00640 1 --2- 172.21.15.106:0/251621702 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2f8c065150 0x7f2f8c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:57.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.223+0000 7f2fb4e00640 1 --2- 172.21.15.106:0/251621702 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2f8c065150 0x7f2f8c067600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0001700 tx=0x7f2fa0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:57.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.226+0000 7f2facc00640 1 -- 172.21.15.106:0/251621702 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2f98070680 con 0x7f2fb00cb980 2024-08-17T02:30:57.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.399+0000 7f2fb6200640 1 -- 172.21.15.106:0/251621702 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000123149.meta", "var": "pg_num"} v 0) v1 -- 0x7f2fb00ccf80 con 0x7f2fb00cb980 2024-08-17T02:30:57.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.400+0000 7f2facc00640 1 -- 172.21.15.106:0/251621702 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000123149.meta", "var": "pg_num"}]=0 v37) v1 ==== 124+0+11 (secure 0 0 0) 0x7f2f98037020 con 0x7f2fb00cb980 2024-08-17T02:30:57.400 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-08-17T02:30:57.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.402+0000 7f2fb6200640 1 -- 172.21.15.106:0/251621702 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2f8c065150 msgr2=0x7f2f8c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:57.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.402+0000 7f2fb6200640 1 --2- 172.21.15.106:0/251621702 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2f8c065150 0x7f2f8c067600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0001700 tx=0x7f2fa0009040 comp rx=0 tx=0).stop 2024-08-17T02:30:57.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.402+0000 7f2fb6200640 1 -- 172.21.15.106:0/251621702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fb00cb980 msgr2=0x7f2fb00c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:57.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.402+0000 7f2fb6200640 1 --2- 172.21.15.106:0/251621702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fb00cb980 0x7f2fb00c8020 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2f98035040 tx=0x7f2f98032000 comp rx=0 tx=0).stop 2024-08-17T02:30:57.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.402+0000 7f2fb6200640 1 -- 172.21.15.106:0/251621702 shutdown_connections 2024-08-17T02:30:57.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.402+0000 7f2fb6200640 1 --2- 172.21.15.106:0/251621702 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fb00ce250 0x7f2fb00c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.402+0000 7f2fb6200640 1 --2- 172.21.15.106:0/251621702 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2f8c065150 0x7f2f8c067600 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.402+0000 7f2fb6200640 1 --2- 172.21.15.106:0/251621702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fb00cb980 0x7f2fb00c8020 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.402+0000 7f2fb6200640 1 --2- 172.21.15.106:0/251621702 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2fb00c4950 0x7f2fb0145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.402+0000 7f2fb6200640 1 -- 172.21.15.106:0/251621702 >> 172.21.15.106:0/251621702 conn(0x7f2fb0098e30 msgr2=0x7f2fb00689d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:57.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.402+0000 7f2fb6200640 1 -- 172.21.15.106:0/251621702 shutdown_connections 2024-08-17T02:30:57.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.402+0000 7f2fb6200640 1 -- 172.21.15.106:0/251621702 wait complete. 2024-08-17T02:30:57.417 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000123149.data pg_num 2024-08-17T02:30:57.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.566+0000 7f0549000640 1 Processor -- start 2024-08-17T02:30:57.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.566+0000 7f0549000640 1 -- start start 2024-08-17T02:30:57.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.567+0000 7f0549000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0544158ce0 0x7f054406a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:57.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.568+0000 7f0549000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05441590b0 0x7f05440c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:57.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.568+0000 7f0549000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f054406d790 con 0x7f05440c9110 2024-08-17T02:30:57.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.568+0000 7f0549000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05440c95b0 con 0x7f0544158ce0 2024-08-17T02:30:57.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.568+0000 7f0549000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054406a730 con 0x7f05441590b0 2024-08-17T02:30:57.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.568+0000 7f0541e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0544158ce0 0x7f054406a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:57.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.568+0000 7f0541e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0544158ce0 0x7f054406a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38504/0 (socket says 172.21.15.106:38504) 2024-08-17T02:30:57.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.568+0000 7f0541e00640 1 -- 172.21.15.106:0/549384269 learned_addr learned my addr 172.21.15.106:0/549384269 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:30:57.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.568+0000 7f0539400640 1 --2- 172.21.15.106:0/549384269 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05441590b0 0x7f05440c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:57.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.568+0000 7f0541e00640 1 -- 172.21.15.106:0/549384269 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05441590b0 msgr2=0x7f05440c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:57.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.568+0000 7f0541e00640 1 --2- 172.21.15.106:0/549384269 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05441590b0 0x7f05440c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.568+0000 7f0541e00640 1 -- 172.21.15.106:0/549384269 >> v1:172.21.15.171:6789/0 conn(0x7f05440c9110 legacy=0x7f054415c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:57.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.568+0000 7f0541e00640 1 -- 172.21.15.106:0/549384269 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054406cb80 con 0x7f0544158ce0 2024-08-17T02:30:57.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.568+0000 7f0539400640 1 --2- 172.21.15.106:0/549384269 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05441590b0 0x7f05440c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:57.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.569+0000 7f0541e00640 1 --2- 172.21.15.106:0/549384269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0544158ce0 0x7f054406a1f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0534009910 tx=0x7f05340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7b0c2a7ccdb0dd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:57.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.569+0000 7f0541400640 1 -- 172.21.15.106:0/549384269 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053402adb0 con 0x7f0544158ce0 2024-08-17T02:30:57.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.570+0000 7f0541400640 1 -- 172.21.15.106:0/549384269 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0534032440 con 0x7f0544158ce0 2024-08-17T02:30:57.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.570+0000 7f0541400640 1 -- 172.21.15.106:0/549384269 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0534032820 con 0x7f0544158ce0 2024-08-17T02:30:57.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.570+0000 7f0549000640 1 -- 172.21.15.106:0/549384269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0544158ce0 msgr2=0x7f054406a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:57.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.570+0000 7f0549000640 1 --2- 172.21.15.106:0/549384269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0544158ce0 0x7f054406a1f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0534009910 tx=0x7f05340091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.570+0000 7f0549000640 1 -- 172.21.15.106:0/549384269 shutdown_connections 2024-08-17T02:30:57.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.570+0000 7f0549000640 1 --2- 172.21.15.106:0/549384269 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05441590b0 0x7f05440c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.570+0000 7f0549000640 1 --2- 172.21.15.106:0/549384269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0544158ce0 0x7f054406a1f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.570+0000 7f0549000640 1 -- 172.21.15.106:0/549384269 >> 172.21.15.106:0/549384269 conn(0x7f0544067750 msgr2=0x7f05440c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:57.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.570+0000 7f0549000640 1 -- 172.21.15.106:0/549384269 shutdown_connections 2024-08-17T02:30:57.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.570+0000 7f0549000640 1 -- 172.21.15.106:0/549384269 wait complete. 2024-08-17T02:30:57.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.572+0000 7f0549000640 1 Processor -- start 2024-08-17T02:30:57.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.572+0000 7f0549000640 1 -- start start 2024-08-17T02:30:57.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.572+0000 7f0549000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05440c9110 0x7f05440af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:57.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.573+0000 7f0549000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0544158ce0 0x7f05441511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:57.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.573+0000 7f0549000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05441590b0 0x7f0544151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:57.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.573+0000 7f0549000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054415bdc0 con 0x7f05441590b0 2024-08-17T02:30:57.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.573+0000 7f0549000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054415c0a0 con 0x7f0544158ce0 2024-08-17T02:30:57.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.573+0000 7f0549000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054415c380 con 0x7f05440c9110 2024-08-17T02:30:57.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.573+0000 7f0542800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05441590b0 0x7f0544151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:57.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.573+0000 7f0542800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05441590b0 0x7f0544151700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38520/0 (socket says 172.21.15.106:38520) 2024-08-17T02:30:57.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.573+0000 7f0542800640 1 -- 172.21.15.106:0/2213142074 learned_addr learned my addr 172.21.15.106:0/2213142074 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:30:57.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.573+0000 7f0539400640 1 --2- 172.21.15.106:0/2213142074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0544158ce0 0x7f05441511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:57.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.573+0000 7f0541e00640 1 --2- 172.21.15.106:0/2213142074 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05440c9110 0x7f05440af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:57.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.573+0000 7f0542800640 1 -- 172.21.15.106:0/2213142074 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05440c9110 msgr2=0x7f05440af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:57.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.573+0000 7f0542800640 1 --2- 172.21.15.106:0/2213142074 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05440c9110 0x7f05440af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.573+0000 7f0542800640 1 -- 172.21.15.106:0/2213142074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0544158ce0 msgr2=0x7f05441511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:57.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.573+0000 7f0542800640 1 --2- 172.21.15.106:0/2213142074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0544158ce0 0x7f05441511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.573+0000 7f0542800640 1 -- 172.21.15.106:0/2213142074 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0534009450 con 0x7f05441590b0 2024-08-17T02:30:57.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.574+0000 7f0542800640 1 --2- 172.21.15.106:0/2213142074 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05441590b0 0x7f0544151700 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f053c00c890 tx=0x7f053c002640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:57.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.574+0000 7f053a000640 1 -- 172.21.15.106:0/2213142074 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c00ce80 con 0x7f05441590b0 2024-08-17T02:30:57.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.574+0000 7f053a000640 1 -- 172.21.15.106:0/2213142074 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053c00a7f0 con 0x7f05441590b0 2024-08-17T02:30:57.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.574+0000 7f0549000640 1 -- 172.21.15.106:0/2213142074 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f054415c660 con 0x7f05441590b0 2024-08-17T02:30:57.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.574+0000 7f053a000640 1 -- 172.21.15.106:0/2213142074 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c00abf0 con 0x7f05441590b0 2024-08-17T02:30:57.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.574+0000 7f0549000640 1 -- 172.21.15.106:0/2213142074 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05440af570 con 0x7f05441590b0 2024-08-17T02:30:57.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.575+0000 7f0549000640 1 -- 172.21.15.106:0/2213142074 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0544071050 con 0x7f05441590b0 2024-08-17T02:30:57.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.576+0000 7f053a000640 1 -- 172.21.15.106:0/2213142074 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f053c00ad50 con 0x7f05441590b0 2024-08-17T02:30:57.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.577+0000 7f053a000640 1 --2- 172.21.15.106:0/2213142074 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0520065150 0x7f0520067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:57.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.577+0000 7f053a000640 1 -- 172.21.15.106:0/2213142074 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f053c0829d0 con 0x7f05441590b0 2024-08-17T02:30:57.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.577+0000 7f0541e00640 1 --2- 172.21.15.106:0/2213142074 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0520065150 0x7f0520067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:57.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.578+0000 7f0541e00640 1 --2- 172.21.15.106:0/2213142074 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0520065150 0x7f0520067600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0534034000 tx=0x7f0534032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:57.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.581+0000 7f053a000640 1 -- 172.21.15.106:0/2213142074 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f053c0507c0 con 0x7f05441590b0 2024-08-17T02:30:57.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.752+0000 7f0549000640 1 -- 172.21.15.106:0/2213142074 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000123149.data", "var": "pg_num"} v 0) v1 -- 0x7f054406a910 con 0x7f05441590b0 2024-08-17T02:30:57.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.752+0000 7f053a000640 1 -- 172.21.15.106:0/2213142074 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000123149.data", "var": "pg_num"}]=0 v37) v1 ==== 124+0+11 (secure 0 0 0) 0x7f053c0160c0 con 0x7f05441590b0 2024-08-17T02:30:57.753 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-08-17T02:30:57.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.754+0000 7f0549000640 1 -- 172.21.15.106:0/2213142074 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0520065150 msgr2=0x7f0520067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:57.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.754+0000 7f0549000640 1 --2- 172.21.15.106:0/2213142074 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0520065150 0x7f0520067600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0534034000 tx=0x7f0534032000 comp rx=0 tx=0).stop 2024-08-17T02:30:57.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.754+0000 7f0549000640 1 -- 172.21.15.106:0/2213142074 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05441590b0 msgr2=0x7f0544151700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:57.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.754+0000 7f0549000640 1 --2- 172.21.15.106:0/2213142074 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05441590b0 0x7f0544151700 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f053c00c890 tx=0x7f053c002640 comp rx=0 tx=0).stop 2024-08-17T02:30:57.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.755+0000 7f0549000640 1 -- 172.21.15.106:0/2213142074 shutdown_connections 2024-08-17T02:30:57.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.755+0000 7f0549000640 1 --2- 172.21.15.106:0/2213142074 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0520065150 0x7f0520067600 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.755+0000 7f0549000640 1 --2- 172.21.15.106:0/2213142074 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05441590b0 0x7f0544151700 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.755+0000 7f0549000640 1 --2- 172.21.15.106:0/2213142074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0544158ce0 0x7f05441511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.755+0000 7f0549000640 1 --2- 172.21.15.106:0/2213142074 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05440c9110 0x7f05440af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.755+0000 7f0549000640 1 -- 172.21.15.106:0/2213142074 >> 172.21.15.106:0/2213142074 conn(0x7f0544067750 msgr2=0x7f05441523c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:57.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.755+0000 7f0549000640 1 -- 172.21.15.106:0/2213142074 shutdown_connections 2024-08-17T02:30:57.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.755+0000 7f0549000640 1 -- 172.21.15.106:0/2213142074 wait complete. 2024-08-17T02:30:57.770 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:57.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.917+0000 7fc0c1600640 1 Processor -- start 2024-08-17T02:30:57.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.918+0000 7fc0c1600640 1 -- start start 2024-08-17T02:30:57.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.919+0000 7fc0c1600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0bc0acd60 0x7fc0bc156f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:57.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.919+0000 7fc0c1600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc0bc1574b0 0x7fc0bc0ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:57.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.919+0000 7fc0c1600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc0bc0ae540 0x7fc0bc066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:57.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.919+0000 7fc0c1600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0bc0aeaa0 con 0x7fc0bc1574b0 2024-08-17T02:30:57.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.919+0000 7fc0c1600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0bc0cb310 con 0x7fc0bc0ae540 2024-08-17T02:30:57.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.919+0000 7fc0c1600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc0ca9e0 con 0x7fc0bc0acd60 2024-08-17T02:30:57.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.919+0000 7fc0b3400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc0bc1574b0 0x7fc0bc0ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:57.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.919+0000 7fc0b3400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc0bc1574b0 0x7fc0bc0ae000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38530/0 (socket says 172.21.15.106:38530) 2024-08-17T02:30:57.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.919+0000 7fc0b3400640 1 -- 172.21.15.106:0/1068854503 learned_addr learned my addr 172.21.15.106:0/1068854503 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:30:57.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.919+0000 7fc0bbe00640 1 --2- 172.21.15.106:0/1068854503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0bc0acd60 0x7fc0bc156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:57.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.919+0000 7fc0c0c00640 1 --2- 172.21.15.106:0/1068854503 >> v2:172.21.15.171:3300/0 conn(0x7fc0bc0ae540 0x7fc0bc066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:57.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.919+0000 7fc0b3400640 1 -- 172.21.15.106:0/1068854503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0bc0acd60 msgr2=0x7fc0bc156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:57.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.919+0000 7fc0b3400640 1 --2- 172.21.15.106:0/1068854503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0bc0acd60 0x7fc0bc156f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.919+0000 7fc0b3400640 1 -- 172.21.15.106:0/1068854503 >> v2:172.21.15.171:3300/0 conn(0x7fc0bc0ae540 msgr2=0x7fc0bc066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:57.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.919+0000 7fc0b3400640 1 --2- 172.21.15.106:0/1068854503 >> v2:172.21.15.171:3300/0 conn(0x7fc0bc0ae540 0x7fc0bc066cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.919+0000 7fc0b3400640 1 -- 172.21.15.106:0/1068854503 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0bc0cacc0 con 0x7fc0bc1574b0 2024-08-17T02:30:57.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.919+0000 7fc0c0c00640 1 --2- 172.21.15.106:0/1068854503 >> v2:172.21.15.171:3300/0 conn(0x7fc0bc0ae540 0x7fc0bc066cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:57.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.920+0000 7fc0b3400640 1 --2- 172.21.15.106:0/1068854503 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0bc1574b0 0x7fc0bc0ae000 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc0cd990 tx=0x7fc0a40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f7b8693efcb3e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:57.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.921+0000 7fc0bb400640 1 -- 172.21.15.106:0/1068854503 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a402ad40 con 0x7fc0bc1574b0 2024-08-17T02:30:57.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.921+0000 7fc0bb400640 1 -- 172.21.15.106:0/1068854503 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a4032440 con 0x7fc0bc1574b0 2024-08-17T02:30:57.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.921+0000 7fc0bb400640 1 -- 172.21.15.106:0/1068854503 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a402aea0 con 0x7fc0bc1574b0 2024-08-17T02:30:57.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.921+0000 7fc0c1600640 1 -- 172.21.15.106:0/1068854503 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0bc1574b0 msgr2=0x7fc0bc0ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:57.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.921+0000 7fc0c1600640 1 --2- 172.21.15.106:0/1068854503 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0bc1574b0 0x7fc0bc0ae000 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc0cd990 tx=0x7fc0a40091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.921+0000 7fc0c1600640 1 -- 172.21.15.106:0/1068854503 shutdown_connections 2024-08-17T02:30:57.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.921+0000 7fc0c1600640 1 --2- 172.21.15.106:0/1068854503 >> v2:172.21.15.171:3300/0 conn(0x7fc0bc0ae540 0x7fc0bc066cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.921+0000 7fc0c1600640 1 --2- 172.21.15.106:0/1068854503 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0bc1574b0 0x7fc0bc0ae000 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.921+0000 7fc0c1600640 1 --2- 172.21.15.106:0/1068854503 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0bc0acd60 0x7fc0bc156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.921+0000 7fc0c1600640 1 -- 172.21.15.106:0/1068854503 >> 172.21.15.106:0/1068854503 conn(0x7fc0bc067de0 msgr2=0x7fc0bc0681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:57.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.921+0000 7fc0c1600640 1 -- 172.21.15.106:0/1068854503 shutdown_connections 2024-08-17T02:30:57.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.921+0000 7fc0c1600640 1 -- 172.21.15.106:0/1068854503 wait complete. 2024-08-17T02:30:57.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.923+0000 7fc0c1600640 1 Processor -- start 2024-08-17T02:30:57.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.923+0000 7fc0c1600640 1 -- start start 2024-08-17T02:30:57.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.924+0000 7fc0c1600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0bc0acd60 0x7fc0bc140260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:57.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.924+0000 7fc0c1600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0bc0ae540 0x7fc0bc153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:57.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.924+0000 7fc0c1600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0bc1574b0 0x7fc0bc154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:57.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.924+0000 7fc0c1600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc14ef80 con 0x7fc0bc0ae540 2024-08-17T02:30:57.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.924+0000 7fc0c1600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc0b18d0 con 0x7fc0bc0acd60 2024-08-17T02:30:57.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.924+0000 7fc0c1600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc0b0cc0 con 0x7fc0bc1574b0 2024-08-17T02:30:57.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.924+0000 7fc0b3400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0bc0ae540 0x7fc0bc153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:57.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.924+0000 7fc0b3400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0bc0ae540 0x7fc0bc153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38540/0 (socket says 172.21.15.106:38540) 2024-08-17T02:30:57.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.924+0000 7fc0b3400640 1 -- 172.21.15.106:0/3881079691 learned_addr learned my addr 172.21.15.106:0/3881079691 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:30:57.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.924+0000 7fc0c0c00640 1 --2- 172.21.15.106:0/3881079691 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0bc1574b0 0x7fc0bc154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:57.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.924+0000 7fc0bbe00640 1 --2- 172.21.15.106:0/3881079691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0bc0acd60 0x7fc0bc140260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:57.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.924+0000 7fc0b3400640 1 -- 172.21.15.106:0/3881079691 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0bc1574b0 msgr2=0x7fc0bc154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:57.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.924+0000 7fc0b3400640 1 --2- 172.21.15.106:0/3881079691 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0bc1574b0 0x7fc0bc154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.924+0000 7fc0b3400640 1 -- 172.21.15.106:0/3881079691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0bc0acd60 msgr2=0x7fc0bc140260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:57.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.924+0000 7fc0b3400640 1 --2- 172.21.15.106:0/3881079691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0bc0acd60 0x7fc0bc140260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:57.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.924+0000 7fc0b3400640 1 -- 172.21.15.106:0/3881079691 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a4009450 con 0x7fc0bc0ae540 2024-08-17T02:30:57.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.925+0000 7fc0b3400640 1 --2- 172.21.15.106:0/3881079691 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0bc0ae540 0x7fc0bc153be0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4009210 tx=0x7fc0a4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:57.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.925+0000 7fc0b3e00640 1 -- 172.21.15.106:0/3881079691 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a4000cc0 con 0x7fc0bc0ae540 2024-08-17T02:30:57.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.925+0000 7fc0b3e00640 1 -- 172.21.15.106:0/3881079691 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a4031a60 con 0x7fc0bc0ae540 2024-08-17T02:30:57.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.925+0000 7fc0c1600640 1 -- 172.21.15.106:0/3881079691 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0bc0b0fa0 con 0x7fc0bc0ae540 2024-08-17T02:30:57.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.925+0000 7fc0b3e00640 1 -- 172.21.15.106:0/3881079691 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a4031e40 con 0x7fc0bc0ae540 2024-08-17T02:30:57.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.925+0000 7fc0c1600640 1 -- 172.21.15.106:0/3881079691 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0bc0b1560 con 0x7fc0bc0ae540 2024-08-17T02:30:57.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.926+0000 7fc0c1600640 1 -- 172.21.15.106:0/3881079691 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0bc071050 con 0x7fc0bc0ae540 2024-08-17T02:30:57.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.927+0000 7fc0b3e00640 1 -- 172.21.15.106:0/3881079691 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc0a4039040 con 0x7fc0bc0ae540 2024-08-17T02:30:57.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.928+0000 7fc0b3e00640 1 --2- 172.21.15.106:0/3881079691 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc098065180 0x7fc098067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:57.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.928+0000 7fc0b3e00640 1 -- 172.21.15.106:0/3881079691 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fc0a40a22f0 con 0x7fc0bc0ae540 2024-08-17T02:30:57.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.928+0000 7fc0bbe00640 1 --2- 172.21.15.106:0/3881079691 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc098065180 0x7fc098067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:57.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.929+0000 7fc0bbe00640 1 --2- 172.21.15.106:0/3881079691 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc098065180 0x7fc098067630 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00bd40 tx=0x7fc0ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:57.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:57.932+0000 7fc0b3e00640 1 -- 172.21.15.106:0/3881079691 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc0a40700e0 con 0x7fc0bc0ae540 2024-08-17T02:30:58.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.140+0000 7fc0c1600640 1 -- 172.21.15.106:0/3881079691 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0bc068bd0 con 0x7fc0bc0ae540 2024-08-17T02:30:58.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.140+0000 7fc0b3e00640 1 -- 172.21.15.106:0/3881079691 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+5693 (secure 0 0 0) 0x7fc0a4073700 con 0x7fc0bc0ae540 2024-08-17T02:30:58.141 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:30:58.141 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4900,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1137148711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1137148711},{"type":"v1","addr":"172.21.15.106:6836","nonce":1137148711}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4903,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3136131297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":3136131297},{"type":"v1","addr":"172.21.15.106:6837","nonce":3136131297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:39.908382+0000","modified":"2024-08-17T02:28:43.540030+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6834/754665763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":754665763},{"type":"v1","addr":"172.21.15.171:6834","nonce":754665763}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:52.606548+0000","modified":"2024-08-17T02:28:54.512181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4909},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4909":{"gid":4909,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.171:6835/3251295288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6833","nonce":3251295288},{"type":"v1","addr":"172.21.15.171:6835","nonce":3251295288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000123149","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:30:58.141 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 20 2024-08-17T02:30:58.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.142+0000 7fc0c1600640 1 -- 172.21.15.106:0/3881079691 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc098065180 msgr2=0x7fc098067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:58.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.142+0000 7fc0c1600640 1 --2- 172.21.15.106:0/3881079691 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc098065180 0x7fc098067630 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00bd40 tx=0x7fc0ac008040 comp rx=0 tx=0).stop 2024-08-17T02:30:58.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.142+0000 7fc0c1600640 1 -- 172.21.15.106:0/3881079691 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0bc0ae540 msgr2=0x7fc0bc153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:58.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.142+0000 7fc0c1600640 1 --2- 172.21.15.106:0/3881079691 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0bc0ae540 0x7fc0bc153be0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4009210 tx=0x7fc0a4032000 comp rx=0 tx=0).stop 2024-08-17T02:30:58.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.142+0000 7fc0c1600640 1 -- 172.21.15.106:0/3881079691 shutdown_connections 2024-08-17T02:30:58.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.142+0000 7fc0c1600640 1 --2- 172.21.15.106:0/3881079691 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc0bc1574b0 0x7fc0bc154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.142+0000 7fc0c1600640 1 --2- 172.21.15.106:0/3881079691 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fc098065180 0x7fc098067630 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.142+0000 7fc0c1600640 1 --2- 172.21.15.106:0/3881079691 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0bc0ae540 0x7fc0bc153be0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.142+0000 7fc0c1600640 1 --2- 172.21.15.106:0/3881079691 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc0bc0acd60 0x7fc0bc140260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.142+0000 7fc0c1600640 1 -- 172.21.15.106:0/3881079691 >> 172.21.15.106:0/3881079691 conn(0x7fc0bc067de0 msgr2=0x7fc0bc0c9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:58.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.142+0000 7fc0c1600640 1 -- 172.21.15.106:0/3881079691 shutdown_connections 2024-08-17T02:30:58.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.142+0000 7fc0c1600640 1 -- 172.21.15.106:0/3881079691 wait complete. 2024-08-17T02:30:58.159 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:30:58.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.308+0000 7f726e200640 1 Processor -- start 2024-08-17T02:30:58.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.308+0000 7f726e200640 1 -- start start 2024-08-17T02:30:58.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.309+0000 7f726e200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f726806df00 0x7f72680adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:58.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.309+0000 7f726e200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7268155df0 0x7f72680ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:58.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.309+0000 7f726e200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7268156670 con 0x7f7268155a20 2024-08-17T02:30:58.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.309+0000 7f726e200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72680b0350 con 0x7f726806df00 2024-08-17T02:30:58.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.309+0000 7f726e200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726806e5e0 con 0x7f7268155df0 2024-08-17T02:30:58.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.310+0000 7f7267400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7268155a20 0x7f726806d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47544/0 (socket says 172.21.15.106:47544) 2024-08-17T02:30:58.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.310+0000 7f7267400640 1 -- 172.21.15.106:0/2031002624 learned_addr learned my addr 172.21.15.106:0/2031002624 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:30:58.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.310+0000 7f725ea00640 1 --2- 172.21.15.106:0/2031002624 >> v2:172.21.15.106:3300/0 conn(0x7f726806df00 0x7f72680adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:58.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.310+0000 7f7267e00640 1 --2- 172.21.15.106:0/2031002624 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7268155df0 0x7f72680ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:58.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.310+0000 7f7266a00640 1 -- 172.21.15.106:0/2031002624 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072622018 0 0) 0x7f7268156670 con 0x7f7268155a20 2024-08-17T02:30:58.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.310+0000 7f7266a00640 1 -- 172.21.15.106:0/2031002624 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f724c0034e0 con 0x7f7268155a20 2024-08-17T02:30:58.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.310+0000 7f725ea00640 1 -- 172.21.15.106:0/2031002624 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7268155df0 msgr2=0x7f72680ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:58.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.310+0000 7f725ea00640 1 --2- 172.21.15.106:0/2031002624 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7268155df0 0x7f72680ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.310+0000 7f725ea00640 1 -- 172.21.15.106:0/2031002624 >> v1:172.21.15.106:6789/0 conn(0x7f7268155a20 legacy=0x7f726806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:58.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.310+0000 7f725ea00640 1 -- 172.21.15.106:0/2031002624 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726806e8c0 con 0x7f726806df00 2024-08-17T02:30:58.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.311+0000 7f725ea00640 1 --2- 172.21.15.106:0/2031002624 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f726806df00 0x7f72680adf10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7250009850 tx=0x7f72500090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f9e29df1327e861 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:58.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.311+0000 7f7266a00640 1 -- 172.21.15.106:0/2031002624 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725002ad90 con 0x7f726806df00 2024-08-17T02:30:58.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.311+0000 7f7266a00640 1 -- 172.21.15.106:0/2031002624 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7250032440 con 0x7f726806df00 2024-08-17T02:30:58.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.311+0000 7f7266a00640 1 -- 172.21.15.106:0/2031002624 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7250032800 con 0x7f726806df00 2024-08-17T02:30:58.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.312+0000 7f726e200640 1 -- 172.21.15.106:0/2031002624 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f726806df00 msgr2=0x7f72680adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:58.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.312+0000 7f726e200640 1 --2- 172.21.15.106:0/2031002624 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f726806df00 0x7f72680adf10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7250009850 tx=0x7f72500090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.312+0000 7f726e200640 1 -- 172.21.15.106:0/2031002624 shutdown_connections 2024-08-17T02:30:58.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.312+0000 7f726e200640 1 --2- 172.21.15.106:0/2031002624 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7268155df0 0x7f72680ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.312+0000 7f726e200640 1 --2- 172.21.15.106:0/2031002624 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f726806df00 0x7f72680adf10 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.312+0000 7f726e200640 1 -- 172.21.15.106:0/2031002624 >> 172.21.15.106:0/2031002624 conn(0x7f72680cb9b0 msgr2=0x7f72680cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:58.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.312+0000 7f726e200640 1 -- 172.21.15.106:0/2031002624 shutdown_connections 2024-08-17T02:30:58.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.312+0000 7f726e200640 1 -- 172.21.15.106:0/2031002624 wait complete. 2024-08-17T02:30:58.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.314+0000 7f726e200640 1 Processor -- start 2024-08-17T02:30:58.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.314+0000 7f726e200640 1 -- start start 2024-08-17T02:30:58.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.315+0000 7f726e200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f726806df00 0x7f7268169ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:58.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.315+0000 7f726e200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7268155a20 0x7f726815b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:58.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.315+0000 7f726e200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7268155df0 0x7f72681522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:58.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.315+0000 7f726e200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7268169650 con 0x7f726806df00 2024-08-17T02:30:58.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.315+0000 7f726e200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726815bbc0 con 0x7f7268155df0 2024-08-17T02:30:58.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.315+0000 7f726e200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726815bea0 con 0x7f7268155a20 2024-08-17T02:30:58.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.315+0000 7f7267400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f726806df00 0x7f7268169ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:58.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.315+0000 7f7267400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f726806df00 0x7f7268169ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38560/0 (socket says 172.21.15.106:38560) 2024-08-17T02:30:58.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.315+0000 7f7267400640 1 -- 172.21.15.106:0/1712061313 learned_addr learned my addr 172.21.15.106:0/1712061313 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:30:58.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.315+0000 7f725ea00640 1 --2- 172.21.15.106:0/1712061313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7268155a20 0x7f726815b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:58.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.315+0000 7f7267e00640 1 --2- 172.21.15.106:0/1712061313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7268155df0 0x7f72681522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:58.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.315+0000 7f7267400640 1 -- 172.21.15.106:0/1712061313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7268155a20 msgr2=0x7f726815b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:58.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.315+0000 7f7267400640 1 --2- 172.21.15.106:0/1712061313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7268155a20 0x7f726815b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.315+0000 7f7267400640 1 -- 172.21.15.106:0/1712061313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7268155df0 msgr2=0x7f72681522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:58.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.315+0000 7f7267400640 1 --2- 172.21.15.106:0/1712061313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7268155df0 0x7f72681522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.315+0000 7f7267400640 1 -- 172.21.15.106:0/1712061313 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7250009390 con 0x7f726806df00 2024-08-17T02:30:58.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.315+0000 7f725ea00640 1 --2- 172.21.15.106:0/1712061313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7268155a20 0x7f726815b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:58.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.315+0000 7f7267400640 1 --2- 172.21.15.106:0/1712061313 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f726806df00 0x7f7268169ae0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f725800c560 tx=0x7f7258007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:58.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.316+0000 7f725f400640 1 -- 172.21.15.106:0/1712061313 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7258005aa0 con 0x7f726806df00 2024-08-17T02:30:58.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.316+0000 7f725f400640 1 -- 172.21.15.106:0/1712061313 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7258005c00 con 0x7f726806df00 2024-08-17T02:30:58.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.316+0000 7f725f400640 1 -- 172.21.15.106:0/1712061313 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72580070d0 con 0x7f726806df00 2024-08-17T02:30:58.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.316+0000 7f726e200640 1 -- 172.21.15.106:0/1712061313 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72681692e0 con 0x7f726806df00 2024-08-17T02:30:58.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.316+0000 7f726e200640 1 -- 172.21.15.106:0/1712061313 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726815b790 con 0x7f726806df00 2024-08-17T02:30:58.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.317+0000 7f726e200640 1 -- 172.21.15.106:0/1712061313 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7268169100 con 0x7f726806df00 2024-08-17T02:30:58.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.318+0000 7f725f400640 1 -- 172.21.15.106:0/1712061313 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f72580074c0 con 0x7f726806df00 2024-08-17T02:30:58.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.318+0000 7f725f400640 1 --2- 172.21.15.106:0/1712061313 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7244065150 0x7f7244067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:58.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.319+0000 7f725f400640 1 -- 172.21.15.106:0/1712061313 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f7258081cc0 con 0x7f726806df00 2024-08-17T02:30:58.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.319+0000 7f725ea00640 1 --2- 172.21.15.106:0/1712061313 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7244065150 0x7f7244067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:58.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.319+0000 7f725ea00640 1 --2- 172.21.15.106:0/1712061313 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7244065150 0x7f7244067600 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7250034000 tx=0x7f7250032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:58.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.322+0000 7f725f400640 1 -- 172.21.15.106:0/1712061313 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f725804fa00 con 0x7f726806df00 2024-08-17T02:30:58.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.499+0000 7f726e200640 1 -- 172.21.15.106:0/1712061313 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7268064db0 con 0x7f726806df00 2024-08-17T02:30:58.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.500+0000 7f725f400640 1 -- 172.21.15.106:0/1712061313 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18647 (secure 0 0 0) 0x7f7258053020 con 0x7f726806df00 2024-08-17T02:30:58.500 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:30:58.501 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":37,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:28:55.604010+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:37.880632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:38.897913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000123149.meta","create_time":"2024-08-17T02:28:50.720877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000123149"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000123149.data","create_time":"2024-08-17T02:28:51.638596+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000123149"}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:30:58.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.502+0000 7f726e200640 1 -- 172.21.15.106:0/1712061313 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7244065150 msgr2=0x7f7244067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:58.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.502+0000 7f726e200640 1 --2- 172.21.15.106:0/1712061313 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7244065150 0x7f7244067600 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7250034000 tx=0x7f7250032000 comp rx=0 tx=0).stop 2024-08-17T02:30:58.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.502+0000 7f726e200640 1 -- 172.21.15.106:0/1712061313 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f726806df00 msgr2=0x7f7268169ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:58.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.502+0000 7f726e200640 1 --2- 172.21.15.106:0/1712061313 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f726806df00 0x7f7268169ae0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f725800c560 tx=0x7f7258007d60 comp rx=0 tx=0).stop 2024-08-17T02:30:58.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.502+0000 7f726e200640 1 -- 172.21.15.106:0/1712061313 shutdown_connections 2024-08-17T02:30:58.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.502+0000 7f726e200640 1 --2- 172.21.15.106:0/1712061313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7268155df0 0x7f72681522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.502+0000 7f726e200640 1 --2- 172.21.15.106:0/1712061313 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7268155a20 0x7f726815b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.502+0000 7f726e200640 1 --2- 172.21.15.106:0/1712061313 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7244065150 0x7f7244067600 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.502+0000 7f726e200640 1 --2- 172.21.15.106:0/1712061313 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f726806df00 0x7f7268169ae0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.502+0000 7f726e200640 1 -- 172.21.15.106:0/1712061313 >> 172.21.15.106:0/1712061313 conn(0x7f72680cb9b0 msgr2=0x7f7268154c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:58.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.502+0000 7f726e200640 1 -- 172.21.15.106:0/1712061313 shutdown_connections 2024-08-17T02:30:58.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.502+0000 7f726e200640 1 -- 172.21.15.106:0/1712061313 wait complete. 2024-08-17T02:30:58.518 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:30:58.518 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:58.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.664+0000 7f8411e00640 1 Processor -- start 2024-08-17T02:30:58.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.665+0000 7f8411e00640 1 -- start start 2024-08-17T02:30:58.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.666+0000 7f8411e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f840c155900 0x7f840c155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:58.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.666+0000 7f8411e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f840c0b0270 0x7f840c156210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:58.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.666+0000 7f8411e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f840c157690 con 0x7f840c157b20 2024-08-17T02:30:58.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.666+0000 7f8411e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f840c156a80 con 0x7f840c0b0270 2024-08-17T02:30:58.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.666+0000 7f8411e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840c156d60 con 0x7f840c155900 2024-08-17T02:30:58.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.666+0000 7f8403e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f840c0b0270 0x7f840c156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:58.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.666+0000 7f8403e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f840c0b0270 0x7f840c156210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38576/0 (socket says 172.21.15.106:38576) 2024-08-17T02:30:58.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.666+0000 7f8403e00640 1 -- 172.21.15.106:0/1497727825 learned_addr learned my addr 172.21.15.106:0/1497727825 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:30:58.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.667+0000 7f8410a00640 1 --2- 172.21.15.106:0/1497727825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f840c155900 0x7f840c155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:58.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.667+0000 7f8403e00640 1 -- 172.21.15.106:0/1497727825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f840c155900 msgr2=0x7f840c155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:58.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.667+0000 7f8403e00640 1 --2- 172.21.15.106:0/1497727825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f840c155900 0x7f840c155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.667+0000 7f8403e00640 1 -- 172.21.15.106:0/1497727825 >> v1:172.21.15.106:6789/0 conn(0x7f840c157b20 legacy=0x7f840c157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:58.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.667+0000 7f8403e00640 1 -- 172.21.15.106:0/1497727825 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840c157040 con 0x7f840c0b0270 2024-08-17T02:30:58.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.667+0000 7f840be00640 1 -- 172.21.15.106:0/1497727825 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 972546612 0 0) 0x7f840c157690 con 0x7f840c157b20 2024-08-17T02:30:58.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.667+0000 7f8410a00640 1 --2- 172.21.15.106:0/1497727825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f840c155900 0x7f840c155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:58.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.668+0000 7f8403e00640 1 --2- 172.21.15.106:0/1497727825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f840c0b0270 0x7f840c156210 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f83f400bbc0 tx=0x7f83f400b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfc6141d0bc5745 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:58.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.668+0000 7f840be00640 1 -- 172.21.15.106:0/1497727825 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4032620 con 0x7f840c0b0270 2024-08-17T02:30:58.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.668+0000 7f840be00640 1 -- 172.21.15.106:0/1497727825 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f402e040 con 0x7f840c0b0270 2024-08-17T02:30:58.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.668+0000 7f840be00640 1 -- 172.21.15.106:0/1497727825 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f40329b0 con 0x7f840c0b0270 2024-08-17T02:30:58.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.669+0000 7f8411e00640 1 -- 172.21.15.106:0/1497727825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f840c0b0270 msgr2=0x7f840c156210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:58.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.669+0000 7f8411e00640 1 --2- 172.21.15.106:0/1497727825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f840c0b0270 0x7f840c156210 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f83f400bbc0 tx=0x7f83f400b460 comp rx=0 tx=0).stop 2024-08-17T02:30:58.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.669+0000 7f8411e00640 1 -- 172.21.15.106:0/1497727825 shutdown_connections 2024-08-17T02:30:58.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.669+0000 7f8411e00640 1 --2- 172.21.15.106:0/1497727825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f840c0b0270 0x7f840c156210 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.669+0000 7f8411e00640 1 --2- 172.21.15.106:0/1497727825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f840c155900 0x7f840c155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.669+0000 7f8411e00640 1 -- 172.21.15.106:0/1497727825 >> 172.21.15.106:0/1497727825 conn(0x7f840c067750 msgr2=0x7f840c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:58.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.669+0000 7f8411e00640 1 -- 172.21.15.106:0/1497727825 shutdown_connections 2024-08-17T02:30:58.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.669+0000 7f8411e00640 1 -- 172.21.15.106:0/1497727825 wait complete. 2024-08-17T02:30:58.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.670+0000 7f8411e00640 1 Processor -- start 2024-08-17T02:30:58.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.670+0000 7f8411e00640 1 -- start start 2024-08-17T02:30:58.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.671+0000 7f8411e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f840c0b0270 0x7f840c152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:58.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.671+0000 7f8411e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f840c155900 0x7f840c153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:58.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.671+0000 7f8411e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f840c157b20 0x7f840c154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:58.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.671+0000 7f8411e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c168e30 con 0x7f840c0b0270 2024-08-17T02:30:58.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.671+0000 7f8411e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c0ca730 con 0x7f840c157b20 2024-08-17T02:30:58.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.671+0000 7f8411e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840c0caa10 con 0x7f840c155900 2024-08-17T02:30:58.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.671+0000 7f8410a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f840c0b0270 0x7f840c152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:58.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.671+0000 7f8410a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f840c0b0270 0x7f840c152400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38584/0 (socket says 172.21.15.106:38584) 2024-08-17T02:30:58.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.671+0000 7f8410a00640 1 -- 172.21.15.106:0/4276104186 learned_addr learned my addr 172.21.15.106:0/4276104186 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:30:58.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.672+0000 7f8403e00640 1 --2- 172.21.15.106:0/4276104186 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f840c155900 0x7f840c153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:58.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.672+0000 7f8410a00640 1 -- 172.21.15.106:0/4276104186 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f840c155900 msgr2=0x7f840c153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:58.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.672+0000 7f8410a00640 1 --2- 172.21.15.106:0/4276104186 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f840c155900 0x7f840c153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.672+0000 7f8410a00640 1 -- 172.21.15.106:0/4276104186 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f840c157b20 msgr2=0x7f840c154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:58.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.672+0000 7f8411400640 1 --2- 172.21.15.106:0/4276104186 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f840c157b20 0x7f840c154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:58.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.672+0000 7f8410a00640 1 --2- 172.21.15.106:0/4276104186 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f840c157b20 0x7f840c154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.672+0000 7f8410a00640 1 -- 172.21.15.106:0/4276104186 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f400b700 con 0x7f840c0b0270 2024-08-17T02:30:58.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.672+0000 7f8411400640 1 --2- 172.21.15.106:0/4276104186 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f840c157b20 0x7f840c154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:58.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.672+0000 7f8403e00640 1 --2- 172.21.15.106:0/4276104186 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f840c155900 0x7f840c153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:58.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.672+0000 7f8410a00640 1 --2- 172.21.15.106:0/4276104186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f840c0b0270 0x7f840c152400 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00c880 tx=0x7f83fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:58.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.672+0000 7f8408c00640 1 -- 172.21.15.106:0/4276104186 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc00ce10 con 0x7f840c0b0270 2024-08-17T02:30:58.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.672+0000 7f8408c00640 1 -- 172.21.15.106:0/4276104186 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83fc007890 con 0x7f840c0b0270 2024-08-17T02:30:58.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.672+0000 7f8408c00640 1 -- 172.21.15.106:0/4276104186 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc007c50 con 0x7f840c0b0270 2024-08-17T02:30:58.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.672+0000 7f8411e00640 1 -- 172.21.15.106:0/4276104186 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f840c0cacf0 con 0x7f840c0b0270 2024-08-17T02:30:58.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.672+0000 7f8411e00640 1 -- 172.21.15.106:0/4276104186 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f840c152940 con 0x7f840c0b0270 2024-08-17T02:30:58.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.674+0000 7f8411e00640 1 -- 172.21.15.106:0/4276104186 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f840c168f80 con 0x7f840c0b0270 2024-08-17T02:30:58.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.674+0000 7f8408c00640 1 -- 172.21.15.106:0/4276104186 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f83fc0113f0 con 0x7f840c0b0270 2024-08-17T02:30:58.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.675+0000 7f8408c00640 1 --2- 172.21.15.106:0/4276104186 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f83e8065150 0x7f83e8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:58.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.675+0000 7f8408c00640 1 -- 172.21.15.106:0/4276104186 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f83fc082710 con 0x7f840c0b0270 2024-08-17T02:30:58.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.675+0000 7f8403e00640 1 --2- 172.21.15.106:0/4276104186 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f83e8065150 0x7f83e8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:58.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.676+0000 7f8403e00640 1 --2- 172.21.15.106:0/4276104186 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f83e8065150 0x7f83e8067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f83f4037000 tx=0x7f83f403a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:58.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.679+0000 7f8408c00640 1 -- 172.21.15.106:0/4276104186 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f83fc050450 con 0x7f840c0b0270 2024-08-17T02:30:58.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.886+0000 7f8411e00640 1 -- 172.21.15.106:0/4276104186 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f840c071050 con 0x7f840c0b0270 2024-08-17T02:30:58.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.886+0000 7f8408c00640 1 -- 172.21.15.106:0/4276104186 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+5693 (secure 0 0 0) 0x7f83fc053a70 con 0x7f840c0b0270 2024-08-17T02:30:58.887 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:30:58.887 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4900,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1137148711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1137148711},{"type":"v1","addr":"172.21.15.106:6836","nonce":1137148711}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4903,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3136131297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":3136131297},{"type":"v1","addr":"172.21.15.106:6837","nonce":3136131297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:39.908382+0000","modified":"2024-08-17T02:28:43.540030+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6834/754665763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":754665763},{"type":"v1","addr":"172.21.15.171:6834","nonce":754665763}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:52.606548+0000","modified":"2024-08-17T02:28:54.512181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4909},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4909":{"gid":4909,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.171:6835/3251295288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6833","nonce":3251295288},{"type":"v1","addr":"172.21.15.171:6835","nonce":3251295288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000123149","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:30:58.887 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 20 2024-08-17T02:30:58.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.888+0000 7f8411e00640 1 -- 172.21.15.106:0/4276104186 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f83e8065150 msgr2=0x7f83e8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:58.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.888+0000 7f8411e00640 1 --2- 172.21.15.106:0/4276104186 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f83e8065150 0x7f83e8067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f83f4037000 tx=0x7f83f403a000 comp rx=0 tx=0).stop 2024-08-17T02:30:58.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.888+0000 7f8411e00640 1 -- 172.21.15.106:0/4276104186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f840c0b0270 msgr2=0x7f840c152400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:58.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.888+0000 7f8411e00640 1 --2- 172.21.15.106:0/4276104186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f840c0b0270 0x7f840c152400 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00c880 tx=0x7f83fc008040 comp rx=0 tx=0).stop 2024-08-17T02:30:58.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.889+0000 7f8411e00640 1 -- 172.21.15.106:0/4276104186 shutdown_connections 2024-08-17T02:30:58.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.889+0000 7f8411e00640 1 --2- 172.21.15.106:0/4276104186 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f840c157b20 0x7f840c154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.889+0000 7f8411e00640 1 --2- 172.21.15.106:0/4276104186 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f840c155900 0x7f840c153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.889+0000 7f8411e00640 1 --2- 172.21.15.106:0/4276104186 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f83e8065150 0x7f83e8067600 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.889+0000 7f8411e00640 1 --2- 172.21.15.106:0/4276104186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f840c0b0270 0x7f840c152400 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:58.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.889+0000 7f8411e00640 1 -- 172.21.15.106:0/4276104186 >> 172.21.15.106:0/4276104186 conn(0x7f840c067750 msgr2=0x7f840c157fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:58.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.889+0000 7f8411e00640 1 -- 172.21.15.106:0/4276104186 shutdown_connections 2024-08-17T02:30:58.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:58.889+0000 7f8411e00640 1 -- 172.21.15.106:0/4276104186 wait complete. 2024-08-17T02:30:58.904 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:59.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.050+0000 7fcc87000640 1 Processor -- start 2024-08-17T02:30:59.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.050+0000 7fcc87000640 1 -- start start 2024-08-17T02:30:59.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.051+0000 7fcc87000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fcc800ada20 0x7fcc800c8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:59.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.051+0000 7fcc87000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc80159c40 0x7fcc800addf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:59.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.051+0000 7fcc87000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc800ae6b0 con 0x7fcc800cae60 2024-08-17T02:30:59.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.051+0000 7fcc87000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc800af230 con 0x7fcc800ada20 2024-08-17T02:30:59.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.051+0000 7fcc87000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc800ae900 con 0x7fcc80159c40 2024-08-17T02:30:59.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.052+0000 7fcc85200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc80159c40 0x7fcc800addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:59.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.052+0000 7fcc85c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fcc800ada20 0x7fcc800c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:59.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.052+0000 7fcc85200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc80159c40 0x7fcc800addf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:39224/0 (socket says 172.21.15.106:39224) 2024-08-17T02:30:59.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.052+0000 7fcc85200640 1 -- 172.21.15.106:0/296935501 learned_addr learned my addr 172.21.15.106:0/296935501 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:30:59.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.052+0000 7fcc85200640 1 -- 172.21.15.106:0/296935501 >> v2:172.21.15.171:3300/0 conn(0x7fcc800ada20 msgr2=0x7fcc800c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:59.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.052+0000 7fcc85200640 1 --2- 172.21.15.106:0/296935501 >> v2:172.21.15.171:3300/0 conn(0x7fcc800ada20 0x7fcc800c8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.052+0000 7fcc85200640 1 -- 172.21.15.106:0/296935501 >> v1:172.21.15.171:6789/0 conn(0x7fcc800cae60 legacy=0x7fcc80154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:59.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.052+0000 7fcc85200640 1 -- 172.21.15.106:0/296935501 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc800aebe0 con 0x7fcc80159c40 2024-08-17T02:30:59.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.053+0000 7fcc85200640 1 --2- 172.21.15.106:0/296935501 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc80159c40 0x7fcc800addf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c009910 tx=0x7fcc6c0091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec2fd710c0e6675 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:59.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.053+0000 7fcc7fe00640 1 -- 172.21.15.106:0/296935501 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c02ae40 con 0x7fcc80159c40 2024-08-17T02:30:59.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.053+0000 7fcc7fe00640 1 -- 172.21.15.106:0/296935501 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6c032440 con 0x7fcc80159c40 2024-08-17T02:30:59.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.053+0000 7fcc7fe00640 1 -- 172.21.15.106:0/296935501 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c032820 con 0x7fcc80159c40 2024-08-17T02:30:59.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.054+0000 7fcc87000640 1 -- 172.21.15.106:0/296935501 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc80159c40 msgr2=0x7fcc800addf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:59.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.054+0000 7fcc87000640 1 --2- 172.21.15.106:0/296935501 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc80159c40 0x7fcc800addf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c009910 tx=0x7fcc6c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.054+0000 7fcc87000640 1 -- 172.21.15.106:0/296935501 shutdown_connections 2024-08-17T02:30:59.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.054+0000 7fcc87000640 1 --2- 172.21.15.106:0/296935501 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc80159c40 0x7fcc800addf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.054+0000 7fcc87000640 1 --2- 172.21.15.106:0/296935501 >> v2:172.21.15.171:3300/0 conn(0x7fcc800ada20 0x7fcc800c8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.054+0000 7fcc87000640 1 -- 172.21.15.106:0/296935501 >> 172.21.15.106:0/296935501 conn(0x7fcc80067750 msgr2=0x7fcc800cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:59.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.054+0000 7fcc87000640 1 -- 172.21.15.106:0/296935501 shutdown_connections 2024-08-17T02:30:59.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.054+0000 7fcc87000640 1 -- 172.21.15.106:0/296935501 wait complete. 2024-08-17T02:30:59.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.056+0000 7fcc87000640 1 Processor -- start 2024-08-17T02:30:59.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.056+0000 7fcc87000640 1 -- start start 2024-08-17T02:30:59.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.057+0000 7fcc87000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc800ada20 0x7fcc801488d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:59.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.057+0000 7fcc87000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc800cae60 0x7fcc801569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:59.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.057+0000 7fcc87000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc80159c40 0x7fcc80154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:59.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.057+0000 7fcc87000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc80155c20 con 0x7fcc80159c40 2024-08-17T02:30:59.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.057+0000 7fcc87000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc80155660 con 0x7fcc800ada20 2024-08-17T02:30:59.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.057+0000 7fcc87000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc80155940 con 0x7fcc800cae60 2024-08-17T02:30:59.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.057+0000 7fcc86600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc80159c40 0x7fcc80154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:59.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.057+0000 7fcc85c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc800ada20 0x7fcc801488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:59.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.057+0000 7fcc86600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc80159c40 0x7fcc80154c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38590/0 (socket says 172.21.15.106:38590) 2024-08-17T02:30:59.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.057+0000 7fcc86600640 1 -- 172.21.15.106:0/774736915 learned_addr learned my addr 172.21.15.106:0/774736915 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:30:59.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.057+0000 7fcc85c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc800ada20 0x7fcc801488d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:49622/0 (socket says 172.21.15.106:49622) 2024-08-17T02:30:59.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.057+0000 7fcc85200640 1 --2- 172.21.15.106:0/774736915 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc800cae60 0x7fcc801569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:59.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.057+0000 7fcc86600640 1 -- 172.21.15.106:0/774736915 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc800cae60 msgr2=0x7fcc801569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:59.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.057+0000 7fcc86600640 1 --2- 172.21.15.106:0/774736915 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc800cae60 0x7fcc801569e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.057+0000 7fcc86600640 1 -- 172.21.15.106:0/774736915 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc800ada20 msgr2=0x7fcc801488d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:59.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.057+0000 7fcc86600640 1 --2- 172.21.15.106:0/774736915 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc800ada20 0x7fcc801488d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.057+0000 7fcc86600640 1 -- 172.21.15.106:0/774736915 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6c009450 con 0x7fcc80159c40 2024-08-17T02:30:59.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.058+0000 7fcc86600640 1 --2- 172.21.15.106:0/774736915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc80159c40 0x7fcc80154c10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fcc7800c860 tx=0x7fcc78001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:59.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.058+0000 7fcc7cc00640 1 -- 172.21.15.106:0/774736915 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7800ce50 con 0x7fcc80159c40 2024-08-17T02:30:59.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.058+0000 7fcc7cc00640 1 -- 172.21.15.106:0/774736915 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7800a850 con 0x7fcc80159c40 2024-08-17T02:30:59.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.058+0000 7fcc7cc00640 1 -- 172.21.15.106:0/774736915 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7800ac10 con 0x7fcc80159c40 2024-08-17T02:30:59.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.058+0000 7fcc87000640 1 -- 172.21.15.106:0/774736915 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc801561e0 con 0x7fcc80159c40 2024-08-17T02:30:59.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.058+0000 7fcc87000640 1 -- 172.21.15.106:0/774736915 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc80158850 con 0x7fcc80159c40 2024-08-17T02:30:59.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.059+0000 7fcc87000640 1 -- 172.21.15.106:0/774736915 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc80156040 con 0x7fcc80159c40 2024-08-17T02:30:59.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.060+0000 7fcc7cc00640 1 -- 172.21.15.106:0/774736915 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcc78012630 con 0x7fcc80159c40 2024-08-17T02:30:59.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.061+0000 7fcc7cc00640 1 --2- 172.21.15.106:0/774736915 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcc60065150 0x7fcc60067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:59.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.061+0000 7fcc7cc00640 1 -- 172.21.15.106:0/774736915 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fcc780828c0 con 0x7fcc80159c40 2024-08-17T02:30:59.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.061+0000 7fcc85c00640 1 --2- 172.21.15.106:0/774736915 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcc60065150 0x7fcc60067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:59.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.062+0000 7fcc85c00640 1 --2- 172.21.15.106:0/774736915 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcc60065150 0x7fcc60067600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcc74009d20 tx=0x7fcc740090f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:59.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.064+0000 7fcc7cc00640 1 -- 172.21.15.106:0/774736915 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcc80156040 con 0x7fcc80159c40 2024-08-17T02:30:59.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.273+0000 7fcc87000640 1 -- 172.21.15.106:0/774736915 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc800ac2d0 con 0x7fcc80159c40 2024-08-17T02:30:59.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.273+0000 7fcc7cc00640 1 -- 172.21.15.106:0/774736915 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+5693 (secure 0 0 0) 0x7fcc800ac2d0 con 0x7fcc80159c40 2024-08-17T02:30:59.275 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:30:59.275 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4900,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1137148711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1137148711},{"type":"v1","addr":"172.21.15.106:6836","nonce":1137148711}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4903,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3136131297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":3136131297},{"type":"v1","addr":"172.21.15.106:6837","nonce":3136131297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:39.908382+0000","modified":"2024-08-17T02:28:43.540030+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6834/754665763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":754665763},{"type":"v1","addr":"172.21.15.171:6834","nonce":754665763}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:52.606548+0000","modified":"2024-08-17T02:28:54.512181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4909},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4909":{"gid":4909,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.171:6835/3251295288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6833","nonce":3251295288},{"type":"v1","addr":"172.21.15.171:6835","nonce":3251295288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000123149","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:30:59.275 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 20 2024-08-17T02:30:59.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.276+0000 7fcc87000640 1 -- 172.21.15.106:0/774736915 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcc60065150 msgr2=0x7fcc60067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:59.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.276+0000 7fcc87000640 1 --2- 172.21.15.106:0/774736915 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcc60065150 0x7fcc60067600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcc74009d20 tx=0x7fcc740090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.276+0000 7fcc87000640 1 -- 172.21.15.106:0/774736915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc80159c40 msgr2=0x7fcc80154c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:59.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.276+0000 7fcc87000640 1 --2- 172.21.15.106:0/774736915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc80159c40 0x7fcc80154c10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fcc7800c860 tx=0x7fcc78001690 comp rx=0 tx=0).stop 2024-08-17T02:30:59.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.276+0000 7fcc87000640 1 -- 172.21.15.106:0/774736915 shutdown_connections 2024-08-17T02:30:59.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.276+0000 7fcc87000640 1 --2- 172.21.15.106:0/774736915 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fcc60065150 0x7fcc60067600 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.276+0000 7fcc87000640 1 --2- 172.21.15.106:0/774736915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc80159c40 0x7fcc80154c10 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.276+0000 7fcc87000640 1 --2- 172.21.15.106:0/774736915 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc800cae60 0x7fcc801569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.276+0000 7fcc87000640 1 --2- 172.21.15.106:0/774736915 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc800ada20 0x7fcc801488d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.276+0000 7fcc87000640 1 -- 172.21.15.106:0/774736915 >> 172.21.15.106:0/774736915 conn(0x7fcc80067750 msgr2=0x7fcc8006c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:59.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.276+0000 7fcc87000640 1 -- 172.21.15.106:0/774736915 shutdown_connections 2024-08-17T02:30:59.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.276+0000 7fcc87000640 1 -- 172.21.15.106:0/774736915 wait complete. 2024-08-17T02:30:59.292 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:30:59.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.438+0000 7f58a4a00640 1 Processor -- start 2024-08-17T02:30:59.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.438+0000 7f58a4a00640 1 -- start start 2024-08-17T02:30:59.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.439+0000 7f58a4a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58a0155a20 0x7f58a00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:59.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.439+0000 7f58a4a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f58a0155df0 0x7f58a00ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:59.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.439+0000 7f58a4a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f58a006d7f0 0x7f58a006dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:59.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.439+0000 7f58a4a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a00b0350 con 0x7f58a006d7f0 2024-08-17T02:30:59.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.439+0000 7f58a4a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a006e1d0 con 0x7f58a0155df0 2024-08-17T02:30:59.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.439+0000 7f58a4a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a0156670 con 0x7f58a0155a20 2024-08-17T02:30:59.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.440+0000 7f589e800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f58a006d7f0 0x7f58a006dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:59.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.440+0000 7f589e800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f58a006d7f0 0x7f58a006dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38606/0 (socket says 172.21.15.106:38606) 2024-08-17T02:30:59.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.440+0000 7f589e800640 1 -- 172.21.15.106:0/422865511 learned_addr learned my addr 172.21.15.106:0/422865511 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:30:59.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.440+0000 7f589de00640 1 --2- 172.21.15.106:0/422865511 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58a0155a20 0x7f58a00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:59.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.440+0000 7f5895400640 1 --2- 172.21.15.106:0/422865511 >> v2:172.21.15.171:3300/0 conn(0x7f58a0155df0 0x7f58a00ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:59.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.440+0000 7f589e800640 1 -- 172.21.15.106:0/422865511 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58a0155a20 msgr2=0x7f58a00adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:59.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.440+0000 7f589e800640 1 --2- 172.21.15.106:0/422865511 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58a0155a20 0x7f58a00adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.440+0000 7f589e800640 1 -- 172.21.15.106:0/422865511 >> v2:172.21.15.171:3300/0 conn(0x7f58a0155df0 msgr2=0x7f58a00ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:59.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.440+0000 7f589e800640 1 --2- 172.21.15.106:0/422865511 >> v2:172.21.15.171:3300/0 conn(0x7f58a0155df0 0x7f58a00ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.440+0000 7f589e800640 1 -- 172.21.15.106:0/422865511 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a006e5e0 con 0x7f58a006d7f0 2024-08-17T02:30:59.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.440+0000 7f5895400640 1 --2- 172.21.15.106:0/422865511 >> v2:172.21.15.171:3300/0 conn(0x7f58a0155df0 0x7f58a00ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:59.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.441+0000 7f589e800640 1 --2- 172.21.15.106:0/422865511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58a006d7f0 0x7f58a006dc90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f58a006c4d0 tx=0x7f5898009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a032cbc3ccf6a286 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:59.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.441+0000 7f589d400640 1 -- 172.21.15.106:0/422865511 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5898031400 con 0x7f58a006d7f0 2024-08-17T02:30:59.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.442+0000 7f589d400640 1 -- 172.21.15.106:0/422865511 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589802d050 con 0x7f58a006d7f0 2024-08-17T02:30:59.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.442+0000 7f589d400640 1 -- 172.21.15.106:0/422865511 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58980317d0 con 0x7f58a006d7f0 2024-08-17T02:30:59.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.442+0000 7f58a4a00640 1 -- 172.21.15.106:0/422865511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58a006d7f0 msgr2=0x7f58a006dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:59.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.442+0000 7f58a4a00640 1 --2- 172.21.15.106:0/422865511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58a006d7f0 0x7f58a006dc90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f58a006c4d0 tx=0x7f5898009840 comp rx=0 tx=0).stop 2024-08-17T02:30:59.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.442+0000 7f58a4a00640 1 -- 172.21.15.106:0/422865511 shutdown_connections 2024-08-17T02:30:59.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.442+0000 7f58a4a00640 1 --2- 172.21.15.106:0/422865511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58a006d7f0 0x7f58a006dc90 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.442+0000 7f58a4a00640 1 --2- 172.21.15.106:0/422865511 >> v2:172.21.15.171:3300/0 conn(0x7f58a0155df0 0x7f58a00ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.442+0000 7f58a4a00640 1 --2- 172.21.15.106:0/422865511 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58a0155a20 0x7f58a00adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.442+0000 7f58a4a00640 1 -- 172.21.15.106:0/422865511 >> 172.21.15.106:0/422865511 conn(0x7f58a00cb9b0 msgr2=0x7f58a00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:59.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.442+0000 7f58a4a00640 1 -- 172.21.15.106:0/422865511 shutdown_connections 2024-08-17T02:30:59.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.442+0000 7f58a4a00640 1 -- 172.21.15.106:0/422865511 wait complete. 2024-08-17T02:30:59.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.444+0000 7f58a4a00640 1 Processor -- start 2024-08-17T02:30:59.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.444+0000 7f58a4a00640 1 -- start start 2024-08-17T02:30:59.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.444+0000 7f58a4a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58a006d7f0 0x7f58a013bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:59.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.445+0000 7f58a4a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58a0155a20 0x7f58a013c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:59.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.445+0000 7f58a4a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58a0155df0 0x7f58a016c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:59.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.445+0000 7f58a4a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a013cd00 con 0x7f58a006d7f0 2024-08-17T02:30:59.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.445+0000 7f58a4a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a013cfe0 con 0x7f58a0155df0 2024-08-17T02:30:59.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.445+0000 7f58a4a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a013d2c0 con 0x7f58a0155a20 2024-08-17T02:30:59.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.445+0000 7f589de00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58a006d7f0 0x7f58a013bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:59.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.445+0000 7f589de00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58a006d7f0 0x7f58a013bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:38614/0 (socket says 172.21.15.106:38614) 2024-08-17T02:30:59.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.445+0000 7f589de00640 1 -- 172.21.15.106:0/2519238252 learned_addr learned my addr 172.21.15.106:0/2519238252 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:30:59.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.445+0000 7f5895400640 1 --2- 172.21.15.106:0/2519238252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58a0155a20 0x7f58a013c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:59.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.445+0000 7f589e800640 1 --2- 172.21.15.106:0/2519238252 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58a0155df0 0x7f58a016c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:59.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.445+0000 7f589de00640 1 -- 172.21.15.106:0/2519238252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58a0155a20 msgr2=0x7f58a013c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:59.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.445+0000 7f589de00640 1 --2- 172.21.15.106:0/2519238252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58a0155a20 0x7f58a013c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.445+0000 7f589de00640 1 -- 172.21.15.106:0/2519238252 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58a0155df0 msgr2=0x7f58a016c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:59.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.445+0000 7f589de00640 1 --2- 172.21.15.106:0/2519238252 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58a0155df0 0x7f58a016c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.445+0000 7f589de00640 1 -- 172.21.15.106:0/2519238252 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5898009ae0 con 0x7f58a006d7f0 2024-08-17T02:30:59.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.445+0000 7f5895400640 1 --2- 172.21.15.106:0/2519238252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58a0155a20 0x7f58a013c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:59.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.445+0000 7f589e800640 1 --2- 172.21.15.106:0/2519238252 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58a0155df0 0x7f58a016c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:59.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.445+0000 7f589de00640 1 --2- 172.21.15.106:0/2519238252 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58a006d7f0 0x7f58a013bae0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f589000d890 tx=0x7f5890008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:59.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.446+0000 7f5896000640 1 -- 172.21.15.106:0/2519238252 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589000de20 con 0x7f58a006d7f0 2024-08-17T02:30:59.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.446+0000 7f5896000640 1 -- 172.21.15.106:0/2519238252 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589000b8d0 con 0x7f58a006d7f0 2024-08-17T02:30:59.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.446+0000 7f5896000640 1 -- 172.21.15.106:0/2519238252 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589000bc70 con 0x7f58a006d7f0 2024-08-17T02:30:59.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.446+0000 7f58a4a00640 1 -- 172.21.15.106:0/2519238252 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a013d5a0 con 0x7f58a006d7f0 2024-08-17T02:30:59.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.446+0000 7f58a4a00640 1 -- 172.21.15.106:0/2519238252 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a013c020 con 0x7f58a006d7f0 2024-08-17T02:30:59.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.447+0000 7f58a4a00640 1 -- 172.21.15.106:0/2519238252 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a00b1b40 con 0x7f58a006d7f0 2024-08-17T02:30:59.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.448+0000 7f5896000640 1 -- 172.21.15.106:0/2519238252 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5890014640 con 0x7f58a006d7f0 2024-08-17T02:30:59.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.448+0000 7f5896000640 1 --2- 172.21.15.106:0/2519238252 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f587c065150 0x7f587c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:59.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.449+0000 7f5896000640 1 -- 172.21.15.106:0/2519238252 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f5890082e20 con 0x7f58a006d7f0 2024-08-17T02:30:59.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.449+0000 7f5895400640 1 --2- 172.21.15.106:0/2519238252 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f587c065150 0x7f587c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:59.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.449+0000 7f5895400640 1 --2- 172.21.15.106:0/2519238252 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f587c065150 0x7f587c067600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5888006fd0 tx=0x7f5888008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:59.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.453+0000 7f5896000640 1 -- 172.21.15.106:0/2519238252 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f58a00b1b40 con 0x7f58a006d7f0 2024-08-17T02:30:59.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.625+0000 7f58a4a00640 1 -- 172.21.15.106:0/2519238252 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58a00b1b40 con 0x7f58a006d7f0 2024-08-17T02:30:59.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.626+0000 7f5896000640 1 -- 172.21.15.106:0/2519238252 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18647 (secure 0 0 0) 0x7f58a00b1b40 con 0x7f58a006d7f0 2024-08-17T02:30:59.627 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:30:59.627 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":37,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:28:55.604010+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:28:37.880632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:28:38.897913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000123149.meta","create_time":"2024-08-17T02:28:50.720877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000123149"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000123149.data","create_time":"2024-08-17T02:28:51.638596+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000123149"}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:30:59.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.628+0000 7f58a4a00640 1 -- 172.21.15.106:0/2519238252 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f587c065150 msgr2=0x7f587c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:59.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.628+0000 7f58a4a00640 1 --2- 172.21.15.106:0/2519238252 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f587c065150 0x7f587c067600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5888006fd0 tx=0x7f5888008040 comp rx=0 tx=0).stop 2024-08-17T02:30:59.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.628+0000 7f58a4a00640 1 -- 172.21.15.106:0/2519238252 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58a006d7f0 msgr2=0x7f58a013bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:59.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.628+0000 7f58a4a00640 1 --2- 172.21.15.106:0/2519238252 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58a006d7f0 0x7f58a013bae0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f589000d890 tx=0x7f5890008040 comp rx=0 tx=0).stop 2024-08-17T02:30:59.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.628+0000 7f58a4a00640 1 -- 172.21.15.106:0/2519238252 shutdown_connections 2024-08-17T02:30:59.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.628+0000 7f58a4a00640 1 --2- 172.21.15.106:0/2519238252 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f58a0155df0 0x7f58a016c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.628+0000 7f58a4a00640 1 --2- 172.21.15.106:0/2519238252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f58a0155a20 0x7f58a013c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.628+0000 7f58a4a00640 1 --2- 172.21.15.106:0/2519238252 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f587c065150 0x7f587c067600 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.628+0000 7f58a4a00640 1 --2- 172.21.15.106:0/2519238252 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58a006d7f0 0x7f58a013bae0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.628+0000 7f58a4a00640 1 -- 172.21.15.106:0/2519238252 >> 172.21.15.106:0/2519238252 conn(0x7f58a00cb9b0 msgr2=0x7f58a0152650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:59.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.628+0000 7f58a4a00640 1 -- 172.21.15.106:0/2519238252 shutdown_connections 2024-08-17T02:30:59.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.628+0000 7f58a4a00640 1 -- 172.21.15.106:0/2519238252 wait complete. 2024-08-17T02:30:59.645 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:30:59.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.792+0000 7f8089400640 1 Processor -- start 2024-08-17T02:30:59.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.793+0000 7f8089400640 1 -- start start 2024-08-17T02:30:59.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.794+0000 7f8089400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8084156ad0 0x7f80840cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:59.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.794+0000 7f8089400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80840caaf0 con 0x7f808406dc80 2024-08-17T02:30:59.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.794+0000 7f8089400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8084157300 con 0x7f8084156ea0 2024-08-17T02:30:59.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.794+0000 7f8089400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80840ca900 con 0x7f8084156ad0 2024-08-17T02:30:59.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.794+0000 7f8083e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8084156ad0 0x7f80840cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:59.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.794+0000 7f8083e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8084156ad0 0x7f80840cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49320/0 (socket says 172.21.15.106:49320) 2024-08-17T02:30:59.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.794+0000 7f8083e00640 1 -- 172.21.15.106:0/2195935166 learned_addr learned my addr 172.21.15.106:0/2195935166 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:30:59.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.794+0000 7f8088a00640 1 --1- 172.21.15.106:0/2195935166 >> v1:172.21.15.106:6789/0 conn(0x7f808406dc80 0x7f80841577f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:54666/0 (socket says 172.21.15.106:54666) 2024-08-17T02:30:59.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.795+0000 7f8083e00640 1 -- 172.21.15.106:0/2195935166 >> v1:172.21.15.171:6789/0 conn(0x7f8084156ea0 legacy=0x7f808406d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:59.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.795+0000 7f8083e00640 1 -- 172.21.15.106:0/2195935166 >> v1:172.21.15.106:6789/0 conn(0x7f808406dc80 legacy=0x7f80841577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:59.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.795+0000 7f8083e00640 1 -- 172.21.15.106:0/2195935166 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80840cad90 con 0x7f8084156ad0 2024-08-17T02:30:59.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.796+0000 7f8083e00640 1 --2- 172.21.15.106:0/2195935166 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8084156ad0 0x7f80840cbea0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8074009910 tx=0x7f80740091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f7f2b49ae0dab server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:59.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.796+0000 7f8083400640 1 -- 172.21.15.106:0/2195935166 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8074032440 con 0x7f8084156ad0 2024-08-17T02:30:59.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.796+0000 7f8083400640 1 -- 172.21.15.106:0/2195935166 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80740325a0 con 0x7f8084156ad0 2024-08-17T02:30:59.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.796+0000 7f8083400640 1 -- 172.21.15.106:0/2195935166 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8074032980 con 0x7f8084156ad0 2024-08-17T02:30:59.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.796+0000 7f8089400640 1 -- 172.21.15.106:0/2195935166 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8084156ad0 msgr2=0x7f80840cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:59.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.796+0000 7f8089400640 1 --2- 172.21.15.106:0/2195935166 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8084156ad0 0x7f80840cbea0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8074009910 tx=0x7f80740091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.797+0000 7f8089400640 1 -- 172.21.15.106:0/2195935166 shutdown_connections 2024-08-17T02:30:59.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.797+0000 7f8089400640 1 --2- 172.21.15.106:0/2195935166 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8084156ad0 0x7f80840cbea0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.797+0000 7f8089400640 1 -- 172.21.15.106:0/2195935166 >> 172.21.15.106:0/2195935166 conn(0x7f8084067750 msgr2=0x7f80840cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:59.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.797+0000 7f8089400640 1 -- 172.21.15.106:0/2195935166 shutdown_connections 2024-08-17T02:30:59.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.797+0000 7f8089400640 1 -- 172.21.15.106:0/2195935166 wait complete. 2024-08-17T02:30:59.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.798+0000 7f8089400640 1 Processor -- start 2024-08-17T02:30:59.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.798+0000 7f8089400640 1 -- start start 2024-08-17T02:30:59.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.799+0000 7f8089400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f808406dc80 0x7f8084167c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:59.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.799+0000 7f8089400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8084156ad0 0x7f808414b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:59.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.799+0000 7f8089400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8084156ea0 0x7f80841577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:59.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.799+0000 7f8089400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8084153490 con 0x7f8084156ea0 2024-08-17T02:30:59.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.799+0000 7f8089400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808415b300 con 0x7f8084156ad0 2024-08-17T02:30:59.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.799+0000 7f8089400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808415aa10 con 0x7f808406dc80 2024-08-17T02:30:59.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.799+0000 7f8088a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8084156ea0 0x7f80841577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:59.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.799+0000 7f8088a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8084156ea0 0x7f80841577f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49328/0 (socket says 172.21.15.106:49328) 2024-08-17T02:30:59.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.799+0000 7f8088a00640 1 -- 172.21.15.106:0/2288387826 learned_addr learned my addr 172.21.15.106:0/2288387826 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:30:59.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.800+0000 7f8083e00640 1 --2- 172.21.15.106:0/2288387826 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f808406dc80 0x7f8084167c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:59.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.800+0000 7f807b400640 1 --2- 172.21.15.106:0/2288387826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8084156ad0 0x7f808414b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:59.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.800+0000 7f8088a00640 1 -- 172.21.15.106:0/2288387826 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f808406dc80 msgr2=0x7f8084167c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:59.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.800+0000 7f8088a00640 1 --2- 172.21.15.106:0/2288387826 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f808406dc80 0x7f8084167c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.800+0000 7f8088a00640 1 -- 172.21.15.106:0/2288387826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8084156ad0 msgr2=0x7f808414b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:59.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.800+0000 7f8088a00640 1 --2- 172.21.15.106:0/2288387826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8084156ad0 0x7f808414b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:59.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.800+0000 7f8088a00640 1 -- 172.21.15.106:0/2288387826 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8074009450 con 0x7f8084156ea0 2024-08-17T02:30:59.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.800+0000 7f807b400640 1 --2- 172.21.15.106:0/2288387826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8084156ad0 0x7f808414b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:59.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.800+0000 7f8088a00640 1 --2- 172.21.15.106:0/2288387826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8084156ea0 0x7f80841577f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f807c00c910 tx=0x7f807c001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:59.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.800+0000 7f807be00640 1 -- 172.21.15.106:0/2288387826 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c00cea0 con 0x7f8084156ea0 2024-08-17T02:30:59.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.800+0000 7f807be00640 1 -- 172.21.15.106:0/2288387826 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807c005d60 con 0x7f8084156ea0 2024-08-17T02:30:59.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.800+0000 7f8089400640 1 -- 172.21.15.106:0/2288387826 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80841681b0 con 0x7f8084156ea0 2024-08-17T02:30:59.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.800+0000 7f807be00640 1 -- 172.21.15.106:0/2288387826 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807c00a870 con 0x7f8084156ea0 2024-08-17T02:30:59.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.800+0000 7f8089400640 1 -- 172.21.15.106:0/2288387826 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f808415acb0 con 0x7f8084156ea0 2024-08-17T02:30:59.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.802+0000 7f8089400640 1 -- 172.21.15.106:0/2288387826 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8084154f00 con 0x7f8084156ea0 2024-08-17T02:30:59.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.802+0000 7f807be00640 1 -- 172.21.15.106:0/2288387826 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f807c00aca0 con 0x7f8084156ea0 2024-08-17T02:30:59.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.803+0000 7f807be00640 1 --2- 172.21.15.106:0/2288387826 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8060065150 0x7f8060067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:59.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.803+0000 7f807be00640 1 -- 172.21.15.106:0/2288387826 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f807c0824e0 con 0x7f8084156ea0 2024-08-17T02:30:59.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.803+0000 7f8083e00640 1 --2- 172.21.15.106:0/2288387826 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8060065150 0x7f8060067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:59.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.804+0000 7f8083e00640 1 --2- 172.21.15.106:0/2288387826 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8060065150 0x7f8060067600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8074034000 tx=0x7f8074032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:59.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:30:59.807+0000 7f807be00640 1 -- 172.21.15.106:0/2288387826 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f807c050200 con 0x7f8084156ea0 2024-08-17T02:31:00.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.014+0000 7f8089400640 1 -- 172.21.15.106:0/2288387826 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f808415b470 con 0x7f8084156ea0 2024-08-17T02:31:00.015 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-08-17T02:31:00.014+0000 7f141ae00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:31:00.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.019+0000 7f807be00640 1 -- 172.21.15.106:0/2288387826 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) v1 ==== 161+0+0 (secure 0 0 0) 0x7f807c053820 con 0x7f8084156ea0 2024-08-17T02:31:00.021 INFO:teuthology.orchestra.run.smithi106.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:31:00.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.022+0000 7f8089400640 1 -- 172.21.15.106:0/2288387826 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8060065150 msgr2=0x7f8060067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:00.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.022+0000 7f8089400640 1 --2- 172.21.15.106:0/2288387826 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8060065150 0x7f8060067600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8074034000 tx=0x7f8074032000 comp rx=0 tx=0).stop 2024-08-17T02:31:00.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.022+0000 7f8089400640 1 -- 172.21.15.106:0/2288387826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8084156ea0 msgr2=0x7f80841577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:00.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.022+0000 7f8089400640 1 --2- 172.21.15.106:0/2288387826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8084156ea0 0x7f80841577f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f807c00c910 tx=0x7f807c001690 comp rx=0 tx=0).stop 2024-08-17T02:31:00.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.022+0000 7f8089400640 1 -- 172.21.15.106:0/2288387826 shutdown_connections 2024-08-17T02:31:00.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.022+0000 7f8089400640 1 --2- 172.21.15.106:0/2288387826 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8060065150 0x7f8060067600 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:00.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.022+0000 7f8089400640 1 --2- 172.21.15.106:0/2288387826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8084156ea0 0x7f80841577f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:00.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.022+0000 7f8089400640 1 --2- 172.21.15.106:0/2288387826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8084156ad0 0x7f808414b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:00.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.022+0000 7f8089400640 1 --2- 172.21.15.106:0/2288387826 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f808406dc80 0x7f8084167c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:00.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.022+0000 7f8089400640 1 -- 172.21.15.106:0/2288387826 >> 172.21.15.106:0/2288387826 conn(0x7f8084067750 msgr2=0x7f808415d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:00.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.022+0000 7f8089400640 1 -- 172.21.15.106:0/2288387826 shutdown_connections 2024-08-17T02:31:00.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.022+0000 7f8089400640 1 -- 172.21.15.106:0/2288387826 wait complete. 2024-08-17T02:31:00.035 INFO:tasks.ceph.mds.b.smithi171.stderr: -7212> 2024-08-17T02:28:44.487+0000 7f069ae00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:31:00.040 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:31:00.079 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-08-17T02:31:00.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.188+0000 7f6633e00640 1 Processor -- start 2024-08-17T02:31:00.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.188+0000 7f6633e00640 1 -- start start 2024-08-17T02:31:00.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.189+0000 7f6633e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f66340aefb0 0x7f66340af380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:00.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.189+0000 7f6633e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66340ae5b0 0x7f66340690a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:00.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.189+0000 7f6633e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f663415c7c0 0x7f663415cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:00.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.189+0000 7f6633e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6634068c10 con 0x7f663415c7c0 2024-08-17T02:31:00.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.189+0000 7f6633e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f663415d180 con 0x7f66340aefb0 2024-08-17T02:31:00.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.189+0000 7f6633e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66340af8c0 con 0x7f66340ae5b0 2024-08-17T02:31:00.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.189+0000 7f6633400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f663415c7c0 0x7f663415cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:00.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.189+0000 7f6633400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f663415c7c0 0x7f663415cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49338/0 (socket says 172.21.15.106:49338) 2024-08-17T02:31:00.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.189+0000 7f6633400640 1 -- 172.21.15.106:0/3505602620 learned_addr learned my addr 172.21.15.106:0/3505602620 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:00.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.189+0000 7f6632a00640 1 --2- 172.21.15.106:0/3505602620 >> v2:172.21.15.171:3300/0 conn(0x7f66340aefb0 0x7f66340af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:00.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.189+0000 7f662a000640 1 --2- 172.21.15.106:0/3505602620 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66340ae5b0 0x7f66340690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:00.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.190+0000 7f6633400640 1 -- 172.21.15.106:0/3505602620 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66340ae5b0 msgr2=0x7f66340690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:00.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.190+0000 7f6633400640 1 --2- 172.21.15.106:0/3505602620 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66340ae5b0 0x7f66340690a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:00.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.190+0000 7f6633400640 1 -- 172.21.15.106:0/3505602620 >> v2:172.21.15.171:3300/0 conn(0x7f66340aefb0 msgr2=0x7f66340af380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:00.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.190+0000 7f6633400640 1 --2- 172.21.15.106:0/3505602620 >> v2:172.21.15.171:3300/0 conn(0x7f66340aefb0 0x7f66340af380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:00.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.190+0000 7f6633400640 1 -- 172.21.15.106:0/3505602620 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6634067d60 con 0x7f663415c7c0 2024-08-17T02:31:00.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.191+0000 7f6633400640 1 --2- 172.21.15.106:0/3505602620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f663415c7c0 0x7f663415cc40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f663406ebb0 tx=0x7f662c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e9f867c5c063c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:00.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.191+0000 7f6632000640 1 -- 172.21.15.106:0/3505602620 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c031400 con 0x7f663415c7c0 2024-08-17T02:31:00.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.191+0000 7f6632000640 1 -- 172.21.15.106:0/3505602620 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662c02d050 con 0x7f663415c7c0 2024-08-17T02:31:00.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.191+0000 7f6632000640 1 -- 172.21.15.106:0/3505602620 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c0317d0 con 0x7f663415c7c0 2024-08-17T02:31:00.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.191+0000 7f6633e00640 1 -- 172.21.15.106:0/3505602620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f663415c7c0 msgr2=0x7f663415cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:00.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.191+0000 7f6633e00640 1 --2- 172.21.15.106:0/3505602620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f663415c7c0 0x7f663415cc40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f663406ebb0 tx=0x7f662c009840 comp rx=0 tx=0).stop 2024-08-17T02:31:00.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.192+0000 7f6633e00640 1 -- 172.21.15.106:0/3505602620 shutdown_connections 2024-08-17T02:31:00.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.192+0000 7f6633e00640 1 --2- 172.21.15.106:0/3505602620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f663415c7c0 0x7f663415cc40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:00.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.192+0000 7f6633e00640 1 --2- 172.21.15.106:0/3505602620 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66340ae5b0 0x7f66340690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:00.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.192+0000 7f6633e00640 1 --2- 172.21.15.106:0/3505602620 >> v2:172.21.15.171:3300/0 conn(0x7f66340aefb0 0x7f66340af380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:00.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.192+0000 7f6633e00640 1 -- 172.21.15.106:0/3505602620 >> 172.21.15.106:0/3505602620 conn(0x7f6634096a70 msgr2=0x7f6634096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:00.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.192+0000 7f6633e00640 1 -- 172.21.15.106:0/3505602620 shutdown_connections 2024-08-17T02:31:00.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.192+0000 7f6633e00640 1 -- 172.21.15.106:0/3505602620 wait complete. 2024-08-17T02:31:00.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.193+0000 7f6633e00640 1 Processor -- start 2024-08-17T02:31:00.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.193+0000 7f6633e00640 1 -- start start 2024-08-17T02:31:00.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.194+0000 7f6633e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66340ae5b0 0x7f66340aa730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:00.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.194+0000 7f6633e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66340aefb0 0x7f6634159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:00.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.194+0000 7f6633e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f663415c7c0 0x7f66341537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:00.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.194+0000 7f6633e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663415a230 con 0x7f663415c7c0 2024-08-17T02:31:00.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.194+0000 7f6633e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6634156f60 con 0x7f66340aefb0 2024-08-17T02:31:00.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.194+0000 7f6633e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66340ab0f0 con 0x7f66340ae5b0 2024-08-17T02:31:00.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.194+0000 7f6633400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f663415c7c0 0x7f66341537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:00.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.194+0000 7f6632a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66340ae5b0 0x7f66340aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:00.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.194+0000 7f6633400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f663415c7c0 0x7f66341537c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49344/0 (socket says 172.21.15.106:49344) 2024-08-17T02:31:00.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.194+0000 7f6633400640 1 -- 172.21.15.106:0/178600802 learned_addr learned my addr 172.21.15.106:0/178600802 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:00.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.194+0000 7f662a000640 1 --2- 172.21.15.106:0/178600802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66340aefb0 0x7f6634159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:00.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.195+0000 7f6633400640 1 -- 172.21.15.106:0/178600802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66340ae5b0 msgr2=0x7f66340aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:00.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.195+0000 7f6633400640 1 --2- 172.21.15.106:0/178600802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66340ae5b0 0x7f66340aa730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:00.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.195+0000 7f6633400640 1 -- 172.21.15.106:0/178600802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66340aefb0 msgr2=0x7f6634159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:00.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.195+0000 7f6633400640 1 --2- 172.21.15.106:0/178600802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66340aefb0 0x7f6634159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:00.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.195+0000 7f6633400640 1 -- 172.21.15.106:0/178600802 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662c009ae0 con 0x7f663415c7c0 2024-08-17T02:31:00.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.195+0000 7f6632a00640 1 --2- 172.21.15.106:0/178600802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66340ae5b0 0x7f66340aa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:31:00.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.195+0000 7f6633400640 1 --2- 172.21.15.106:0/178600802 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f663415c7c0 0x7f66341537c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f662c02ac20 tx=0x7f662c036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:00.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.197+0000 7f662aa00640 1 -- 172.21.15.106:0/178600802 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c007170 con 0x7f663415c7c0 2024-08-17T02:31:00.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.197+0000 7f662aa00640 1 -- 172.21.15.106:0/178600802 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662c007e40 con 0x7f663415c7c0 2024-08-17T02:31:00.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.197+0000 7f6633e00640 1 -- 172.21.15.106:0/178600802 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66340aae10 con 0x7f663415c7c0 2024-08-17T02:31:00.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.197+0000 7f662aa00640 1 -- 172.21.15.106:0/178600802 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c03c670 con 0x7f663415c7c0 2024-08-17T02:31:00.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.198+0000 7f6633e00640 1 -- 172.21.15.106:0/178600802 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66341574e0 con 0x7f663415c7c0 2024-08-17T02:31:00.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.198+0000 7f6633e00640 1 -- 172.21.15.106:0/178600802 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6634157700 con 0x7f663415c7c0 2024-08-17T02:31:00.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.199+0000 7f662aa00640 1 -- 172.21.15.106:0/178600802 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f662c03ca60 con 0x7f663415c7c0 2024-08-17T02:31:00.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.200+0000 7f662aa00640 1 --2- 172.21.15.106:0/178600802 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6610065150 0x7f6610067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:00.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.200+0000 7f662aa00640 1 -- 172.21.15.106:0/178600802 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f662c0a33b0 con 0x7f663415c7c0 2024-08-17T02:31:00.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.201+0000 7f6632a00640 1 --2- 172.21.15.106:0/178600802 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6610065150 0x7f6610067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:00.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.201+0000 7f6632a00640 1 --2- 172.21.15.106:0/178600802 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6610065150 0x7f6610067600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6624007fa0 tx=0x7f6624008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:00.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.206+0000 7f662aa00640 1 -- 172.21.15.106:0/178600802 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f662c0710a0 con 0x7f663415c7c0 2024-08-17T02:31:00.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:00.415+0000 7f6633e00640 1 -- 172.21.15.106:0/178600802 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6634071050 con 0x7f663415c7c0 2024-08-17T02:31:01.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.020+0000 7f662aa00640 1 -- 172.21.15.106:0/178600802 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) v1 ==== 104+0+0 (secure 0 0 0) 0x7f662c03d030 con 0x7f663415c7c0 2024-08-17T02:31:01.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.023+0000 7f6633e00640 1 -- 172.21.15.106:0/178600802 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6610065150 msgr2=0x7f6610067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:01.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.023+0000 7f6633e00640 1 --2- 172.21.15.106:0/178600802 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6610065150 0x7f6610067600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6624007fa0 tx=0x7f6624008040 comp rx=0 tx=0).stop 2024-08-17T02:31:01.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.023+0000 7f6633e00640 1 -- 172.21.15.106:0/178600802 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f663415c7c0 msgr2=0x7f66341537c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:01.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.023+0000 7f6633e00640 1 --2- 172.21.15.106:0/178600802 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f663415c7c0 0x7f66341537c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f662c02ac20 tx=0x7f662c036000 comp rx=0 tx=0).stop 2024-08-17T02:31:01.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.023+0000 7f6633e00640 1 -- 172.21.15.106:0/178600802 shutdown_connections 2024-08-17T02:31:01.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.023+0000 7f6633e00640 1 --2- 172.21.15.106:0/178600802 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f6610065150 0x7f6610067600 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:01.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.023+0000 7f6633e00640 1 --2- 172.21.15.106:0/178600802 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f663415c7c0 0x7f66341537c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:01.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.023+0000 7f6633e00640 1 --2- 172.21.15.106:0/178600802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66340aefb0 0x7f6634159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:01.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.023+0000 7f6633e00640 1 --2- 172.21.15.106:0/178600802 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f66340ae5b0 0x7f66340aa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:01.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.023+0000 7f6633e00640 1 -- 172.21.15.106:0/178600802 >> 172.21.15.106:0/178600802 conn(0x7f6634096a70 msgr2=0x7f66341564b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:01.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.023+0000 7f6633e00640 1 -- 172.21.15.106:0/178600802 shutdown_connections 2024-08-17T02:31:01.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.023+0000 7f6633e00640 1 -- 172.21.15.106:0/178600802 wait complete. 2024-08-17T02:31:01.041 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:31:01.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.190+0000 7ffbb4400640 1 Processor -- start 2024-08-17T02:31:01.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.190+0000 7ffbb4400640 1 -- start start 2024-08-17T02:31:01.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.191+0000 7ffbb4400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbac156890 0x7ffbac06dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:01.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.192+0000 7ffbb4400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ffbac0c8840 0x7ffbac06e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:01.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.192+0000 7ffbb4400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbac0ae9b0 con 0x7ffbac156c60 2024-08-17T02:31:01.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.192+0000 7ffbb4400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbac0aa730 con 0x7ffbac0c8840 2024-08-17T02:31:01.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.192+0000 7ffbb4400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac0aa9f0 con 0x7ffbac156890 2024-08-17T02:31:01.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.192+0000 7ffbb1a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbac156890 0x7ffbac06dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:01.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.192+0000 7ffbb2400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ffbac0c8840 0x7ffbac06e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:01.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.192+0000 7ffbb2400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ffbac0c8840 0x7ffbac06e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:57086/0 (socket says 172.21.15.106:57086) 2024-08-17T02:31:01.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.192+0000 7ffbb2400640 1 -- 172.21.15.106:0/702866318 learned_addr learned my addr 172.21.15.106:0/702866318 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:01.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.193+0000 7ffbb2400640 1 -- 172.21.15.106:0/702866318 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbac156890 msgr2=0x7ffbac06dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:01.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.193+0000 7ffbb2400640 1 --2- 172.21.15.106:0/702866318 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbac156890 0x7ffbac06dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:01.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.193+0000 7ffbb2400640 1 -- 172.21.15.106:0/702866318 >> v1:172.21.15.171:6789/0 conn(0x7ffbac156c60 legacy=0x7ffbac0c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:01.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.193+0000 7ffbb2400640 1 -- 172.21.15.106:0/702866318 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbac0ab320 con 0x7ffbac0c8840 2024-08-17T02:31:01.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.193+0000 7ffbb1a00640 1 --2- 172.21.15.106:0/702866318 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbac156890 0x7ffbac06dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:31:01.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.194+0000 7ffbb2400640 1 --2- 172.21.15.106:0/702866318 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbac0c8840 0x7ffbac06e420 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffba4009f20 tx=0x7ffba4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c893b2aa0f22015f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:01.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.194+0000 7ffbabe00640 1 -- 172.21.15.106:0/702866318 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba4031400 con 0x7ffbac0c8840 2024-08-17T02:31:01.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.194+0000 7ffbabe00640 1 -- 172.21.15.106:0/702866318 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba402d050 con 0x7ffbac0c8840 2024-08-17T02:31:01.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.194+0000 7ffbabe00640 1 -- 172.21.15.106:0/702866318 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba40317d0 con 0x7ffbac0c8840 2024-08-17T02:31:01.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.194+0000 7ffbb4400640 1 -- 172.21.15.106:0/702866318 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbac0c8840 msgr2=0x7ffbac06e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:01.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.194+0000 7ffbb4400640 1 --2- 172.21.15.106:0/702866318 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbac0c8840 0x7ffbac06e420 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffba4009f20 tx=0x7ffba4009840 comp rx=0 tx=0).stop 2024-08-17T02:31:01.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.195+0000 7ffbb4400640 1 -- 172.21.15.106:0/702866318 shutdown_connections 2024-08-17T02:31:01.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.195+0000 7ffbb4400640 1 --2- 172.21.15.106:0/702866318 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbac0c8840 0x7ffbac06e420 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:01.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.195+0000 7ffbb4400640 1 --2- 172.21.15.106:0/702866318 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbac156890 0x7ffbac06dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:01.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.195+0000 7ffbb4400640 1 -- 172.21.15.106:0/702866318 >> 172.21.15.106:0/702866318 conn(0x7ffbac067750 msgr2=0x7ffbac06c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:01.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.195+0000 7ffbb4400640 1 -- 172.21.15.106:0/702866318 shutdown_connections 2024-08-17T02:31:01.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.195+0000 7ffbb4400640 1 -- 172.21.15.106:0/702866318 wait complete. 2024-08-17T02:31:01.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.196+0000 7ffbb4400640 1 Processor -- start 2024-08-17T02:31:01.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.196+0000 7ffbb4400640 1 -- start start 2024-08-17T02:31:01.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.197+0000 7ffbb4400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffbac0c8840 0x7ffbac1454c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:01.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.197+0000 7ffbb4400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbac156890 0x7ffbac0abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:01.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.197+0000 7ffbb4400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbac156c60 0x7ffbac0ac3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:01.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.197+0000 7ffbb4400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac15e4d0 con 0x7ffbac0c8840 2024-08-17T02:31:01.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.197+0000 7ffbb4400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac15d8c0 con 0x7ffbac156890 2024-08-17T02:31:01.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.197+0000 7ffbb4400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac15dba0 con 0x7ffbac156c60 2024-08-17T02:31:01.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.197+0000 7ffbb1a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffbac0c8840 0x7ffbac1454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:01.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.197+0000 7ffbb1a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffbac0c8840 0x7ffbac1454c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49356/0 (socket says 172.21.15.106:49356) 2024-08-17T02:31:01.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.197+0000 7ffbb1a00640 1 -- 172.21.15.106:0/249910117 learned_addr learned my addr 172.21.15.106:0/249910117 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:01.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.198+0000 7ffbb1000640 1 --2- 172.21.15.106:0/249910117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbac156890 0x7ffbac0abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:01.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.198+0000 7ffbb1a00640 1 -- 172.21.15.106:0/249910117 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbac156c60 msgr2=0x7ffbac0ac3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:01.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.198+0000 7ffbb1a00640 1 --2- 172.21.15.106:0/249910117 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbac156c60 0x7ffbac0ac3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:01.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.198+0000 7ffbb1a00640 1 -- 172.21.15.106:0/249910117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbac156890 msgr2=0x7ffbac0abeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:01.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.198+0000 7ffbb1a00640 1 --2- 172.21.15.106:0/249910117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbac156890 0x7ffbac0abeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:01.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.198+0000 7ffbb1a00640 1 -- 172.21.15.106:0/249910117 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba0009390 con 0x7ffbac0c8840 2024-08-17T02:31:01.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.198+0000 7ffbb1000640 1 --2- 172.21.15.106:0/249910117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbac156890 0x7ffbac0abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:31:01.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.198+0000 7ffbb1a00640 1 --2- 172.21.15.106:0/249910117 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffbac0c8840 0x7ffbac1454c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffba000ec80 tx=0x7ffba00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:01.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.198+0000 7ffba8c00640 1 -- 172.21.15.106:0/249910117 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba000eec0 con 0x7ffbac0c8840 2024-08-17T02:31:01.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.198+0000 7ffba8c00640 1 -- 172.21.15.106:0/249910117 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba000cbc0 con 0x7ffbac0c8840 2024-08-17T02:31:01.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.198+0000 7ffba8c00640 1 -- 172.21.15.106:0/249910117 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba0013470 con 0x7ffbac0c8840 2024-08-17T02:31:01.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.198+0000 7ffbb4400640 1 -- 172.21.15.106:0/249910117 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba4009ae0 con 0x7ffbac0c8840 2024-08-17T02:31:01.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.198+0000 7ffbb4400640 1 -- 172.21.15.106:0/249910117 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbac15e160 con 0x7ffbac0c8840 2024-08-17T02:31:01.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.199+0000 7ffbb4400640 1 -- 172.21.15.106:0/249910117 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbac0710c0 con 0x7ffbac0c8840 2024-08-17T02:31:01.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.200+0000 7ffba8c00640 1 -- 172.21.15.106:0/249910117 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ffba00137e0 con 0x7ffbac0c8840 2024-08-17T02:31:01.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.201+0000 7ffba8c00640 1 --2- 172.21.15.106:0/249910117 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ffb8c065150 0x7ffb8c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:01.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.201+0000 7ffba8c00640 1 -- 172.21.15.106:0/249910117 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6689+0+0 (secure 0 0 0) 0x7ffba0082cd0 con 0x7ffbac0c8840 2024-08-17T02:31:01.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.201+0000 7ffbb1000640 1 --2- 172.21.15.106:0/249910117 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ffb8c065150 0x7ffb8c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:01.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.202+0000 7ffbb1000640 1 --2- 172.21.15.106:0/249910117 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ffb8c065150 0x7ffb8c067600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ffbac15d5e0 tx=0x7ffb98009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:01.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.205+0000 7ffba8c00640 1 -- 172.21.15.106:0/249910117 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ffba0050910 con 0x7ffbac0c8840 2024-08-17T02:31:01.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:01.375+0000 7ffbb4400640 1 -- 172.21.15.106:0/249910117 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffbac063d20 con 0x7ffbac0c8840 2024-08-17T02:31:02.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.219+0000 7ffba8c00640 1 -- 172.21.15.106:0/249910117 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) v1 ==== 181+0+0 (secure 0 0 0) 0x7ffba00210d0 con 0x7ffbac0c8840 2024-08-17T02:31:02.221 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:31:02.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.223+0000 7ffbb4400640 1 -- 172.21.15.106:0/249910117 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ffb8c065150 msgr2=0x7ffb8c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:02.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.223+0000 7ffbb4400640 1 --2- 172.21.15.106:0/249910117 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ffb8c065150 0x7ffb8c067600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ffbac15d5e0 tx=0x7ffb98009040 comp rx=0 tx=0).stop 2024-08-17T02:31:02.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.224+0000 7ffbb4400640 1 -- 172.21.15.106:0/249910117 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffbac0c8840 msgr2=0x7ffbac1454c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:02.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.224+0000 7ffbb4400640 1 --2- 172.21.15.106:0/249910117 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffbac0c8840 0x7ffbac1454c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffba000ec80 tx=0x7ffba00090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.224+0000 7ffbb4400640 1 -- 172.21.15.106:0/249910117 shutdown_connections 2024-08-17T02:31:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.224+0000 7ffbb4400640 1 --2- 172.21.15.106:0/249910117 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffbac156c60 0x7ffbac0ac3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.224+0000 7ffbb4400640 1 --2- 172.21.15.106:0/249910117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbac156890 0x7ffbac0abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.224+0000 7ffbb4400640 1 --2- 172.21.15.106:0/249910117 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7ffb8c065150 0x7ffb8c067600 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.224+0000 7ffbb4400640 1 --2- 172.21.15.106:0/249910117 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffbac0c8840 0x7ffbac1454c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.224+0000 7ffbb4400640 1 -- 172.21.15.106:0/249910117 >> 172.21.15.106:0/249910117 conn(0x7ffbac067750 msgr2=0x7ffbac0c7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.224+0000 7ffbb4400640 1 -- 172.21.15.106:0/249910117 shutdown_connections 2024-08-17T02:31:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.224+0000 7ffbb4400640 1 -- 172.21.15.106:0/249910117 wait complete. 2024-08-17T02:31:02.245 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:31:02.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.399+0000 7f4d72800640 1 Processor -- start 2024-08-17T02:31:02.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.400+0000 7f4d72800640 1 -- start start 2024-08-17T02:31:02.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.401+0000 7f4d72800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4d6c155880 0x7f4d6c0ae630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:02.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.401+0000 7f4d72800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d6c0aeb70 0x7f4d6c0af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:02.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.401+0000 7f4d72800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d6c157840 con 0x7f4d6c155c50 2024-08-17T02:31:02.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.401+0000 7f4d72800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d6c156c30 con 0x7f4d6c155880 2024-08-17T02:31:02.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.401+0000 7f4d72800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c156f10 con 0x7f4d6c0aeb70 2024-08-17T02:31:02.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.401+0000 7f4d71400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4d6c155880 0x7f4d6c0ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:02.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.401+0000 7f4d71400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4d6c155880 0x7f4d6c0ae630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49364/0 (socket says 172.21.15.106:49364) 2024-08-17T02:31:02.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.401+0000 7f4d71400640 1 -- 172.21.15.106:0/1368421830 learned_addr learned my addr 172.21.15.106:0/1368421830 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:02.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.401+0000 7f4d70a00640 1 --2- 172.21.15.106:0/1368421830 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d6c0aeb70 0x7f4d6c0af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:02.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.401+0000 7f4d71400640 1 -- 172.21.15.106:0/1368421830 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d6c0aeb70 msgr2=0x7f4d6c0af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:02.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.401+0000 7f4d71400640 1 --2- 172.21.15.106:0/1368421830 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d6c0aeb70 0x7f4d6c0af0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.401+0000 7f4d71400640 1 -- 172.21.15.106:0/1368421830 >> v1:172.21.15.171:6789/0 conn(0x7f4d6c155c50 legacy=0x7f4d6c1596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:02.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.402+0000 7f4d71400640 1 -- 172.21.15.106:0/1368421830 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6c1571f0 con 0x7f4d6c155880 2024-08-17T02:31:02.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.402+0000 7f4d71400640 1 --2- 172.21.15.106:0/1368421830 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d6c155880 0x7f4d6c0ae630 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4d60009910 tx=0x7f4d600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2d40bce336c158 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:02.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.403+0000 7f4d6be00640 1 -- 172.21.15.106:0/1368421830 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6002adb0 con 0x7f4d6c155880 2024-08-17T02:31:02.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.403+0000 7f4d6be00640 1 -- 172.21.15.106:0/1368421830 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d60032440 con 0x7f4d6c155880 2024-08-17T02:31:02.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.403+0000 7f4d6be00640 1 -- 172.21.15.106:0/1368421830 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d60032820 con 0x7f4d6c155880 2024-08-17T02:31:02.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.403+0000 7f4d72800640 1 -- 172.21.15.106:0/1368421830 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d6c155880 msgr2=0x7f4d6c0ae630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:02.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.403+0000 7f4d72800640 1 --2- 172.21.15.106:0/1368421830 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d6c155880 0x7f4d6c0ae630 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4d60009910 tx=0x7f4d600091d0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.403+0000 7f4d72800640 1 -- 172.21.15.106:0/1368421830 shutdown_connections 2024-08-17T02:31:02.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.403+0000 7f4d72800640 1 --2- 172.21.15.106:0/1368421830 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d6c0aeb70 0x7f4d6c0af0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.403+0000 7f4d72800640 1 --2- 172.21.15.106:0/1368421830 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d6c155880 0x7f4d6c0ae630 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.403+0000 7f4d72800640 1 -- 172.21.15.106:0/1368421830 >> 172.21.15.106:0/1368421830 conn(0x7f4d6c067750 msgr2=0x7f4d6c0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:02.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.404+0000 7f4d72800640 1 -- 172.21.15.106:0/1368421830 shutdown_connections 2024-08-17T02:31:02.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.404+0000 7f4d72800640 1 -- 172.21.15.106:0/1368421830 wait complete. 2024-08-17T02:31:02.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.405+0000 7f4d72800640 1 Processor -- start 2024-08-17T02:31:02.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.405+0000 7f4d72800640 1 -- start start 2024-08-17T02:31:02.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.406+0000 7f4d72800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d6c0aeb70 0x7f4d6c146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:02.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.406+0000 7f4d72800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d6c155880 0x7f4d6c1326c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:02.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.406+0000 7f4d72800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d6c155c50 0x7f4d6c132c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:02.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.406+0000 7f4d72800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c134070 con 0x7f4d6c0aeb70 2024-08-17T02:31:02.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.406+0000 7f4d72800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c133460 con 0x7f4d6c155880 2024-08-17T02:31:02.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.406+0000 7f4d72800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c133740 con 0x7f4d6c155c50 2024-08-17T02:31:02.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.406+0000 7f4d71400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d6c0aeb70 0x7f4d6c146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:02.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.406+0000 7f4d71400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d6c0aeb70 0x7f4d6c146f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49370/0 (socket says 172.21.15.106:49370) 2024-08-17T02:31:02.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.406+0000 7f4d71400640 1 -- 172.21.15.106:0/3837556820 learned_addr learned my addr 172.21.15.106:0/3837556820 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:02.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.406+0000 7f4d70a00640 1 --2- 172.21.15.106:0/3837556820 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d6c155880 0x7f4d6c1326c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:02.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.406+0000 7f4d71e00640 1 --2- 172.21.15.106:0/3837556820 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d6c155c50 0x7f4d6c132c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:02.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.407+0000 7f4d71400640 1 -- 172.21.15.106:0/3837556820 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d6c155c50 msgr2=0x7f4d6c132c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:02.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.407+0000 7f4d71400640 1 --2- 172.21.15.106:0/3837556820 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d6c155c50 0x7f4d6c132c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.407+0000 7f4d71400640 1 -- 172.21.15.106:0/3837556820 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d6c155880 msgr2=0x7f4d6c1326c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:02.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.407+0000 7f4d71400640 1 --2- 172.21.15.106:0/3837556820 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d6c155880 0x7f4d6c1326c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:02.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.407+0000 7f4d71400640 1 -- 172.21.15.106:0/3837556820 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d60009450 con 0x7f4d6c0aeb70 2024-08-17T02:31:02.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.407+0000 7f4d71400640 1 --2- 172.21.15.106:0/3837556820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d6c0aeb70 0x7f4d6c146f10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4d60035040 tx=0x7f4d60032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:02.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.407+0000 7f4d68c00640 1 -- 172.21.15.106:0/3837556820 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d60000d10 con 0x7f4d6c0aeb70 2024-08-17T02:31:02.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.407+0000 7f4d68c00640 1 -- 172.21.15.106:0/3837556820 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d60031de0 con 0x7f4d6c0aeb70 2024-08-17T02:31:02.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.407+0000 7f4d68c00640 1 -- 172.21.15.106:0/3837556820 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6003d690 con 0x7f4d6c0aeb70 2024-08-17T02:31:02.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.407+0000 7f4d72800640 1 -- 172.21.15.106:0/3837556820 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d6c133a20 con 0x7f4d6c0aeb70 2024-08-17T02:31:02.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.407+0000 7f4d72800640 1 -- 172.21.15.106:0/3837556820 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6c133140 con 0x7f4d6c0aeb70 2024-08-17T02:31:02.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.409+0000 7f4d72800640 1 -- 172.21.15.106:0/3837556820 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6c071050 con 0x7f4d6c0aeb70 2024-08-17T02:31:02.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.409+0000 7f4d68c00640 1 -- 172.21.15.106:0/3837556820 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4d60039040 con 0x7f4d6c0aeb70 2024-08-17T02:31:02.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.410+0000 7f4d68c00640 1 --2- 172.21.15.106:0/3837556820 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4d4c065150 0x7f4d4c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:02.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.410+0000 7f4d68c00640 1 -- 172.21.15.106:0/3837556820 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6251+0+0 (secure 0 0 0) 0x7f4d600a2620 con 0x7f4d6c0aeb70 2024-08-17T02:31:02.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.410+0000 7f4d70a00640 1 --2- 172.21.15.106:0/3837556820 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4d4c065150 0x7f4d4c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:02.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.411+0000 7f4d70a00640 1 --2- 172.21.15.106:0/3837556820 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4d4c065150 0x7f4d4c067600 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c156b10 tx=0x7f4d58008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:02.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.414+0000 7f4d68c00640 1 -- 172.21.15.106:0/3837556820 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4d600704d0 con 0x7f4d6c0aeb70 2024-08-17T02:31:02.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:02.586+0000 7f4d72800640 1 -- 172.21.15.106:0/3837556820 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4d6c0cc150 con 0x7f4d6c0aeb70 2024-08-17T02:31:03.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.228+0000 7f4d68c00640 1 -- 172.21.15.106:0/3837556820 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4d60073af0 con 0x7f4d6c0aeb70 2024-08-17T02:31:03.229 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_data' removed 2024-08-17T02:31:03.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.231+0000 7f4d72800640 1 -- 172.21.15.106:0/3837556820 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4d4c065150 msgr2=0x7f4d4c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:03.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.231+0000 7f4d72800640 1 --2- 172.21.15.106:0/3837556820 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4d4c065150 0x7f4d4c067600 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c156b10 tx=0x7f4d58008040 comp rx=0 tx=0).stop 2024-08-17T02:31:03.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.231+0000 7f4d72800640 1 -- 172.21.15.106:0/3837556820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d6c0aeb70 msgr2=0x7f4d6c146f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:03.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.231+0000 7f4d72800640 1 --2- 172.21.15.106:0/3837556820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d6c0aeb70 0x7f4d6c146f10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4d60035040 tx=0x7f4d60032000 comp rx=0 tx=0).stop 2024-08-17T02:31:03.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.231+0000 7f4d72800640 1 -- 172.21.15.106:0/3837556820 shutdown_connections 2024-08-17T02:31:03.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.231+0000 7f4d72800640 1 --2- 172.21.15.106:0/3837556820 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4d6c155c50 0x7f4d6c132c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.231+0000 7f4d72800640 1 --2- 172.21.15.106:0/3837556820 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d6c155880 0x7f4d6c1326c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.231+0000 7f4d72800640 1 --2- 172.21.15.106:0/3837556820 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f4d4c065150 0x7f4d4c067600 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.231+0000 7f4d72800640 1 --2- 172.21.15.106:0/3837556820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d6c0aeb70 0x7f4d6c146f10 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.231+0000 7f4d72800640 1 -- 172.21.15.106:0/3837556820 >> 172.21.15.106:0/3837556820 conn(0x7f4d6c067750 msgr2=0x7f4d6c159070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:03.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.231+0000 7f4d72800640 1 -- 172.21.15.106:0/3837556820 shutdown_connections 2024-08-17T02:31:03.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.231+0000 7f4d72800640 1 -- 172.21.15.106:0/3837556820 wait complete. 2024-08-17T02:31:03.250 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:31:03.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.402+0000 7f7e9fe00640 1 Processor -- start 2024-08-17T02:31:03.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.402+0000 7f7e9fe00640 1 -- start start 2024-08-17T02:31:03.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.403+0000 7f7e9fe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7e9806e790 0x7f7e980aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:03.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.403+0000 7f7e9fe00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e980afc10 con 0x7f7e98155550 2024-08-17T02:31:03.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.403+0000 7f7e9fe00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e980af000 con 0x7f7e98155180 2024-08-17T02:31:03.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.403+0000 7f7e9fe00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e980af2e0 con 0x7f7e9806e790 2024-08-17T02:31:03.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.403+0000 7f7e9ca00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7e98155550 0x7f7e9806e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:54678/0 (socket says 172.21.15.106:54678) 2024-08-17T02:31:03.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.403+0000 7f7e9ca00640 1 -- 172.21.15.106:0/2417111462 learned_addr learned my addr 172.21.15.106:0/2417111462 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:31:03.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.404+0000 7f7e9de00640 1 --2- 172.21.15.106:0/2417111462 >> v2:172.21.15.171:3300/0 conn(0x7f7e9806e790 0x7f7e980aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:03.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.404+0000 7f7e97e00640 1 -- 172.21.15.106:0/2417111462 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478482865 0 0) 0x7f7e980afc10 con 0x7f7e98155550 2024-08-17T02:31:03.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.404+0000 7f7e97e00640 1 -- 172.21.15.106:0/2417111462 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e800034e0 con 0x7f7e98155550 2024-08-17T02:31:03.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.404+0000 7f7e97e00640 1 -- 172.21.15.106:0/2417111462 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1374488911 0 0) 0x7f7e800034e0 con 0x7f7e98155550 2024-08-17T02:31:03.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.404+0000 7f7e97e00640 1 -- 172.21.15.106:0/2417111462 >> v2:172.21.15.171:3300/0 conn(0x7f7e9806e790 msgr2=0x7f7e980aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:03.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.404+0000 7f7e97e00640 1 --2- 172.21.15.106:0/2417111462 >> v2:172.21.15.171:3300/0 conn(0x7f7e9806e790 0x7f7e980aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.404+0000 7f7e97e00640 1 -- 172.21.15.106:0/2417111462 >> v1:172.21.15.171:6789/0 conn(0x7f7e98155180 legacy=0x7f7e980ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:03.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.404+0000 7f7e97e00640 1 -- 172.21.15.106:0/2417111462 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e980af5c0 con 0x7f7e98155550 2024-08-17T02:31:03.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.404+0000 7f7e97e00640 1 -- 172.21.15.106:0/2417111462 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7f7e84001490 con 0x7f7e98155550 2024-08-17T02:31:03.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.404+0000 7f7e97e00640 1 -- 172.21.15.106:0/2417111462 >> v1:172.21.15.106:6789/0 conn(0x7f7e98155550 legacy=0x7f7e9806e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:03.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.404+0000 7f7e97e00640 1 --2- 172.21.15.106:0/2417111462 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e800039d0 0x7f7e80003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:03.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.404+0000 7f7e97e00640 1 --2- 172.21.15.106:0/2417111462 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e80004780 0x7f7e80004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:03.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.404+0000 7f7e97e00640 1 --2- 172.21.15.106:0/2417111462 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e80005130 0x7f7e8000dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:03.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.404+0000 7f7e97e00640 1 -- 172.21.15.106:0/2417111462 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980af2e0 con 0x7f7e80004780 2024-08-17T02:31:03.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.404+0000 7f7e97e00640 1 -- 172.21.15.106:0/2417111462 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8000e250 con 0x7f7e80005130 2024-08-17T02:31:03.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.404+0000 7f7e97e00640 1 -- 172.21.15.106:0/2417111462 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8000e410 con 0x7f7e800039d0 2024-08-17T02:31:03.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.405+0000 7f7e9ca00640 1 --2- 172.21.15.106:0/2417111462 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e80004780 0x7f7e80004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:03.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.405+0000 7f7e9de00640 1 --2- 172.21.15.106:0/2417111462 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e80005130 0x7f7e8000dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:03.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.405+0000 7f7e9d400640 1 --2- 172.21.15.106:0/2417111462 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e800039d0 0x7f7e80003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:03.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.405+0000 7f7e9ca00640 1 -- 172.21.15.106:0/2417111462 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e800039d0 msgr2=0x7f7e80003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:03.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.405+0000 7f7e9ca00640 1 --2- 172.21.15.106:0/2417111462 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e800039d0 0x7f7e80003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.405+0000 7f7e9ca00640 1 -- 172.21.15.106:0/2417111462 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e80005130 msgr2=0x7f7e8000dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:03.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.405+0000 7f7e9ca00640 1 --2- 172.21.15.106:0/2417111462 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e80005130 0x7f7e8000dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.405+0000 7f7e9ca00640 1 -- 172.21.15.106:0/2417111462 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e800034e0 con 0x7f7e80004780 2024-08-17T02:31:03.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.405+0000 7f7e9de00640 1 -- 172.21.15.106:0/2417111462 reap_dead start 2024-08-17T02:31:03.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.406+0000 7f7e9ca00640 1 --2- 172.21.15.106:0/2417111462 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e80004780 0x7f7e80004bf0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400c2a0 tx=0x7f7e84001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad2bfd2391497ed server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:03.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.406+0000 7f7e97e00640 1 -- 172.21.15.106:0/2417111462 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e84005890 con 0x7f7e80004780 2024-08-17T02:31:03.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.406+0000 7f7e97e00640 1 -- 172.21.15.106:0/2417111462 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8402d070 con 0x7f7e80004780 2024-08-17T02:31:03.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.406+0000 7f7e97e00640 1 -- 172.21.15.106:0/2417111462 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e84005a50 con 0x7f7e80004780 2024-08-17T02:31:03.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.407+0000 7f7e9fe00640 1 -- 172.21.15.106:0/2417111462 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e80004780 msgr2=0x7f7e80004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:03.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.407+0000 7f7e9fe00640 1 --2- 172.21.15.106:0/2417111462 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e80004780 0x7f7e80004bf0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400c2a0 tx=0x7f7e84001e70 comp rx=0 tx=0).stop 2024-08-17T02:31:03.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.407+0000 7f7e9fe00640 1 -- 172.21.15.106:0/2417111462 shutdown_connections 2024-08-17T02:31:03.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.407+0000 7f7e9fe00640 1 --2- 172.21.15.106:0/2417111462 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e80004780 0x7f7e80004bf0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.407+0000 7f7e9fe00640 1 -- 172.21.15.106:0/2417111462 >> 172.21.15.106:0/2417111462 conn(0x7f7e980cb9b0 msgr2=0x7f7e980cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:03.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.407+0000 7f7e9fe00640 1 -- 172.21.15.106:0/2417111462 shutdown_connections 2024-08-17T02:31:03.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.407+0000 7f7e9fe00640 1 -- 172.21.15.106:0/2417111462 wait complete. 2024-08-17T02:31:03.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.408+0000 7f7e9fe00640 1 Processor -- start 2024-08-17T02:31:03.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.408+0000 7f7e9fe00640 1 -- start start 2024-08-17T02:31:03.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.409+0000 7f7e9fe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e80004780 0x7f7e98156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:03.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.409+0000 7f7e9fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e980c85d0 0x7f7e9814d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:03.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.409+0000 7f7e9fe00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e9816cc50 0x7f7e98069780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:03.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.409+0000 7f7e9fe00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e98157050 con 0x7f7e980c85d0 2024-08-17T02:31:03.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.409+0000 7f7e9fe00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9814daf0 con 0x7f7e9816cc50 2024-08-17T02:31:03.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.409+0000 7f7e9fe00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980c63a0 con 0x7f7e80004780 2024-08-17T02:31:03.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.409+0000 7f7e9ca00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e980c85d0 0x7f7e9814d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:03.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.409+0000 7f7e9ca00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e980c85d0 0x7f7e9814d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49378/0 (socket says 172.21.15.106:49378) 2024-08-17T02:31:03.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.409+0000 7f7e9ca00640 1 -- 172.21.15.106:0/3252594129 learned_addr learned my addr 172.21.15.106:0/3252594129 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:03.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.410+0000 7f7e9d400640 1 --2- 172.21.15.106:0/3252594129 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e80004780 0x7f7e98156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:03.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.410+0000 7f7e9de00640 1 --2- 172.21.15.106:0/3252594129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e9816cc50 0x7f7e98069780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:03.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.410+0000 7f7e9ca00640 1 -- 172.21.15.106:0/3252594129 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e80004780 msgr2=0x7f7e98156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:03.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.410+0000 7f7e9ca00640 1 --2- 172.21.15.106:0/3252594129 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e80004780 0x7f7e98156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.410+0000 7f7e9ca00640 1 -- 172.21.15.106:0/3252594129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e9816cc50 msgr2=0x7f7e98069780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:03.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.410+0000 7f7e9ca00640 1 --2- 172.21.15.106:0/3252594129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e9816cc50 0x7f7e98069780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.410+0000 7f7e9ca00640 1 -- 172.21.15.106:0/3252594129 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e980c8b90 con 0x7f7e980c85d0 2024-08-17T02:31:03.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.410+0000 7f7e9de00640 1 --2- 172.21.15.106:0/3252594129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e9816cc50 0x7f7e98069780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:31:03.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.410+0000 7f7e9ca00640 1 --2- 172.21.15.106:0/3252594129 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e980c85d0 0x7f7e9814d5b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400c300 tx=0x7f7e84030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:03.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.410+0000 7f7e94c00640 1 -- 172.21.15.106:0/3252594129 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e84040070 con 0x7f7e980c85d0 2024-08-17T02:31:03.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.410+0000 7f7e94c00640 1 -- 172.21.15.106:0/3252594129 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e84005dc0 con 0x7f7e980c85d0 2024-08-17T02:31:03.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.410+0000 7f7e94c00640 1 -- 172.21.15.106:0/3252594129 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e84007070 con 0x7f7e980c85d0 2024-08-17T02:31:03.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.410+0000 7f7e9fe00640 1 -- 172.21.15.106:0/3252594129 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e980c8e70 con 0x7f7e980c85d0 2024-08-17T02:31:03.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.411+0000 7f7e9fe00640 1 -- 172.21.15.106:0/3252594129 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e980c9430 con 0x7f7e980c85d0 2024-08-17T02:31:03.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.411+0000 7f7e9fe00640 1 -- 172.21.15.106:0/3252594129 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e98064db0 con 0x7f7e980c85d0 2024-08-17T02:31:03.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.412+0000 7f7e94c00640 1 -- 172.21.15.106:0/3252594129 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7e8402f030 con 0x7f7e980c85d0 2024-08-17T02:31:03.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.413+0000 7f7e94c00640 1 --2- 172.21.15.106:0/3252594129 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7e78065150 0x7f7e78067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:03.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.413+0000 7f7e94c00640 1 -- 172.21.15.106:0/3252594129 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f7e840a1b10 con 0x7f7e980c85d0 2024-08-17T02:31:03.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.413+0000 7f7e9d400640 1 --2- 172.21.15.106:0/3252594129 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7e78065150 0x7f7e78067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:03.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.414+0000 7f7e9d400640 1 --2- 172.21.15.106:0/3252594129 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7e78065150 0x7f7e78067600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7e98065970 tx=0x7f7e8c007ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:03.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.417+0000 7f7e94c00640 1 -- 172.21.15.106:0/3252594129 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7e8406fab0 con 0x7f7e980c85d0 2024-08-17T02:31:03.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.591+0000 7f7e9fe00640 1 -- 172.21.15.106:0/3252594129 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e98064db0 con 0x7f7e980c85d0 2024-08-17T02:31:03.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.592+0000 7f7e94c00640 1 -- 172.21.15.106:0/3252594129 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15560 (secure 0 0 0) 0x7f7e840730d0 con 0x7f7e980c85d0 2024-08-17T02:31:03.594 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:31:03.594 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":40,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:31:03.217182+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000123149.meta","create_time":"2024-08-17T02:28:50.720877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000123149"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000123149.data","create_time":"2024-08-17T02:28:51.638596+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000123149"}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.171:6834/754665763":"2024-08-18T02:31:00.016136+0000","172.21.15.171:6832/754665763":"2024-08-18T02:31:00.016136+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:31:03.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.594+0000 7f7e9fe00640 1 -- 172.21.15.106:0/3252594129 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7e78065150 msgr2=0x7f7e78067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:03.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.594+0000 7f7e9fe00640 1 --2- 172.21.15.106:0/3252594129 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7e78065150 0x7f7e78067600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7e98065970 tx=0x7f7e8c007ca0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.594+0000 7f7e9fe00640 1 -- 172.21.15.106:0/3252594129 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e980c85d0 msgr2=0x7f7e9814d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:03.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.594+0000 7f7e9fe00640 1 --2- 172.21.15.106:0/3252594129 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e980c85d0 0x7f7e9814d5b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400c300 tx=0x7f7e84030000 comp rx=0 tx=0).stop 2024-08-17T02:31:03.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.594+0000 7f7e9fe00640 1 -- 172.21.15.106:0/3252594129 shutdown_connections 2024-08-17T02:31:03.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.594+0000 7f7e9fe00640 1 --2- 172.21.15.106:0/3252594129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e9816cc50 0x7f7e98069780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.594+0000 7f7e9fe00640 1 --2- 172.21.15.106:0/3252594129 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7e78065150 0x7f7e78067600 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.594+0000 7f7e9fe00640 1 --2- 172.21.15.106:0/3252594129 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e980c85d0 0x7f7e9814d5b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.594+0000 7f7e9fe00640 1 --2- 172.21.15.106:0/3252594129 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e80004780 0x7f7e98156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.594+0000 7f7e9fe00640 1 -- 172.21.15.106:0/3252594129 >> 172.21.15.106:0/3252594129 conn(0x7f7e980cb9b0 msgr2=0x7f7e980b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:03.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.595+0000 7f7e9fe00640 1 -- 172.21.15.106:0/3252594129 shutdown_connections 2024-08-17T02:31:03.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.595+0000 7f7e9fe00640 1 -- 172.21.15.106:0/3252594129 wait complete. 2024-08-17T02:31:03.611 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:27:37.928826+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000123149.meta', 'create_time': '2024-08-17T02:28:50.720877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000123149'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000123149.data', 'create_time': '2024-08-17T02:28:51.638596+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000123149'}}}] 2024-08-17T02:31:03.612 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:31:03.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.760+0000 7f8b49600640 1 Processor -- start 2024-08-17T02:31:03.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.760+0000 7f8b49600640 1 -- start start 2024-08-17T02:31:03.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.762+0000 7f8b49600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b440accf0 0x7f8b440b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:03.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.762+0000 7f8b49600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8b440afd90 0x7f8b44157690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:03.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.762+0000 7f8b49600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b440ae540 con 0x7f8b44159610 2024-08-17T02:31:03.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.762+0000 7f8b49600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b440ad930 con 0x7f8b440afd90 2024-08-17T02:31:03.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.762+0000 7f8b49600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b440adc10 con 0x7f8b440accf0 2024-08-17T02:31:03.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.762+0000 7f8b3a000640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8b44159610 0x7f8b440af680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:54682/0 (socket says 172.21.15.106:54682) 2024-08-17T02:31:03.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.762+0000 7f8b3a000640 1 -- 172.21.15.106:0/1657184225 learned_addr learned my addr 172.21.15.106:0/1657184225 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:31:03.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.762+0000 7f8b42a00640 1 --2- 172.21.15.106:0/1657184225 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b440accf0 0x7f8b440b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:03.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.762+0000 7f8b43400640 1 --2- 172.21.15.106:0/1657184225 >> v2:172.21.15.171:3300/0 conn(0x7f8b440afd90 0x7f8b44157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:03.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.762+0000 7f8b42000640 1 -- 172.21.15.106:0/1657184225 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959884029 0 0) 0x7f8b440ae540 con 0x7f8b44159610 2024-08-17T02:31:03.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.762+0000 7f8b42000640 1 -- 172.21.15.106:0/1657184225 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b280034e0 con 0x7f8b44159610 2024-08-17T02:31:03.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.762+0000 7f8b42a00640 1 -- 172.21.15.106:0/1657184225 >> v2:172.21.15.171:3300/0 conn(0x7f8b440afd90 msgr2=0x7f8b44157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:03.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.762+0000 7f8b42a00640 1 --2- 172.21.15.106:0/1657184225 >> v2:172.21.15.171:3300/0 conn(0x7f8b440afd90 0x7f8b44157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.762+0000 7f8b42a00640 1 -- 172.21.15.106:0/1657184225 >> v1:172.21.15.106:6789/0 conn(0x7f8b44159610 legacy=0x7f8b440af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:03.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.762+0000 7f8b42a00640 1 -- 172.21.15.106:0/1657184225 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b440adef0 con 0x7f8b440accf0 2024-08-17T02:31:03.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.764+0000 7f8b42a00640 1 --2- 172.21.15.106:0/1657184225 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b440accf0 0x7f8b440b1670 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8b34009850 tx=0x7f8b340090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=166596b2f57b815e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:03.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.764+0000 7f8b42000640 1 -- 172.21.15.106:0/1657184225 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3402ad00 con 0x7f8b440accf0 2024-08-17T02:31:03.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.764+0000 7f8b42000640 1 -- 172.21.15.106:0/1657184225 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3402ae60 con 0x7f8b440accf0 2024-08-17T02:31:03.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.764+0000 7f8b42000640 1 -- 172.21.15.106:0/1657184225 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b34032650 con 0x7f8b440accf0 2024-08-17T02:31:03.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.764+0000 7f8b49600640 1 -- 172.21.15.106:0/1657184225 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b440accf0 msgr2=0x7f8b440b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:03.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.764+0000 7f8b49600640 1 --2- 172.21.15.106:0/1657184225 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b440accf0 0x7f8b440b1670 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8b34009850 tx=0x7f8b340090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.765+0000 7f8b49600640 1 -- 172.21.15.106:0/1657184225 shutdown_connections 2024-08-17T02:31:03.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.765+0000 7f8b49600640 1 --2- 172.21.15.106:0/1657184225 >> v2:172.21.15.171:3300/0 conn(0x7f8b440afd90 0x7f8b44157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.765+0000 7f8b49600640 1 --2- 172.21.15.106:0/1657184225 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b440accf0 0x7f8b440b1670 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.765+0000 7f8b49600640 1 -- 172.21.15.106:0/1657184225 >> 172.21.15.106:0/1657184225 conn(0x7f8b44067750 msgr2=0x7f8b440cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:03.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.765+0000 7f8b49600640 1 -- 172.21.15.106:0/1657184225 shutdown_connections 2024-08-17T02:31:03.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.765+0000 7f8b49600640 1 -- 172.21.15.106:0/1657184225 wait complete. 2024-08-17T02:31:03.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.766+0000 7f8b49600640 1 Processor -- start 2024-08-17T02:31:03.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.766+0000 7f8b49600640 1 -- start start 2024-08-17T02:31:03.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.767+0000 7f8b49600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b440accf0 0x7f8b4414cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:03.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.767+0000 7f8b49600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b440afd90 0x7f8b44150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:03.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.767+0000 7f8b49600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b44159610 0x7f8b4414e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:03.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.767+0000 7f8b49600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4414d200 con 0x7f8b440accf0 2024-08-17T02:31:03.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.767+0000 7f8b49600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4414d4e0 con 0x7f8b44159610 2024-08-17T02:31:03.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.767+0000 7f8b49600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4414d7c0 con 0x7f8b440afd90 2024-08-17T02:31:03.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.767+0000 7f8b42a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b440accf0 0x7f8b4414cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:03.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.767+0000 7f8b42a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b440accf0 0x7f8b4414cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49392/0 (socket says 172.21.15.106:49392) 2024-08-17T02:31:03.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.767+0000 7f8b42a00640 1 -- 172.21.15.106:0/1576294888 learned_addr learned my addr 172.21.15.106:0/1576294888 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:03.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.768+0000 7f8b43400640 1 --2- 172.21.15.106:0/1576294888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b44159610 0x7f8b4414e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:03.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.768+0000 7f8b3a000640 1 --2- 172.21.15.106:0/1576294888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b440afd90 0x7f8b44150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:03.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.768+0000 7f8b42a00640 1 -- 172.21.15.106:0/1576294888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b440afd90 msgr2=0x7f8b44150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:03.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.768+0000 7f8b42a00640 1 --2- 172.21.15.106:0/1576294888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b440afd90 0x7f8b44150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.768+0000 7f8b42a00640 1 -- 172.21.15.106:0/1576294888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b44159610 msgr2=0x7f8b4414e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:03.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.768+0000 7f8b42a00640 1 --2- 172.21.15.106:0/1576294888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b44159610 0x7f8b4414e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.768+0000 7f8b42a00640 1 -- 172.21.15.106:0/1576294888 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b34009390 con 0x7f8b440accf0 2024-08-17T02:31:03.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.768+0000 7f8b42a00640 1 --2- 172.21.15.106:0/1576294888 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b440accf0 0x7f8b4414cbb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8b34009360 tx=0x7f8b34032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:03.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.768+0000 7f8b3aa00640 1 -- 172.21.15.106:0/1576294888 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3403e660 con 0x7f8b440accf0 2024-08-17T02:31:03.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.768+0000 7f8b3aa00640 1 -- 172.21.15.106:0/1576294888 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3403e7c0 con 0x7f8b440accf0 2024-08-17T02:31:03.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.768+0000 7f8b3aa00640 1 -- 172.21.15.106:0/1576294888 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3403eb80 con 0x7f8b440accf0 2024-08-17T02:31:03.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.768+0000 7f8b49600640 1 -- 172.21.15.106:0/1576294888 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b4414ee00 con 0x7f8b440accf0 2024-08-17T02:31:03.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.769+0000 7f8b49600640 1 -- 172.21.15.106:0/1576294888 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b4414e8d0 con 0x7f8b440accf0 2024-08-17T02:31:03.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.769+0000 7f8b49600640 1 -- 172.21.15.106:0/1576294888 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b44064db0 con 0x7f8b440accf0 2024-08-17T02:31:03.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.770+0000 7f8b3aa00640 1 -- 172.21.15.106:0/1576294888 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8b3403c400 con 0x7f8b440accf0 2024-08-17T02:31:03.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.771+0000 7f8b3aa00640 1 --2- 172.21.15.106:0/1576294888 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8b20065150 0x7f8b20067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:03.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.771+0000 7f8b3aa00640 1 -- 172.21.15.106:0/1576294888 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f8b340a2940 con 0x7f8b440accf0 2024-08-17T02:31:03.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.771+0000 7f8b3a000640 1 --2- 172.21.15.106:0/1576294888 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8b20065150 0x7f8b20067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:03.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.772+0000 7f8b3a000640 1 --2- 172.21.15.106:0/1576294888 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8b20065150 0x7f8b20067600 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8b440cb340 tx=0x7f8b2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:03.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.775+0000 7f8b3aa00640 1 -- 172.21.15.106:0/1576294888 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8b340708e0 con 0x7f8b440accf0 2024-08-17T02:31:03.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.946+0000 7f8b49600640 1 -- 172.21.15.106:0/1576294888 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8b440cc480 con 0x7f8b440accf0 2024-08-17T02:31:03.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.946+0000 7f8b3aa00640 1 -- 172.21.15.106:0/1576294888 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8b340370a0 con 0x7f8b440accf0 2024-08-17T02:31:03.948 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-08-17T02:31:03.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.948+0000 7f8b49600640 1 -- 172.21.15.106:0/1576294888 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8b20065150 msgr2=0x7f8b20067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:03.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.948+0000 7f8b49600640 1 --2- 172.21.15.106:0/1576294888 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8b20065150 0x7f8b20067600 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8b440cb340 tx=0x7f8b2c009040 comp rx=0 tx=0).stop 2024-08-17T02:31:03.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.948+0000 7f8b49600640 1 -- 172.21.15.106:0/1576294888 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b440accf0 msgr2=0x7f8b4414cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:03.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.948+0000 7f8b49600640 1 --2- 172.21.15.106:0/1576294888 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b440accf0 0x7f8b4414cbb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8b34009360 tx=0x7f8b34032000 comp rx=0 tx=0).stop 2024-08-17T02:31:03.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.948+0000 7f8b49600640 1 -- 172.21.15.106:0/1576294888 shutdown_connections 2024-08-17T02:31:03.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.948+0000 7f8b49600640 1 --2- 172.21.15.106:0/1576294888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b44159610 0x7f8b4414e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.948+0000 7f8b49600640 1 --2- 172.21.15.106:0/1576294888 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b440afd90 0x7f8b44150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.948+0000 7f8b49600640 1 --2- 172.21.15.106:0/1576294888 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8b20065150 0x7f8b20067600 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.948+0000 7f8b49600640 1 --2- 172.21.15.106:0/1576294888 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b440accf0 0x7f8b4414cbb0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:03.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.948+0000 7f8b49600640 1 -- 172.21.15.106:0/1576294888 >> 172.21.15.106:0/1576294888 conn(0x7f8b44067750 msgr2=0x7f8b4406e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:03.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.948+0000 7f8b49600640 1 -- 172.21.15.106:0/1576294888 shutdown_connections 2024-08-17T02:31:03.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:03.948+0000 7f8b49600640 1 -- 172.21.15.106:0/1576294888 wait complete. 2024-08-17T02:31:03.964 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000123149.meta pg_num 2024-08-17T02:31:04.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.114+0000 7fddd3600640 1 Processor -- start 2024-08-17T02:31:04.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.114+0000 7fddd3600640 1 -- start start 2024-08-17T02:31:04.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.115+0000 7fddd3600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fddcc0caa20 0x7fddcc0c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.115+0000 7fddd3600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fddcc0c3390 0x7fddcc0c7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.115+0000 7fddd3600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddcc0cb540 con 0x7fddcc158e20 2024-08-17T02:31:04.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.115+0000 7fddd3600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddcc0cf7f0 con 0x7fddcc0caa20 2024-08-17T02:31:04.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.115+0000 7fddd3600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddcc0caef0 con 0x7fddcc0c3390 2024-08-17T02:31:04.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.115+0000 7fddcbe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fddcc0caa20 0x7fddcc0c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.115+0000 7fddcbe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fddcc0caa20 0x7fddcc0c6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49406/0 (socket says 172.21.15.106:49406) 2024-08-17T02:31:04.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.115+0000 7fddcbe00640 1 -- 172.21.15.106:0/914877662 learned_addr learned my addr 172.21.15.106:0/914877662 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:04.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.116+0000 7fddd1600640 1 --2- 172.21.15.106:0/914877662 >> v2:172.21.15.171:3300/0 conn(0x7fddcc0c3390 0x7fddcc0c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.116+0000 7fddcbe00640 1 -- 172.21.15.106:0/914877662 >> v2:172.21.15.171:3300/0 conn(0x7fddcc0c3390 msgr2=0x7fddcc0c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:04.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.116+0000 7fddcbe00640 1 --2- 172.21.15.106:0/914877662 >> v2:172.21.15.171:3300/0 conn(0x7fddcc0c3390 0x7fddcc0c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.116+0000 7fddcbe00640 1 -- 172.21.15.106:0/914877662 >> v1:172.21.15.171:6789/0 conn(0x7fddcc158e20 legacy=0x7fddcc0ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:04.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.116+0000 7fddcbe00640 1 -- 172.21.15.106:0/914877662 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc0cb1d0 con 0x7fddcc0caa20 2024-08-17T02:31:04.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.117+0000 7fddcbe00640 1 --2- 172.21.15.106:0/914877662 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddcc0caa20 0x7fddcc0c6e10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fddcc06f650 tx=0x7fddb80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfaf5f33c66c868e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:04.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.117+0000 7fddcb400640 1 -- 172.21.15.106:0/914877662 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb802add0 con 0x7fddcc0caa20 2024-08-17T02:31:04.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.117+0000 7fddcb400640 1 -- 172.21.15.106:0/914877662 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb8032440 con 0x7fddcc0caa20 2024-08-17T02:31:04.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.117+0000 7fddcb400640 1 -- 172.21.15.106:0/914877662 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb8032820 con 0x7fddcc0caa20 2024-08-17T02:31:04.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.117+0000 7fddd3600640 1 -- 172.21.15.106:0/914877662 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddcc0caa20 msgr2=0x7fddcc0c6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.118+0000 7fddd3600640 1 --2- 172.21.15.106:0/914877662 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddcc0caa20 0x7fddcc0c6e10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fddcc06f650 tx=0x7fddb80091d0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.118+0000 7fddd3600640 1 -- 172.21.15.106:0/914877662 shutdown_connections 2024-08-17T02:31:04.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.118+0000 7fddd3600640 1 --2- 172.21.15.106:0/914877662 >> v2:172.21.15.171:3300/0 conn(0x7fddcc0c3390 0x7fddcc0c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.118+0000 7fddd3600640 1 --2- 172.21.15.106:0/914877662 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddcc0caa20 0x7fddcc0c6e10 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.118+0000 7fddd3600640 1 -- 172.21.15.106:0/914877662 >> 172.21.15.106:0/914877662 conn(0x7fddcc0cfd70 msgr2=0x7fddcc0d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:04.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.118+0000 7fddd3600640 1 -- 172.21.15.106:0/914877662 shutdown_connections 2024-08-17T02:31:04.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.118+0000 7fddd3600640 1 -- 172.21.15.106:0/914877662 wait complete. 2024-08-17T02:31:04.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.119+0000 7fddd3600640 1 Processor -- start 2024-08-17T02:31:04.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.119+0000 7fddd3600640 1 -- start start 2024-08-17T02:31:04.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.120+0000 7fddd3600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fddcc0c3390 0x7fddcc09c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.120+0000 7fddd3600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddcc0caa20 0x7fddcc09cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.120+0000 7fddd3600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fddcc158e20 0x7fddcc0c5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.120+0000 7fddd3600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc09acf0 con 0x7fddcc0caa20 2024-08-17T02:31:04.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.120+0000 7fddd3600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc09a0e0 con 0x7fddcc0c3390 2024-08-17T02:31:04.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.120+0000 7fddd3600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc09a3c0 con 0x7fddcc158e20 2024-08-17T02:31:04.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.120+0000 7fddcbe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddcc0caa20 0x7fddcc09cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.120+0000 7fddcbe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddcc0caa20 0x7fddcc09cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49408/0 (socket says 172.21.15.106:49408) 2024-08-17T02:31:04.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.120+0000 7fddcbe00640 1 -- 172.21.15.106:0/3884676347 learned_addr learned my addr 172.21.15.106:0/3884676347 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:04.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.120+0000 7fddd0c00640 1 --2- 172.21.15.106:0/3884676347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fddcc0c3390 0x7fddcc09c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.121+0000 7fddd1600640 1 --2- 172.21.15.106:0/3884676347 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fddcc158e20 0x7fddcc0c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.121+0000 7fddcbe00640 1 -- 172.21.15.106:0/3884676347 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fddcc158e20 msgr2=0x7fddcc0c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.121+0000 7fddcbe00640 1 --2- 172.21.15.106:0/3884676347 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fddcc158e20 0x7fddcc0c5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.121+0000 7fddcbe00640 1 -- 172.21.15.106:0/3884676347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fddcc0c3390 msgr2=0x7fddcc09c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.121+0000 7fddcbe00640 1 --2- 172.21.15.106:0/3884676347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fddcc0c3390 0x7fddcc09c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.121+0000 7fddcbe00640 1 -- 172.21.15.106:0/3884676347 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb8009450 con 0x7fddcc0caa20 2024-08-17T02:31:04.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.121+0000 7fddcbe00640 1 --2- 172.21.15.106:0/3884676347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddcc0caa20 0x7fddcc09cb60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fddb8035040 tx=0x7fddb8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:04.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.121+0000 7fddbfe00640 1 -- 172.21.15.106:0/3884676347 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb8031de0 con 0x7fddcc0caa20 2024-08-17T02:31:04.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.121+0000 7fddbfe00640 1 -- 172.21.15.106:0/3884676347 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb8000c40 con 0x7fddcc0caa20 2024-08-17T02:31:04.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.121+0000 7fddbfe00640 1 -- 172.21.15.106:0/3884676347 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb803d670 con 0x7fddcc0caa20 2024-08-17T02:31:04.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.121+0000 7fddd3600640 1 -- 172.21.15.106:0/3884676347 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddcc09a6a0 con 0x7fddcc0caa20 2024-08-17T02:31:04.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.121+0000 7fddd3600640 1 -- 172.21.15.106:0/3884676347 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddcc099c00 con 0x7fddcc0caa20 2024-08-17T02:31:04.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.122+0000 7fddd3600640 1 -- 172.21.15.106:0/3884676347 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddcc071050 con 0x7fddcc0caa20 2024-08-17T02:31:04.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.123+0000 7fddbfe00640 1 -- 172.21.15.106:0/3884676347 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fddb8039040 con 0x7fddcc0caa20 2024-08-17T02:31:04.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.124+0000 7fddbfe00640 1 --2- 172.21.15.106:0/3884676347 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fddac065150 0x7fddac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.124+0000 7fddbfe00640 1 -- 172.21.15.106:0/3884676347 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fddb80a2470 con 0x7fddcc0caa20 2024-08-17T02:31:04.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.124+0000 7fddd0c00640 1 --2- 172.21.15.106:0/3884676347 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fddac065150 0x7fddac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.125+0000 7fddd0c00640 1 --2- 172.21.15.106:0/3884676347 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fddac065150 0x7fddac067600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fddc000b8d0 tx=0x7fddc0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:04.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.128+0000 7fddbfe00640 1 -- 172.21.15.106:0/3884676347 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fddb80704d0 con 0x7fddcc0caa20 2024-08-17T02:31:04.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.299+0000 7fddd3600640 1 -- 172.21.15.106:0/3884676347 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000123149.meta", "var": "pg_num"} v 0) v1 -- 0x7fddcc099e20 con 0x7fddcc0caa20 2024-08-17T02:31:04.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.299+0000 7fddbfe00640 1 -- 172.21.15.106:0/3884676347 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000123149.meta", "var": "pg_num"}]=0 v40) v1 ==== 124+0+11 (secure 0 0 0) 0x7fddb8037020 con 0x7fddcc0caa20 2024-08-17T02:31:04.301 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-08-17T02:31:04.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.301+0000 7fddd3600640 1 -- 172.21.15.106:0/3884676347 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fddac065150 msgr2=0x7fddac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.301+0000 7fddd3600640 1 --2- 172.21.15.106:0/3884676347 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fddac065150 0x7fddac067600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fddc000b8d0 tx=0x7fddc0008040 comp rx=0 tx=0).stop 2024-08-17T02:31:04.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.301+0000 7fddd3600640 1 -- 172.21.15.106:0/3884676347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddcc0caa20 msgr2=0x7fddcc09cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.301+0000 7fddd3600640 1 --2- 172.21.15.106:0/3884676347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddcc0caa20 0x7fddcc09cb60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fddb8035040 tx=0x7fddb8032000 comp rx=0 tx=0).stop 2024-08-17T02:31:04.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.301+0000 7fddd3600640 1 -- 172.21.15.106:0/3884676347 shutdown_connections 2024-08-17T02:31:04.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.301+0000 7fddd3600640 1 --2- 172.21.15.106:0/3884676347 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fddcc158e20 0x7fddcc0c5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.301+0000 7fddd3600640 1 --2- 172.21.15.106:0/3884676347 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fddac065150 0x7fddac067600 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.301+0000 7fddd3600640 1 --2- 172.21.15.106:0/3884676347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fddcc0caa20 0x7fddcc09cb60 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.301+0000 7fddd3600640 1 --2- 172.21.15.106:0/3884676347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fddcc0c3390 0x7fddcc09c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.301+0000 7fddd3600640 1 -- 172.21.15.106:0/3884676347 >> 172.21.15.106:0/3884676347 conn(0x7fddcc0cfd70 msgr2=0x7fddcc0c7180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:04.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.302+0000 7fddd3600640 1 -- 172.21.15.106:0/3884676347 shutdown_connections 2024-08-17T02:31:04.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.302+0000 7fddd3600640 1 -- 172.21.15.106:0/3884676347 wait complete. 2024-08-17T02:31:04.318 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000123149.data pg_num 2024-08-17T02:31:04.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.467+0000 7f3429e00640 1 Processor -- start 2024-08-17T02:31:04.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.467+0000 7f3429e00640 1 -- start start 2024-08-17T02:31:04.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.468+0000 7f3429e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34240adcf0 0x7f34240ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.468+0000 7f3429e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34240ab130 con 0x7f34240abb00 2024-08-17T02:31:04.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.468+0000 7f3429e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34240ae5a0 con 0x7f3424156c50 2024-08-17T02:31:04.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.468+0000 7f3429e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34240ae2c0 con 0x7f34240adcf0 2024-08-17T02:31:04.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.468+0000 7f3423400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f34240abb00 0x7f34240c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:54684/0 (socket says 172.21.15.106:54684) 2024-08-17T02:31:04.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.469+0000 7f3423400640 1 -- 172.21.15.106:0/718278726 learned_addr learned my addr 172.21.15.106:0/718278726 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:31:04.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.469+0000 7f3422000640 1 --2- 172.21.15.106:0/718278726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34240adcf0 0x7f34240ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.469+0000 7f3421600640 1 -- 172.21.15.106:0/718278726 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977161468 0 0) 0x7f34240ab130 con 0x7f34240abb00 2024-08-17T02:31:04.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.469+0000 7f3421600640 1 -- 172.21.15.106:0/718278726 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34080034e0 con 0x7f34240abb00 2024-08-17T02:31:04.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.469+0000 7f3421600640 1 -- 172.21.15.106:0/718278726 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2442157483 0 0) 0x7f34080034e0 con 0x7f34240abb00 2024-08-17T02:31:04.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.469+0000 7f3421600640 1 -- 172.21.15.106:0/718278726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34240adcf0 msgr2=0x7f34240ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:04.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.469+0000 7f3421600640 1 --2- 172.21.15.106:0/718278726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34240adcf0 0x7f34240ab5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.469+0000 7f3421600640 1 -- 172.21.15.106:0/718278726 >> v1:172.21.15.171:6789/0 conn(0x7f3424156c50 legacy=0x7f34240c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.469+0000 7f3421600640 1 -- 172.21.15.106:0/718278726 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34240aaae0 con 0x7f34240abb00 2024-08-17T02:31:04.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.469+0000 7f3421600640 1 -- 172.21.15.106:0/718278726 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7f341c0017f0 con 0x7f34240abb00 2024-08-17T02:31:04.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.469+0000 7f3421600640 1 -- 172.21.15.106:0/718278726 >> v1:172.21.15.106:6789/0 conn(0x7f34240abb00 legacy=0x7f34240c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.469+0000 7f3421600640 1 --2- 172.21.15.106:0/718278726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3408003a00 0x7f3408003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.469+0000 7f3421600640 1 --2- 172.21.15.106:0/718278726 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3408004780 0x7f3408004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.469+0000 7f3421600640 1 --2- 172.21.15.106:0/718278726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34240adcf0 0x7f34080051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.469+0000 7f3421600640 1 -- 172.21.15.106:0/718278726 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34240ae2c0 con 0x7f3408003a00 2024-08-17T02:31:04.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.469+0000 7f3421600640 1 -- 172.21.15.106:0/718278726 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340800bb60 con 0x7f3408004780 2024-08-17T02:31:04.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.469+0000 7f3421600640 1 -- 172.21.15.106:0/718278726 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340800bcf0 con 0x7f34240adcf0 2024-08-17T02:31:04.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.470+0000 7f3422a00640 1 --2- 172.21.15.106:0/718278726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3408003a00 0x7f3408003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.470+0000 7f3422000640 1 --2- 172.21.15.106:0/718278726 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3408004780 0x7f3408004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.470+0000 7f3423400640 1 --2- 172.21.15.106:0/718278726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34240adcf0 0x7f34080051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.470+0000 7f3422a00640 1 -- 172.21.15.106:0/718278726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34240adcf0 msgr2=0x7f34080051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:04.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.470+0000 7f3422a00640 1 --2- 172.21.15.106:0/718278726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34240adcf0 0x7f34080051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.470+0000 7f3422a00640 1 -- 172.21.15.106:0/718278726 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3408004780 msgr2=0x7f3408004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:04.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.470+0000 7f3422a00640 1 --2- 172.21.15.106:0/718278726 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3408004780 0x7f3408004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.470+0000 7f3422a00640 1 -- 172.21.15.106:0/718278726 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34080034e0 con 0x7f3408003a00 2024-08-17T02:31:04.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.470+0000 7f3423400640 1 --2- 172.21.15.106:0/718278726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f34240adcf0 0x7f34080051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:31:04.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.470+0000 7f3422000640 1 --2- 172.21.15.106:0/718278726 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3408004780 0x7f3408004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:31:04.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.471+0000 7f3422a00640 1 --2- 172.21.15.106:0/718278726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3408003a00 0x7f3408003e10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3414001830 tx=0x7f3414007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9709ecb53d01b370 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:04.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.471+0000 7f3421600640 1 -- 172.21.15.106:0/718278726 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341402a920 con 0x7f3408003a00 2024-08-17T02:31:04.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.471+0000 7f3421600640 1 -- 172.21.15.106:0/718278726 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341402aaa0 con 0x7f3408003a00 2024-08-17T02:31:04.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.471+0000 7f3421600640 1 -- 172.21.15.106:0/718278726 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341402ae60 con 0x7f3408003a00 2024-08-17T02:31:04.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.472+0000 7f3429e00640 1 -- 172.21.15.106:0/718278726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3408003a00 msgr2=0x7f3408003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.472+0000 7f3429e00640 1 --2- 172.21.15.106:0/718278726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3408003a00 0x7f3408003e10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3414001830 tx=0x7f3414007ca0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.472+0000 7f3423400640 1 -- 172.21.15.106:0/718278726 reap_dead start 2024-08-17T02:31:04.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.472+0000 7f3429e00640 1 -- 172.21.15.106:0/718278726 shutdown_connections 2024-08-17T02:31:04.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.472+0000 7f3429e00640 1 -- 172.21.15.106:0/718278726 >> 172.21.15.106:0/718278726 conn(0x7f3424067750 msgr2=0x7f34240c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:04.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.472+0000 7f3429e00640 1 -- 172.21.15.106:0/718278726 shutdown_connections 2024-08-17T02:31:04.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.472+0000 7f3429e00640 1 -- 172.21.15.106:0/718278726 wait complete. 2024-08-17T02:31:04.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.473+0000 7f3429e00640 1 Processor -- start 2024-08-17T02:31:04.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.473+0000 7f3429e00640 1 -- start start 2024-08-17T02:31:04.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.474+0000 7f3429e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3408003a00 0x7f3424157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.474+0000 7f3429e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34241581a0 0x7f34241482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.474+0000 7f3429e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3424151030 0x7f3424148800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.474+0000 7f3429e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3424148d40 con 0x7f34241581a0 2024-08-17T02:31:04.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.474+0000 7f3429e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3424154850 con 0x7f3408003a00 2024-08-17T02:31:04.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.474+0000 7f3429e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3424151590 con 0x7f3424151030 2024-08-17T02:31:04.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.474+0000 7f3422000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34241581a0 0x7f34241482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.474+0000 7f3422000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34241581a0 0x7f34241482c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49422/0 (socket says 172.21.15.106:49422) 2024-08-17T02:31:04.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.475+0000 7f3422000640 1 -- 172.21.15.106:0/1350798934 learned_addr learned my addr 172.21.15.106:0/1350798934 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:04.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.475+0000 7f3422a00640 1 --2- 172.21.15.106:0/1350798934 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3408003a00 0x7f3424157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.475+0000 7f3423400640 1 --2- 172.21.15.106:0/1350798934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3424151030 0x7f3424148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.475+0000 7f3422000640 1 -- 172.21.15.106:0/1350798934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3424151030 msgr2=0x7f3424148800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.475+0000 7f3422000640 1 --2- 172.21.15.106:0/1350798934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3424151030 0x7f3424148800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.475+0000 7f3422000640 1 -- 172.21.15.106:0/1350798934 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3408003a00 msgr2=0x7f3424157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.475+0000 7f3422000640 1 --2- 172.21.15.106:0/1350798934 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3408003a00 0x7f3424157c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.475+0000 7f3422000640 1 -- 172.21.15.106:0/1350798934 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3424151870 con 0x7f34241581a0 2024-08-17T02:31:04.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.475+0000 7f3422000640 1 --2- 172.21.15.106:0/1350798934 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34241581a0 0x7f34241482c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3410011960 tx=0x7f3410008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:04.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.475+0000 7f341a000640 1 -- 172.21.15.106:0/1350798934 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341000f9d0 con 0x7f34241581a0 2024-08-17T02:31:04.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.475+0000 7f341a000640 1 -- 172.21.15.106:0/1350798934 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341000fb30 con 0x7f34241581a0 2024-08-17T02:31:04.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.476+0000 7f3429e00640 1 -- 172.21.15.106:0/1350798934 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3424151b50 con 0x7f34241581a0 2024-08-17T02:31:04.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.476+0000 7f341a000640 1 -- 172.21.15.106:0/1350798934 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341000feb0 con 0x7f34241581a0 2024-08-17T02:31:04.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.476+0000 7f3429e00640 1 -- 172.21.15.106:0/1350798934 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34241495f0 con 0x7f34241581a0 2024-08-17T02:31:04.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.477+0000 7f3429e00640 1 -- 172.21.15.106:0/1350798934 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3424071050 con 0x7f34241581a0 2024-08-17T02:31:04.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.477+0000 7f341a000640 1 -- 172.21.15.106:0/1350798934 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3410015670 con 0x7f34241581a0 2024-08-17T02:31:04.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.479+0000 7f341a000640 1 --2- 172.21.15.106:0/1350798934 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f3404065150 0x7f3404067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.479+0000 7f341a000640 1 -- 172.21.15.106:0/1350798934 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f3410082e40 con 0x7f34241581a0 2024-08-17T02:31:04.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.479+0000 7f3422a00640 1 --2- 172.21.15.106:0/1350798934 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f3404065150 0x7f3404067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.479+0000 7f3422a00640 1 --2- 172.21.15.106:0/1350798934 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f3404065150 0x7f3404067600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3414032000 tx=0x7f3414003000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:04.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.482+0000 7f341a000640 1 -- 172.21.15.106:0/1350798934 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3410050e90 con 0x7f34241581a0 2024-08-17T02:31:04.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.655+0000 7f3429e00640 1 -- 172.21.15.106:0/1350798934 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000123149.data", "var": "pg_num"} v 0) v1 -- 0x7f342406a5c0 con 0x7f34241581a0 2024-08-17T02:31:04.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.655+0000 7f341a000640 1 -- 172.21.15.106:0/1350798934 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000123149.data", "var": "pg_num"}]=0 v40) v1 ==== 124+0+11 (secure 0 0 0) 0x7f3410022020 con 0x7f34241581a0 2024-08-17T02:31:04.657 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2024-08-17T02:31:04.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.657+0000 7f3429e00640 1 -- 172.21.15.106:0/1350798934 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f3404065150 msgr2=0x7f3404067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.657+0000 7f3429e00640 1 --2- 172.21.15.106:0/1350798934 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f3404065150 0x7f3404067600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3414032000 tx=0x7f3414003000 comp rx=0 tx=0).stop 2024-08-17T02:31:04.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.657+0000 7f3429e00640 1 -- 172.21.15.106:0/1350798934 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34241581a0 msgr2=0x7f34241482c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.657+0000 7f3429e00640 1 --2- 172.21.15.106:0/1350798934 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34241581a0 0x7f34241482c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3410011960 tx=0x7f3410008040 comp rx=0 tx=0).stop 2024-08-17T02:31:04.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.657+0000 7f3429e00640 1 -- 172.21.15.106:0/1350798934 shutdown_connections 2024-08-17T02:31:04.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.657+0000 7f3429e00640 1 --2- 172.21.15.106:0/1350798934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3424151030 0x7f3424148800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.657+0000 7f3429e00640 1 --2- 172.21.15.106:0/1350798934 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f3404065150 0x7f3404067600 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.657+0000 7f3429e00640 1 --2- 172.21.15.106:0/1350798934 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f34241581a0 0x7f34241482c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.657+0000 7f3429e00640 1 --2- 172.21.15.106:0/1350798934 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3408003a00 0x7f3424157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.657+0000 7f3429e00640 1 -- 172.21.15.106:0/1350798934 >> 172.21.15.106:0/1350798934 conn(0x7f3424067750 msgr2=0x7f34240ae9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:04.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.657+0000 7f3429e00640 1 -- 172.21.15.106:0/1350798934 shutdown_connections 2024-08-17T02:31:04.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.657+0000 7f3429e00640 1 -- 172.21.15.106:0/1350798934 wait complete. 2024-08-17T02:31:04.674 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:31:04.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.820+0000 7fae03e00640 1 Processor -- start 2024-08-17T02:31:04.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.820+0000 7fae03e00640 1 -- start start 2024-08-17T02:31:04.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.821+0000 7fae03e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fadfc06df00 0x7fadfc0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.822+0000 7fae03e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadfc156670 con 0x7fadfc155df0 2024-08-17T02:31:04.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.822+0000 7fae03e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadfc06e5e0 con 0x7fadfc155a20 2024-08-17T02:31:04.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.822+0000 7fae03e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadfc0b0350 con 0x7fadfc06df00 2024-08-17T02:31:04.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.822+0000 7fae00a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fadfc06df00 0x7fadfc0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.822+0000 7fae01e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fadfc155df0 0x7fadfc156b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:54688/0 (socket says 172.21.15.106:54688) 2024-08-17T02:31:04.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.822+0000 7fae01e00640 1 -- 172.21.15.106:0/3895118072 learned_addr learned my addr 172.21.15.106:0/3895118072 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:31:04.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.822+0000 7fae00a00640 1 -- 172.21.15.106:0/3895118072 >> v1:172.21.15.171:6789/0 conn(0x7fadfc155a20 legacy=0x7fadfc06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.822+0000 7fae00a00640 1 -- 172.21.15.106:0/3895118072 >> v1:172.21.15.106:6789/0 conn(0x7fadfc155df0 legacy=0x7fadfc156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.822+0000 7fae00a00640 1 -- 172.21.15.106:0/3895118072 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadfc06e8c0 con 0x7fadfc06df00 2024-08-17T02:31:04.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.822+0000 7fadfbe00640 1 -- 172.21.15.106:0/3895118072 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015673256 0 0) 0x7fadfc156670 con 0x7fadfc155df0 2024-08-17T02:31:04.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.823+0000 7fae00a00640 1 --2- 172.21.15.106:0/3895118072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadfc06df00 0x7fadfc0adf10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fade8009850 tx=0x7fade80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf5541b9ef70f9d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:04.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.824+0000 7fadfbe00640 1 -- 172.21.15.106:0/3895118072 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade802ad90 con 0x7fadfc06df00 2024-08-17T02:31:04.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.824+0000 7fadfbe00640 1 -- 172.21.15.106:0/3895118072 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade8032440 con 0x7fadfc06df00 2024-08-17T02:31:04.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.824+0000 7fadfbe00640 1 -- 172.21.15.106:0/3895118072 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade80327e0 con 0x7fadfc06df00 2024-08-17T02:31:04.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.824+0000 7fae03e00640 1 -- 172.21.15.106:0/3895118072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadfc06df00 msgr2=0x7fadfc0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.824+0000 7fae03e00640 1 --2- 172.21.15.106:0/3895118072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadfc06df00 0x7fadfc0adf10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fade8009850 tx=0x7fade80090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.824+0000 7fae03e00640 1 -- 172.21.15.106:0/3895118072 shutdown_connections 2024-08-17T02:31:04.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.824+0000 7fae03e00640 1 --2- 172.21.15.106:0/3895118072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadfc06df00 0x7fadfc0adf10 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.824+0000 7fae03e00640 1 -- 172.21.15.106:0/3895118072 >> 172.21.15.106:0/3895118072 conn(0x7fadfc0cb9b0 msgr2=0x7fadfc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:04.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.824+0000 7fae03e00640 1 -- 172.21.15.106:0/3895118072 shutdown_connections 2024-08-17T02:31:04.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.824+0000 7fae03e00640 1 -- 172.21.15.106:0/3895118072 wait complete. 2024-08-17T02:31:04.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.826+0000 7fae03e00640 1 Processor -- start 2024-08-17T02:31:04.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.826+0000 7fae03e00640 1 -- start start 2024-08-17T02:31:04.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.827+0000 7fae03e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fadfc06df00 0x7fadfc1455d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.827+0000 7fae03e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fadfc155a20 0x7fadfc15df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.827+0000 7fae03e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadfc155df0 0x7fadfc0ab860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.827+0000 7fae03e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc0ad8b0 con 0x7fadfc155df0 2024-08-17T02:31:04.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.827+0000 7fae03e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc0aa660 con 0x7fadfc155a20 2024-08-17T02:31:04.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.827+0000 7fae03e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc0adac0 con 0x7fadfc06df00 2024-08-17T02:31:04.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.827+0000 7fae01e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadfc155df0 0x7fadfc0ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.827+0000 7fae00a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fadfc155a20 0x7fadfc15df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.827+0000 7fae01400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fadfc06df00 0x7fadfc1455d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.827+0000 7fae01e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadfc155df0 0x7fadfc0ab860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49440/0 (socket says 172.21.15.106:49440) 2024-08-17T02:31:04.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.827+0000 7fae01e00640 1 -- 172.21.15.106:0/3204087224 learned_addr learned my addr 172.21.15.106:0/3204087224 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:04.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.827+0000 7fae01e00640 1 -- 172.21.15.106:0/3204087224 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fadfc06df00 msgr2=0x7fadfc1455d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.827+0000 7fae01e00640 1 --2- 172.21.15.106:0/3204087224 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fadfc06df00 0x7fadfc1455d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.827+0000 7fae01e00640 1 -- 172.21.15.106:0/3204087224 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fadfc155a20 msgr2=0x7fadfc15df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:04.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.827+0000 7fae01e00640 1 --2- 172.21.15.106:0/3204087224 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fadfc155a20 0x7fadfc15df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:04.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.827+0000 7fae01e00640 1 -- 172.21.15.106:0/3204087224 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade8009390 con 0x7fadfc155df0 2024-08-17T02:31:04.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.828+0000 7fae01e00640 1 --2- 172.21.15.106:0/3204087224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadfc155df0 0x7fadfc0ab860 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fadf400cb90 tx=0x7fadf4001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:04.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.828+0000 7fadf8c00640 1 -- 172.21.15.106:0/3204087224 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf400a640 con 0x7fadfc155df0 2024-08-17T02:31:04.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.828+0000 7fadf8c00640 1 -- 172.21.15.106:0/3204087224 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf400a7c0 con 0x7fadfc155df0 2024-08-17T02:31:04.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.828+0000 7fadf8c00640 1 -- 172.21.15.106:0/3204087224 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf400ab80 con 0x7fadfc155df0 2024-08-17T02:31:04.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.828+0000 7fae03e00640 1 -- 172.21.15.106:0/3204087224 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadfc0add60 con 0x7fadfc155df0 2024-08-17T02:31:04.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.828+0000 7fae03e00640 1 -- 172.21.15.106:0/3204087224 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadfc0aa2a0 con 0x7fadfc155df0 2024-08-17T02:31:04.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.829+0000 7fae03e00640 1 -- 172.21.15.106:0/3204087224 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadfc0aa7d0 con 0x7fadfc155df0 2024-08-17T02:31:04.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.830+0000 7fadf8c00640 1 -- 172.21.15.106:0/3204087224 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fadf40070f0 con 0x7fadfc155df0 2024-08-17T02:31:04.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.831+0000 7fadf8c00640 1 --2- 172.21.15.106:0/3204087224 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7faddc065180 0x7faddc067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:04.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.831+0000 7fadf8c00640 1 -- 172.21.15.106:0/3204087224 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fadf40826c0 con 0x7fadfc155df0 2024-08-17T02:31:04.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.831+0000 7fae01400640 1 --2- 172.21.15.106:0/3204087224 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7faddc065180 0x7faddc067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:04.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.832+0000 7fae01400640 1 --2- 172.21.15.106:0/3204087224 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7faddc065180 0x7faddc067630 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fadf0007fd0 tx=0x7fadf0007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:04.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:04.835+0000 7fadf8c00640 1 -- 172.21.15.106:0/3204087224 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fadf40507c0 con 0x7fadfc155df0 2024-08-17T02:31:05.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.044+0000 7fae03e00640 1 -- 172.21.15.106:0/3204087224 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadfc064db0 con 0x7fadfc155df0 2024-08-17T02:31:05.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.044+0000 7fadf8c00640 1 -- 172.21.15.106:0/3204087224 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4627 (secure 0 0 0) 0x7fadf4053de0 con 0x7fadfc155df0 2024-08-17T02:31:05.046 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:31:05.046 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4900,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1137148711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1137148711},{"type":"v1","addr":"172.21.15.106:6836","nonce":1137148711}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4903,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3136131297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":3136131297},{"type":"v1","addr":"172.21.15.106:6837","nonce":3136131297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4919,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6834/2012785463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":2012785463},{"type":"v1","addr":"172.21.15.171:6834","nonce":2012785463}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:52.606548+0000","modified":"2024-08-17T02:28:54.512181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4909},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4909":{"gid":4909,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.171:6835/3251295288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6833","nonce":3251295288},{"type":"v1","addr":"172.21.15.171:6835","nonce":3251295288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000123149","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:31:05.046 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 22 2024-08-17T02:31:05.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.046+0000 7fae03e00640 1 -- 172.21.15.106:0/3204087224 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7faddc065180 msgr2=0x7faddc067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.046+0000 7fae03e00640 1 --2- 172.21.15.106:0/3204087224 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7faddc065180 0x7faddc067630 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fadf0007fd0 tx=0x7fadf0007e30 comp rx=0 tx=0).stop 2024-08-17T02:31:05.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.046+0000 7fae03e00640 1 -- 172.21.15.106:0/3204087224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadfc155df0 msgr2=0x7fadfc0ab860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.046+0000 7fae03e00640 1 --2- 172.21.15.106:0/3204087224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadfc155df0 0x7fadfc0ab860 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fadf400cb90 tx=0x7fadf4001940 comp rx=0 tx=0).stop 2024-08-17T02:31:05.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.046+0000 7fae03e00640 1 -- 172.21.15.106:0/3204087224 shutdown_connections 2024-08-17T02:31:05.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.046+0000 7fae03e00640 1 --2- 172.21.15.106:0/3204087224 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7faddc065180 0x7faddc067630 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.046+0000 7fae03e00640 1 --2- 172.21.15.106:0/3204087224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadfc155df0 0x7fadfc0ab860 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.046+0000 7fae03e00640 1 --2- 172.21.15.106:0/3204087224 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fadfc155a20 0x7fadfc15df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.046+0000 7fae03e00640 1 --2- 172.21.15.106:0/3204087224 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fadfc06df00 0x7fadfc1455d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.046+0000 7fae03e00640 1 -- 172.21.15.106:0/3204087224 >> 172.21.15.106:0/3204087224 conn(0x7fadfc0cb9b0 msgr2=0x7fadfc1542b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:05.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.046+0000 7fae03e00640 1 -- 172.21.15.106:0/3204087224 shutdown_connections 2024-08-17T02:31:05.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.047+0000 7fae03e00640 1 -- 172.21.15.106:0/3204087224 wait complete. 2024-08-17T02:31:05.063 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:31:05.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.209+0000 7f47cca00640 1 Processor -- start 2024-08-17T02:31:05.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.209+0000 7f47cca00640 1 -- start start 2024-08-17T02:31:05.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.210+0000 7f47cca00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f47c8156ad0 0x7f47c80cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.210+0000 7f47cca00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47c80caaf0 con 0x7f47c8156ea0 2024-08-17T02:31:05.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.210+0000 7f47cca00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47c8157300 con 0x7f47c806dc80 2024-08-17T02:31:05.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.210+0000 7f47cca00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47c80ca900 con 0x7f47c8156ad0 2024-08-17T02:31:05.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.210+0000 7f47bea00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f47c8156ea0 0x7f47c806d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:54690/0 (socket says 172.21.15.106:54690) 2024-08-17T02:31:05.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.210+0000 7f47bea00640 1 -- 172.21.15.106:0/1208717542 learned_addr learned my addr 172.21.15.106:0/1208717542 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:31:05.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.210+0000 7f47c7400640 1 --2- 172.21.15.106:0/1208717542 >> v2:172.21.15.171:3300/0 conn(0x7f47c8156ad0 0x7f47c80cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.211+0000 7f47c6a00640 1 -- 172.21.15.106:0/1208717542 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1216994943 0 0) 0x7f47c80caaf0 con 0x7f47c8156ea0 2024-08-17T02:31:05.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.211+0000 7f47c6a00640 1 -- 172.21.15.106:0/1208717542 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47ac0034e0 con 0x7f47c8156ea0 2024-08-17T02:31:05.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.211+0000 7f47c7400640 1 -- 172.21.15.106:0/1208717542 >> v1:172.21.15.171:6789/0 conn(0x7f47c806dc80 legacy=0x7f47c81577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.211+0000 7f47c7400640 1 -- 172.21.15.106:0/1208717542 >> v1:172.21.15.106:6789/0 conn(0x7f47c8156ea0 legacy=0x7f47c806d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.211+0000 7f47c7400640 1 -- 172.21.15.106:0/1208717542 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c80cad90 con 0x7f47c8156ad0 2024-08-17T02:31:05.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.212+0000 7f47c7400640 1 --2- 172.21.15.106:0/1208717542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47c8156ad0 0x7f47c80cbea0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f47b8009850 tx=0x7f47b80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fa47a5e102b85fe server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:05.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.212+0000 7f47c6a00640 1 -- 172.21.15.106:0/1208717542 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b802ae20 con 0x7f47c8156ad0 2024-08-17T02:31:05.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.212+0000 7f47c6a00640 1 -- 172.21.15.106:0/1208717542 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b8032440 con 0x7f47c8156ad0 2024-08-17T02:31:05.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.212+0000 7f47c6a00640 1 -- 172.21.15.106:0/1208717542 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b80327e0 con 0x7f47c8156ad0 2024-08-17T02:31:05.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.213+0000 7f47cca00640 1 -- 172.21.15.106:0/1208717542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47c8156ad0 msgr2=0x7f47c80cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.213+0000 7f47cca00640 1 --2- 172.21.15.106:0/1208717542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47c8156ad0 0x7f47c80cbea0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f47b8009850 tx=0x7f47b80090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.213+0000 7f47cca00640 1 -- 172.21.15.106:0/1208717542 shutdown_connections 2024-08-17T02:31:05.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.213+0000 7f47cca00640 1 --2- 172.21.15.106:0/1208717542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47c8156ad0 0x7f47c80cbea0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.213+0000 7f47cca00640 1 -- 172.21.15.106:0/1208717542 >> 172.21.15.106:0/1208717542 conn(0x7f47c8067750 msgr2=0x7f47c80cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:05.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.213+0000 7f47cca00640 1 -- 172.21.15.106:0/1208717542 shutdown_connections 2024-08-17T02:31:05.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.213+0000 7f47cca00640 1 -- 172.21.15.106:0/1208717542 wait complete. 2024-08-17T02:31:05.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.214+0000 7f47cca00640 1 Processor -- start 2024-08-17T02:31:05.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.214+0000 7f47cca00640 1 -- start start 2024-08-17T02:31:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.215+0000 7f47cca00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47c806dc80 0x7f47c815d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.215+0000 7f47cca00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47c8156ad0 0x7f47c81696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.215+0000 7f47cca00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47c8156ea0 0x7f47c814c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.215+0000 7f47cca00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c80c7910 con 0x7f47c8156ad0 2024-08-17T02:31:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.215+0000 7f47cca00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c8169bf0 con 0x7f47c806dc80 2024-08-17T02:31:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.215+0000 7f47cca00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47c815c0a0 con 0x7f47c8156ea0 2024-08-17T02:31:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.216+0000 7f47bea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47c8156ad0 0x7f47c81696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.216+0000 7f47bea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47c8156ad0 0x7f47c81696b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49456/0 (socket says 172.21.15.106:49456) 2024-08-17T02:31:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.216+0000 7f47bea00640 1 -- 172.21.15.106:0/3170676620 learned_addr learned my addr 172.21.15.106:0/3170676620 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.216+0000 7f47c7400640 1 --2- 172.21.15.106:0/3170676620 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47c806dc80 0x7f47c815d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.216+0000 7f47c7e00640 1 --2- 172.21.15.106:0/3170676620 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47c8156ea0 0x7f47c814c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.216+0000 7f47bea00640 1 -- 172.21.15.106:0/3170676620 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47c8156ea0 msgr2=0x7f47c814c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.216+0000 7f47bea00640 1 --2- 172.21.15.106:0/3170676620 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47c8156ea0 0x7f47c814c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.216+0000 7f47bea00640 1 -- 172.21.15.106:0/3170676620 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47c806dc80 msgr2=0x7f47c815d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.216+0000 7f47bea00640 1 --2- 172.21.15.106:0/3170676620 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47c806dc80 0x7f47c815d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.216+0000 7f47bea00640 1 -- 172.21.15.106:0/3170676620 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b8009390 con 0x7f47c8156ad0 2024-08-17T02:31:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.216+0000 7f47bea00640 1 --2- 172.21.15.106:0/3170676620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47c8156ad0 0x7f47c81696b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f47b000c590 tx=0x7f47b0007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.216+0000 7f47bf400640 1 -- 172.21.15.106:0/3170676620 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0005b70 con 0x7f47c8156ad0 2024-08-17T02:31:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.217+0000 7f47bf400640 1 -- 172.21.15.106:0/3170676620 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b0005cf0 con 0x7f47c8156ad0 2024-08-17T02:31:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.217+0000 7f47cca00640 1 -- 172.21.15.106:0/3170676620 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c815c380 con 0x7f47c8156ad0 2024-08-17T02:31:05.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.217+0000 7f47bf400640 1 -- 172.21.15.106:0/3170676620 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0007320 con 0x7f47c8156ad0 2024-08-17T02:31:05.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.217+0000 7f47cca00640 1 -- 172.21.15.106:0/3170676620 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c815c940 con 0x7f47c8156ad0 2024-08-17T02:31:05.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.218+0000 7f47cca00640 1 -- 172.21.15.106:0/3170676620 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47c8071050 con 0x7f47c8156ad0 2024-08-17T02:31:05.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.218+0000 7f47bf400640 1 -- 172.21.15.106:0/3170676620 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f47b0012400 con 0x7f47c8156ad0 2024-08-17T02:31:05.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.219+0000 7f47bf400640 1 --2- 172.21.15.106:0/3170676620 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f47a4065150 0x7f47a4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.219+0000 7f47bf400640 1 -- 172.21.15.106:0/3170676620 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f47b00819a0 con 0x7f47c8156ad0 2024-08-17T02:31:05.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.220+0000 7f47c7400640 1 --2- 172.21.15.106:0/3170676620 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f47a4065150 0x7f47a4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.220+0000 7f47c7400640 1 --2- 172.21.15.106:0/3170676620 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f47a4065150 0x7f47a4067600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f47b8034000 tx=0x7f47b8032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:05.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.223+0000 7f47bf400640 1 -- 172.21.15.106:0/3170676620 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f47b004f9f0 con 0x7f47c8156ad0 2024-08-17T02:31:05.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.398+0000 7f47cca00640 1 -- 172.21.15.106:0/3170676620 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47c806f480 con 0x7f47c8156ad0 2024-08-17T02:31:05.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.399+0000 7f47bf400640 1 -- 172.21.15.106:0/3170676620 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15560 (secure 0 0 0) 0x7f47b0017020 con 0x7f47c8156ad0 2024-08-17T02:31:05.401 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:31:05.401 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":40,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:31:03.217182+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000123149.meta","create_time":"2024-08-17T02:28:50.720877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000123149"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000123149.data","create_time":"2024-08-17T02:28:51.638596+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000123149"}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.171:6834/754665763":"2024-08-18T02:31:00.016136+0000","172.21.15.171:6832/754665763":"2024-08-18T02:31:00.016136+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:31:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.401+0000 7f47cca00640 1 -- 172.21.15.106:0/3170676620 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f47a4065150 msgr2=0x7f47a4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.401+0000 7f47cca00640 1 --2- 172.21.15.106:0/3170676620 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f47a4065150 0x7f47a4067600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f47b8034000 tx=0x7f47b8032000 comp rx=0 tx=0).stop 2024-08-17T02:31:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.401+0000 7f47cca00640 1 -- 172.21.15.106:0/3170676620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47c8156ad0 msgr2=0x7f47c81696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.402+0000 7f47cca00640 1 --2- 172.21.15.106:0/3170676620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47c8156ad0 0x7f47c81696b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f47b000c590 tx=0x7f47b0007d70 comp rx=0 tx=0).stop 2024-08-17T02:31:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.402+0000 7f47cca00640 1 -- 172.21.15.106:0/3170676620 shutdown_connections 2024-08-17T02:31:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.402+0000 7f47cca00640 1 --2- 172.21.15.106:0/3170676620 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f47c8156ea0 0x7f47c814c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.402+0000 7f47cca00640 1 --2- 172.21.15.106:0/3170676620 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f47a4065150 0x7f47a4067600 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.402+0000 7f47cca00640 1 --2- 172.21.15.106:0/3170676620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47c8156ad0 0x7f47c81696b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.402+0000 7f47cca00640 1 --2- 172.21.15.106:0/3170676620 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47c806dc80 0x7f47c815d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.402+0000 7f47cca00640 1 -- 172.21.15.106:0/3170676620 >> 172.21.15.106:0/3170676620 conn(0x7f47c8067750 msgr2=0x7f47c81541f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.402+0000 7f47cca00640 1 -- 172.21.15.106:0/3170676620 shutdown_connections 2024-08-17T02:31:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.402+0000 7f47cca00640 1 -- 172.21.15.106:0/3170676620 wait complete. 2024-08-17T02:31:05.420 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000123149 and related pools 2024-08-17T02:31:05.420 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:31:05.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.566+0000 7f20e4e00640 1 Processor -- start 2024-08-17T02:31:05.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.566+0000 7f20e4e00640 1 -- start start 2024-08-17T02:31:05.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.567+0000 7f20e4e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f20e015cb30 0x7f20e00c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.567+0000 7f20e4e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e00b18d0 con 0x7f20e0158d60 2024-08-17T02:31:05.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.567+0000 7f20e4e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e00b0d00 con 0x7f20e0159130 2024-08-17T02:31:05.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.567+0000 7f20e4e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e00b0fa0 con 0x7f20e015cb30 2024-08-17T02:31:05.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.568+0000 7f20dd400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f20e015cb30 0x7f20e00c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.568+0000 7f20dde00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f20e0158d60 0x7f20e00b1d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:54692/0 (socket says 172.21.15.106:54692) 2024-08-17T02:31:05.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.568+0000 7f20dde00640 1 -- 172.21.15.106:0/526019860 learned_addr learned my addr 172.21.15.106:0/526019860 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:31:05.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.568+0000 7f20dd400640 1 -- 172.21.15.106:0/526019860 >> v1:172.21.15.171:6789/0 conn(0x7f20e0159130 legacy=0x7f20e0096a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:05.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.568+0000 7f20dd400640 1 -- 172.21.15.106:0/526019860 >> v1:172.21.15.106:6789/0 conn(0x7f20e0158d60 legacy=0x7f20e00b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.568+0000 7f20dd400640 1 -- 172.21.15.106:0/526019860 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e00b1280 con 0x7f20e015cb30 2024-08-17T02:31:05.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.568+0000 7f20dca00640 1 -- 172.21.15.106:0/526019860 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072594493 0 0) 0x7f20e00b18d0 con 0x7f20e0158d60 2024-08-17T02:31:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.569+0000 7f20dd400640 1 --2- 172.21.15.106:0/526019860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20e015cb30 0x7f20e00c6d10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f20cc009880 tx=0x7f20cc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c966ac95c21b260 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.569+0000 7f20dca00640 1 -- 172.21.15.106:0/526019860 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc02ae20 con 0x7f20e015cb30 2024-08-17T02:31:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.569+0000 7f20dca00640 1 -- 172.21.15.106:0/526019860 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20cc032440 con 0x7f20e015cb30 2024-08-17T02:31:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.569+0000 7f20dca00640 1 -- 172.21.15.106:0/526019860 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc0327e0 con 0x7f20e015cb30 2024-08-17T02:31:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.570+0000 7f20e4e00640 1 -- 172.21.15.106:0/526019860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20e015cb30 msgr2=0x7f20e00c6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.570+0000 7f20e4e00640 1 --2- 172.21.15.106:0/526019860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20e015cb30 0x7f20e00c6d10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f20cc009880 tx=0x7f20cc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.570+0000 7f20e4e00640 1 -- 172.21.15.106:0/526019860 shutdown_connections 2024-08-17T02:31:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.570+0000 7f20e4e00640 1 --2- 172.21.15.106:0/526019860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20e015cb30 0x7f20e00c6d10 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.570+0000 7f20e4e00640 1 -- 172.21.15.106:0/526019860 >> 172.21.15.106:0/526019860 conn(0x7f20e00b3040 msgr2=0x7f20e00b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.570+0000 7f20e4e00640 1 -- 172.21.15.106:0/526019860 shutdown_connections 2024-08-17T02:31:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.570+0000 7f20e4e00640 1 -- 172.21.15.106:0/526019860 wait complete. 2024-08-17T02:31:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.571+0000 7f20e4e00640 1 Processor -- start 2024-08-17T02:31:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.572+0000 7f20e4e00640 1 -- start start 2024-08-17T02:31:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.572+0000 7f20e4e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20e0158d60 0x7f20e0152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.573+0000 7f20e4e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20e0159130 0x7f20e009a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.573+0000 7f20e4e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20e015cb30 0x7f20e00ab420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.573+0000 7f20e4e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e009a500 con 0x7f20e015cb30 2024-08-17T02:31:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.573+0000 7f20e4e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e0099ef0 con 0x7f20e0159130 2024-08-17T02:31:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.573+0000 7f20e4e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e00abe00 con 0x7f20e0158d60 2024-08-17T02:31:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.573+0000 7f20de800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20e015cb30 0x7f20e00ab420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.573+0000 7f20de800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20e015cb30 0x7f20e00ab420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49468/0 (socket says 172.21.15.106:49468) 2024-08-17T02:31:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.573+0000 7f20de800640 1 -- 172.21.15.106:0/2186695978 learned_addr learned my addr 172.21.15.106:0/2186695978 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.573+0000 7f20dde00640 1 --2- 172.21.15.106:0/2186695978 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20e0158d60 0x7f20e0152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.573+0000 7f20dd400640 1 --2- 172.21.15.106:0/2186695978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20e0159130 0x7f20e009a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.573+0000 7f20de800640 1 -- 172.21.15.106:0/2186695978 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20e0158d60 msgr2=0x7f20e0152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.573+0000 7f20de800640 1 --2- 172.21.15.106:0/2186695978 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20e0158d60 0x7f20e0152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.573+0000 7f20de800640 1 -- 172.21.15.106:0/2186695978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20e0159130 msgr2=0x7f20e009a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.573+0000 7f20de800640 1 --2- 172.21.15.106:0/2186695978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20e0159130 0x7f20e009a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.573+0000 7f20de800640 1 -- 172.21.15.106:0/2186695978 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20cc009390 con 0x7f20e015cb30 2024-08-17T02:31:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.574+0000 7f20de800640 1 --2- 172.21.15.106:0/2186695978 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20e015cb30 0x7f20e00ab420 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f20d800c860 tx=0x7f20d8001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.574+0000 7f20d5600640 1 -- 172.21.15.106:0/2186695978 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d800ce50 con 0x7f20e015cb30 2024-08-17T02:31:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.574+0000 7f20d5600640 1 -- 172.21.15.106:0/2186695978 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d800a850 con 0x7f20e015cb30 2024-08-17T02:31:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.574+0000 7f20d5600640 1 -- 172.21.15.106:0/2186695978 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d800ac10 con 0x7f20e015cb30 2024-08-17T02:31:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.574+0000 7f20e4e00640 1 -- 172.21.15.106:0/2186695978 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e00ac0e0 con 0x7f20e015cb30 2024-08-17T02:31:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.574+0000 7f20e4e00640 1 -- 172.21.15.106:0/2186695978 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e009aed0 con 0x7f20e015cb30 2024-08-17T02:31:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.575+0000 7f20e4e00640 1 -- 172.21.15.106:0/2186695978 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e009a670 con 0x7f20e015cb30 2024-08-17T02:31:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.576+0000 7f20d5600640 1 -- 172.21.15.106:0/2186695978 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f20d8012630 con 0x7f20e015cb30 2024-08-17T02:31:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.577+0000 7f20d5600640 1 --2- 172.21.15.106:0/2186695978 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f20c0065150 0x7f20c0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.577+0000 7f20d5600640 1 -- 172.21.15.106:0/2186695978 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f20d8082660 con 0x7f20e015cb30 2024-08-17T02:31:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.577+0000 7f20dde00640 1 --2- 172.21.15.106:0/2186695978 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f20c0065150 0x7f20c0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.578+0000 7f20dde00640 1 --2- 172.21.15.106:0/2186695978 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f20c0065150 0x7f20c0067600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f20d00011e0 tx=0x7f20d0007c80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:05.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.581+0000 7f20d5600640 1 -- 172.21.15.106:0/2186695978 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f20d80506b0 con 0x7f20e015cb30 2024-08-17T02:31:05.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.787+0000 7f20e4e00640 1 -- 172.21.15.106:0/2186695978 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20e0064db0 con 0x7f20e015cb30 2024-08-17T02:31:05.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.788+0000 7f20d5600640 1 -- 172.21.15.106:0/2186695978 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4627 (secure 0 0 0) 0x7f20d8053cd0 con 0x7f20e015cb30 2024-08-17T02:31:05.789 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:31:05.789 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4900,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1137148711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1137148711},{"type":"v1","addr":"172.21.15.106:6836","nonce":1137148711}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4903,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3136131297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":3136131297},{"type":"v1","addr":"172.21.15.106:6837","nonce":3136131297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4919,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6834/2012785463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":2012785463},{"type":"v1","addr":"172.21.15.171:6834","nonce":2012785463}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:52.606548+0000","modified":"2024-08-17T02:28:54.512181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4909},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4909":{"gid":4909,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.171:6835/3251295288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6833","nonce":3251295288},{"type":"v1","addr":"172.21.15.171:6835","nonce":3251295288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000123149","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:31:05.790 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 22 2024-08-17T02:31:05.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.790+0000 7f20e4e00640 1 -- 172.21.15.106:0/2186695978 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f20c0065150 msgr2=0x7f20c0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.790+0000 7f20e4e00640 1 --2- 172.21.15.106:0/2186695978 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f20c0065150 0x7f20c0067600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f20d00011e0 tx=0x7f20d0007c80 comp rx=0 tx=0).stop 2024-08-17T02:31:05.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.790+0000 7f20e4e00640 1 -- 172.21.15.106:0/2186695978 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20e015cb30 msgr2=0x7f20e00ab420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.790+0000 7f20e4e00640 1 --2- 172.21.15.106:0/2186695978 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20e015cb30 0x7f20e00ab420 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f20d800c860 tx=0x7f20d8001690 comp rx=0 tx=0).stop 2024-08-17T02:31:05.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.790+0000 7f20e4e00640 1 -- 172.21.15.106:0/2186695978 shutdown_connections 2024-08-17T02:31:05.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.790+0000 7f20e4e00640 1 --2- 172.21.15.106:0/2186695978 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f20c0065150 0x7f20c0067600 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.790+0000 7f20e4e00640 1 --2- 172.21.15.106:0/2186695978 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20e015cb30 0x7f20e00ab420 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.790+0000 7f20e4e00640 1 --2- 172.21.15.106:0/2186695978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f20e0159130 0x7f20e009a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.790+0000 7f20e4e00640 1 --2- 172.21.15.106:0/2186695978 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f20e0158d60 0x7f20e0152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.790+0000 7f20e4e00640 1 -- 172.21.15.106:0/2186695978 >> 172.21.15.106:0/2186695978 conn(0x7f20e00b3040 msgr2=0x7f20e015a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:05.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.790+0000 7f20e4e00640 1 -- 172.21.15.106:0/2186695978 shutdown_connections 2024-08-17T02:31:05.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.790+0000 7f20e4e00640 1 -- 172.21.15.106:0/2186695978 wait complete. 2024-08-17T02:31:05.806 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:31:05.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.953+0000 7f4509800640 1 Processor -- start 2024-08-17T02:31:05.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.954+0000 7f4509800640 1 -- start start 2024-08-17T02:31:05.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.955+0000 7f4509800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f45040b0270 0x7f45041563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.955+0000 7f4509800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4504158b30 0x7f45040ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.955+0000 7f4509800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4504157690 con 0x7f4504155900 2024-08-17T02:31:05.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.955+0000 7f4509800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4504156a80 con 0x7f45040b0270 2024-08-17T02:31:05.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.955+0000 7f4509800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4504156d60 con 0x7f4504158b30 2024-08-17T02:31:05.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.955+0000 7f4503400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f45040b0270 0x7f45041563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.955+0000 7f4503e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f4504155900 0x7f4504155cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:54700/0 (socket says 172.21.15.106:54700) 2024-08-17T02:31:05.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.955+0000 7f4503e00640 1 -- 172.21.15.106:0/148717780 learned_addr learned my addr 172.21.15.106:0/148717780 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:31:05.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.955+0000 7f4508e00640 1 --2- 172.21.15.106:0/148717780 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4504158b30 0x7f45040ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.956+0000 7f4502a00640 1 -- 172.21.15.106:0/148717780 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1580849711 0 0) 0x7f4504157690 con 0x7f4504155900 2024-08-17T02:31:05.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.956+0000 7f4502a00640 1 -- 172.21.15.106:0/148717780 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44e80034e0 con 0x7f4504155900 2024-08-17T02:31:05.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.956+0000 7f4503400640 1 -- 172.21.15.106:0/148717780 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4504158b30 msgr2=0x7f45040ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:05.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.956+0000 7f4503400640 1 --2- 172.21.15.106:0/148717780 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4504158b30 0x7f45040ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.956+0000 7f4503400640 1 -- 172.21.15.106:0/148717780 >> v1:172.21.15.106:6789/0 conn(0x7f4504155900 legacy=0x7f4504155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.956+0000 7f4503400640 1 -- 172.21.15.106:0/148717780 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4504157040 con 0x7f45040b0270 2024-08-17T02:31:05.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.957+0000 7f4503400640 1 --2- 172.21.15.106:0/148717780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45040b0270 0x7f45041563e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f44f0009850 tx=0x7f44f00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a580b66b349032e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:05.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.957+0000 7f4502a00640 1 -- 172.21.15.106:0/148717780 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f002ad00 con 0x7f45040b0270 2024-08-17T02:31:05.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.957+0000 7f4502a00640 1 -- 172.21.15.106:0/148717780 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f002ae60 con 0x7f45040b0270 2024-08-17T02:31:05.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.957+0000 7f4502a00640 1 -- 172.21.15.106:0/148717780 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f0032670 con 0x7f45040b0270 2024-08-17T02:31:05.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.957+0000 7f4509800640 1 -- 172.21.15.106:0/148717780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45040b0270 msgr2=0x7f45041563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.957+0000 7f4509800640 1 --2- 172.21.15.106:0/148717780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45040b0270 0x7f45041563e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f44f0009850 tx=0x7f44f00090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.958+0000 7f4509800640 1 -- 172.21.15.106:0/148717780 shutdown_connections 2024-08-17T02:31:05.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.958+0000 7f4509800640 1 --2- 172.21.15.106:0/148717780 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4504158b30 0x7f45040ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.958+0000 7f4509800640 1 --2- 172.21.15.106:0/148717780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45040b0270 0x7f45041563e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.958+0000 7f4509800640 1 -- 172.21.15.106:0/148717780 >> 172.21.15.106:0/148717780 conn(0x7f4504067750 msgr2=0x7f45040cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:05.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.958+0000 7f4509800640 1 -- 172.21.15.106:0/148717780 shutdown_connections 2024-08-17T02:31:05.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.958+0000 7f4509800640 1 -- 172.21.15.106:0/148717780 wait complete. 2024-08-17T02:31:05.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.959+0000 7f4509800640 1 Processor -- start 2024-08-17T02:31:05.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.959+0000 7f4509800640 1 -- start start 2024-08-17T02:31:05.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.960+0000 7f4509800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f45040b0270 0x7f4504145100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.960+0000 7f4509800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4504155900 0x7f45040c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.960+0000 7f4509800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4504158b30 0x7f45040c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.960+0000 7f4509800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4504169200 con 0x7f4504158b30 2024-08-17T02:31:05.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.960+0000 7f4509800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4504168350 con 0x7f4504155900 2024-08-17T02:31:05.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.960+0000 7f4509800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45041685f0 con 0x7f45040b0270 2024-08-17T02:31:05.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.960+0000 7f4508e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4504158b30 0x7f45040c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.960+0000 7f4508e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4504158b30 0x7f45040c9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49482/0 (socket says 172.21.15.106:49482) 2024-08-17T02:31:05.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.960+0000 7f4508e00640 1 -- 172.21.15.106:0/742877790 learned_addr learned my addr 172.21.15.106:0/742877790 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:05.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.960+0000 7f4508e00640 1 -- 172.21.15.106:0/742877790 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f45040b0270 msgr2=0x7f4504145100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.960+0000 7f4508e00640 1 --2- 172.21.15.106:0/742877790 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f45040b0270 0x7f4504145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.960+0000 7f4508e00640 1 -- 172.21.15.106:0/742877790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4504155900 msgr2=0x7f45040c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:05.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.960+0000 7f4508e00640 1 --2- 172.21.15.106:0/742877790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4504155900 0x7f45040c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:05.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.960+0000 7f4508e00640 1 -- 172.21.15.106:0/742877790 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f0009390 con 0x7f4504158b30 2024-08-17T02:31:05.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.961+0000 7f4508e00640 1 --2- 172.21.15.106:0/742877790 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4504158b30 0x7f45040c9e50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f44fc009df0 tx=0x7f44fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:05.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.961+0000 7f44fb400640 1 -- 172.21.15.106:0/742877790 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44fc00cd40 con 0x7f4504158b30 2024-08-17T02:31:05.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.961+0000 7f44fb400640 1 -- 172.21.15.106:0/742877790 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44fc00f040 con 0x7f4504158b30 2024-08-17T02:31:05.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.961+0000 7f4509800640 1 -- 172.21.15.106:0/742877790 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45041688d0 con 0x7f4504158b30 2024-08-17T02:31:05.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.961+0000 7f44fb400640 1 -- 172.21.15.106:0/742877790 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44fc0146d0 con 0x7f4504158b30 2024-08-17T02:31:05.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.961+0000 7f4509800640 1 -- 172.21.15.106:0/742877790 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4504168e90 con 0x7f4504158b30 2024-08-17T02:31:05.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.962+0000 7f4509800640 1 -- 172.21.15.106:0/742877790 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4504071050 con 0x7f4504158b30 2024-08-17T02:31:05.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.963+0000 7f44fb400640 1 -- 172.21.15.106:0/742877790 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f44fc014a80 con 0x7f4504158b30 2024-08-17T02:31:05.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.964+0000 7f44fb400640 1 --2- 172.21.15.106:0/742877790 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f44e4065150 0x7f44e4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:05.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.964+0000 7f44fb400640 1 -- 172.21.15.106:0/742877790 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f44fc082f50 con 0x7f4504158b30 2024-08-17T02:31:05.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.964+0000 7f4503e00640 1 --2- 172.21.15.106:0/742877790 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f44e4065150 0x7f44e4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:05.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.965+0000 7f4503e00640 1 --2- 172.21.15.106:0/742877790 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f44e4065150 0x7f44e4067600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f44f4001640 tx=0x7f44f4007940 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:05.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:05.968+0000 7f44fb400640 1 -- 172.21.15.106:0/742877790 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f44fc054a00 con 0x7f4504158b30 2024-08-17T02:31:06.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.174+0000 7f4509800640 1 -- 172.21.15.106:0/742877790 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45040a54d0 con 0x7f4504158b30 2024-08-17T02:31:06.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.175+0000 7f44fb400640 1 -- 172.21.15.106:0/742877790 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4627 (secure 0 0 0) 0x7f44fc018090 con 0x7f4504158b30 2024-08-17T02:31:06.176 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:31:06.176 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4900,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1137148711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1137148711},{"type":"v1","addr":"172.21.15.106:6836","nonce":1137148711}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4903,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3136131297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":3136131297},{"type":"v1","addr":"172.21.15.106:6837","nonce":3136131297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4919,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6834/2012785463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":2012785463},{"type":"v1","addr":"172.21.15.171:6834","nonce":2012785463}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:28:52.606548+0000","modified":"2024-08-17T02:28:54.512181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4909},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4909":{"gid":4909,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.171:6835/3251295288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6833","nonce":3251295288},{"type":"v1","addr":"172.21.15.171:6835","nonce":3251295288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000123149","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:31:06.177 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 22 2024-08-17T02:31:06.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.177+0000 7f4509800640 1 -- 172.21.15.106:0/742877790 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f44e4065150 msgr2=0x7f44e4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.177+0000 7f4509800640 1 --2- 172.21.15.106:0/742877790 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f44e4065150 0x7f44e4067600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f44f4001640 tx=0x7f44f4007940 comp rx=0 tx=0).stop 2024-08-17T02:31:06.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.177+0000 7f4509800640 1 -- 172.21.15.106:0/742877790 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4504158b30 msgr2=0x7f45040c9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.177+0000 7f4509800640 1 --2- 172.21.15.106:0/742877790 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4504158b30 0x7f45040c9e50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f44fc009df0 tx=0x7f44fc00b040 comp rx=0 tx=0).stop 2024-08-17T02:31:06.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.177+0000 7f4509800640 1 -- 172.21.15.106:0/742877790 shutdown_connections 2024-08-17T02:31:06.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.177+0000 7f4509800640 1 --2- 172.21.15.106:0/742877790 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f44e4065150 0x7f44e4067600 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.177+0000 7f4509800640 1 --2- 172.21.15.106:0/742877790 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4504158b30 0x7f45040c9e50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.177+0000 7f4509800640 1 --2- 172.21.15.106:0/742877790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4504155900 0x7f45040c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.177+0000 7f4509800640 1 --2- 172.21.15.106:0/742877790 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f45040b0270 0x7f4504145100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.177+0000 7f4509800640 1 -- 172.21.15.106:0/742877790 >> 172.21.15.106:0/742877790 conn(0x7f4504067750 msgr2=0x7f4504068780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:06.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.177+0000 7f4509800640 1 -- 172.21.15.106:0/742877790 shutdown_connections 2024-08-17T02:31:06.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.177+0000 7f4509800640 1 -- 172.21.15.106:0/742877790 wait complete. 2024-08-17T02:31:06.194 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:31:06.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.339+0000 7f95c7200640 1 Processor -- start 2024-08-17T02:31:06.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.340+0000 7f95c7200640 1 -- start start 2024-08-17T02:31:06.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.341+0000 7f95c7200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f95c80cc010 0x7f95c80ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.341+0000 7f95c7200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f95c80a98e0 0x7f95c80afe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.341+0000 7f95c7200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c80ab950 con 0x7f95c80b03d0 2024-08-17T02:31:06.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.341+0000 7f95c7200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95c80abc30 con 0x7f95c80a98e0 2024-08-17T02:31:06.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.341+0000 7f95c7200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95c80abf10 con 0x7f95c80cc010 2024-08-17T02:31:06.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.341+0000 7f95bd400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f95c80a98e0 0x7f95c80afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.341+0000 7f95bd400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f95c80a98e0 0x7f95c80afe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49490/0 (socket says 172.21.15.106:49490) 2024-08-17T02:31:06.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.341+0000 7f95bd400640 1 -- 172.21.15.106:0/1892028087 learned_addr learned my addr 172.21.15.106:0/1892028087 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:06.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.341+0000 7f95c5e00640 1 --2- 172.21.15.106:0/1892028087 >> v2:172.21.15.171:3300/0 conn(0x7f95c80cc010 0x7f95c80ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.342+0000 7f95bd400640 1 -- 172.21.15.106:0/1892028087 >> v2:172.21.15.171:3300/0 conn(0x7f95c80cc010 msgr2=0x7f95c80ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:06.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.342+0000 7f95bd400640 1 --2- 172.21.15.106:0/1892028087 >> v2:172.21.15.171:3300/0 conn(0x7f95c80cc010 0x7f95c80ab2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.342+0000 7f95bd400640 1 -- 172.21.15.106:0/1892028087 >> v1:172.21.15.171:6789/0 conn(0x7f95c80b03d0 legacy=0x7f95c815c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.342+0000 7f95bd400640 1 -- 172.21.15.106:0/1892028087 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c80af970 con 0x7f95c80a98e0 2024-08-17T02:31:06.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.342+0000 7f95bd400640 1 --2- 172.21.15.106:0/1892028087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95c80a98e0 0x7f95c80afe90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f95c8064c30 tx=0x7f95b00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb8d9b09ad5e4d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:06.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.343+0000 7f95c5400640 1 -- 172.21.15.106:0/1892028087 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b002add0 con 0x7f95c80a98e0 2024-08-17T02:31:06.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.343+0000 7f95c5400640 1 -- 172.21.15.106:0/1892028087 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b0032440 con 0x7f95c80a98e0 2024-08-17T02:31:06.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.343+0000 7f95c5400640 1 -- 172.21.15.106:0/1892028087 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b0032820 con 0x7f95c80a98e0 2024-08-17T02:31:06.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.343+0000 7f95c7200640 1 -- 172.21.15.106:0/1892028087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95c80a98e0 msgr2=0x7f95c80afe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.343+0000 7f95c7200640 1 --2- 172.21.15.106:0/1892028087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95c80a98e0 0x7f95c80afe90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f95c8064c30 tx=0x7f95b00091d0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.343+0000 7f95c7200640 1 -- 172.21.15.106:0/1892028087 shutdown_connections 2024-08-17T02:31:06.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.343+0000 7f95c7200640 1 --2- 172.21.15.106:0/1892028087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95c80a98e0 0x7f95c80afe90 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.343+0000 7f95c7200640 1 --2- 172.21.15.106:0/1892028087 >> v2:172.21.15.171:3300/0 conn(0x7f95c80cc010 0x7f95c80ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.343+0000 7f95c7200640 1 -- 172.21.15.106:0/1892028087 >> 172.21.15.106:0/1892028087 conn(0x7f95c8067de0 msgr2=0x7f95c80681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:06.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.343+0000 7f95c7200640 1 -- 172.21.15.106:0/1892028087 shutdown_connections 2024-08-17T02:31:06.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.344+0000 7f95c7200640 1 -- 172.21.15.106:0/1892028087 wait complete. 2024-08-17T02:31:06.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.345+0000 7f95c7200640 1 Processor -- start 2024-08-17T02:31:06.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.345+0000 7f95c7200640 1 -- start start 2024-08-17T02:31:06.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.346+0000 7f95c7200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95c80a98e0 0x7f95c816d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.346+0000 7f95c7200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95c80b03d0 0x7f95c815d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.346+0000 7f95c7200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f95c80cc010 0x7f95c815eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.346+0000 7f95c7200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c816dc70 con 0x7f95c80a98e0 2024-08-17T02:31:06.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.346+0000 7f95c7200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c815ce30 con 0x7f95c80b03d0 2024-08-17T02:31:06.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.346+0000 7f95c7200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c815c220 con 0x7f95c80cc010 2024-08-17T02:31:06.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.346+0000 7f95c5e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95c80a98e0 0x7f95c816d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.346+0000 7f95c5e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95c80a98e0 0x7f95c816d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49498/0 (socket says 172.21.15.106:49498) 2024-08-17T02:31:06.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.346+0000 7f95c5e00640 1 -- 172.21.15.106:0/3047106750 learned_addr learned my addr 172.21.15.106:0/3047106750 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:06.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.346+0000 7f95bd400640 1 --2- 172.21.15.106:0/3047106750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95c80b03d0 0x7f95c815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.346+0000 7f95c6800640 1 --2- 172.21.15.106:0/3047106750 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f95c80cc010 0x7f95c815eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.347+0000 7f95c5e00640 1 -- 172.21.15.106:0/3047106750 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f95c80cc010 msgr2=0x7f95c815eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.347+0000 7f95c5e00640 1 --2- 172.21.15.106:0/3047106750 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f95c80cc010 0x7f95c815eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.347+0000 7f95c5e00640 1 -- 172.21.15.106:0/3047106750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95c80b03d0 msgr2=0x7f95c815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.347+0000 7f95c5e00640 1 --2- 172.21.15.106:0/3047106750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95c80b03d0 0x7f95c815d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.347+0000 7f95c5e00640 1 -- 172.21.15.106:0/3047106750 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b0009450 con 0x7f95c80a98e0 2024-08-17T02:31:06.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.347+0000 7f95c5e00640 1 --2- 172.21.15.106:0/3047106750 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95c80a98e0 0x7f95c816d730 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f95b800e900 tx=0x7f95b80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:06.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.347+0000 7f95be000640 1 -- 172.21.15.106:0/3047106750 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b800c8e0 con 0x7f95c80a98e0 2024-08-17T02:31:06.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.347+0000 7f95be000640 1 -- 172.21.15.106:0/3047106750 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b800ca40 con 0x7f95c80a98e0 2024-08-17T02:31:06.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.347+0000 7f95be000640 1 -- 172.21.15.106:0/3047106750 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b800cde0 con 0x7f95c80a98e0 2024-08-17T02:31:06.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.347+0000 7f95c7200640 1 -- 172.21.15.106:0/3047106750 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c815c500 con 0x7f95c80a98e0 2024-08-17T02:31:06.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.347+0000 7f95c7200640 1 -- 172.21.15.106:0/3047106750 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c815cac0 con 0x7f95c80a98e0 2024-08-17T02:31:06.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.348+0000 7f95c7200640 1 -- 172.21.15.106:0/3047106750 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c8071050 con 0x7f95c80a98e0 2024-08-17T02:31:06.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.349+0000 7f95be000640 1 -- 172.21.15.106:0/3047106750 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f95b8013680 con 0x7f95c80a98e0 2024-08-17T02:31:06.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.350+0000 7f95be000640 1 --2- 172.21.15.106:0/3047106750 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f95a4065150 0x7f95a4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.350+0000 7f95be000640 1 -- 172.21.15.106:0/3047106750 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f95b8082660 con 0x7f95c80a98e0 2024-08-17T02:31:06.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.350+0000 7f95bd400640 1 --2- 172.21.15.106:0/3047106750 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f95a4065150 0x7f95a4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.351+0000 7f95bd400640 1 --2- 172.21.15.106:0/3047106750 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f95a4065150 0x7f95a4067600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f95b0034000 tx=0x7f95b0032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:06.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.354+0000 7f95be000640 1 -- 172.21.15.106:0/3047106750 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f95b8050770 con 0x7f95c80a98e0 2024-08-17T02:31:06.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.527+0000 7f95c7200640 1 -- 172.21.15.106:0/3047106750 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95c80b1170 con 0x7f95c80a98e0 2024-08-17T02:31:06.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.527+0000 7f95be000640 1 -- 172.21.15.106:0/3047106750 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15560 (secure 0 0 0) 0x7f95b8053d90 con 0x7f95c80a98e0 2024-08-17T02:31:06.529 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:31:06.529 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":40,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:31:03.217182+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000123149.meta","create_time":"2024-08-17T02:28:50.720877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000123149"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000123149.data","create_time":"2024-08-17T02:28:51.638596+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000123149"}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.171:6834/754665763":"2024-08-18T02:31:00.016136+0000","172.21.15.171:6832/754665763":"2024-08-18T02:31:00.016136+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:31:06.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.530+0000 7f95c7200640 1 -- 172.21.15.106:0/3047106750 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f95a4065150 msgr2=0x7f95a4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.530+0000 7f95c7200640 1 --2- 172.21.15.106:0/3047106750 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f95a4065150 0x7f95a4067600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f95b0034000 tx=0x7f95b0032000 comp rx=0 tx=0).stop 2024-08-17T02:31:06.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.530+0000 7f95c7200640 1 -- 172.21.15.106:0/3047106750 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95c80a98e0 msgr2=0x7f95c816d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.530+0000 7f95c7200640 1 --2- 172.21.15.106:0/3047106750 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95c80a98e0 0x7f95c816d730 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f95b800e900 tx=0x7f95b80090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.530+0000 7f95c7200640 1 -- 172.21.15.106:0/3047106750 shutdown_connections 2024-08-17T02:31:06.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.530+0000 7f95c7200640 1 --2- 172.21.15.106:0/3047106750 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f95c80cc010 0x7f95c815eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.530+0000 7f95c7200640 1 --2- 172.21.15.106:0/3047106750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95c80b03d0 0x7f95c815d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.530+0000 7f95c7200640 1 --2- 172.21.15.106:0/3047106750 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f95a4065150 0x7f95a4067600 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.530+0000 7f95c7200640 1 --2- 172.21.15.106:0/3047106750 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95c80a98e0 0x7f95c816d730 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.530+0000 7f95c7200640 1 -- 172.21.15.106:0/3047106750 >> 172.21.15.106:0/3047106750 conn(0x7f95c8067de0 msgr2=0x7f95c806a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:06.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.530+0000 7f95c7200640 1 -- 172.21.15.106:0/3047106750 shutdown_connections 2024-08-17T02:31:06.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.530+0000 7f95c7200640 1 -- 172.21.15.106:0/3047106750 wait complete. 2024-08-17T02:31:06.547 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000123149 2024-08-17T02:31:06.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.693+0000 7f691f200640 1 Processor -- start 2024-08-17T02:31:06.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.694+0000 7f691f200640 1 -- start start 2024-08-17T02:31:06.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.695+0000 7f691f200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f69200b0270 0x7f69201563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.695+0000 7f691f200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6920158b30 0x7f69200ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.695+0000 7f691f200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6920157690 con 0x7f6920155900 2024-08-17T02:31:06.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.695+0000 7f691f200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6920156a80 con 0x7f6920158b30 2024-08-17T02:31:06.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.695+0000 7f691f200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6920156d60 con 0x7f69200b0270 2024-08-17T02:31:06.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.695+0000 7f691de00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6920155900 0x7f6920155cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:54704/0 (socket says 172.21.15.106:54704) 2024-08-17T02:31:06.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.695+0000 7f691de00640 1 -- 172.21.15.106:0/1070578913 learned_addr learned my addr 172.21.15.106:0/1070578913 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:31:06.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.695+0000 7f691e800640 1 --2- 172.21.15.106:0/1070578913 >> v2:172.21.15.106:3300/0 conn(0x7f6920158b30 0x7f69200ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.695+0000 7f6915400640 1 --2- 172.21.15.106:0/1070578913 >> v2:172.21.15.171:3300/0 conn(0x7f69200b0270 0x7f69201563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.695+0000 7f691d400640 1 -- 172.21.15.106:0/1070578913 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447101118 0 0) 0x7f6920157690 con 0x7f6920155900 2024-08-17T02:31:06.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.696+0000 7f691d400640 1 -- 172.21.15.106:0/1070578913 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69040034e0 con 0x7f6920155900 2024-08-17T02:31:06.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.696+0000 7f691e800640 1 -- 172.21.15.106:0/1070578913 >> v2:172.21.15.171:3300/0 conn(0x7f69200b0270 msgr2=0x7f69201563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:06.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.696+0000 7f691e800640 1 --2- 172.21.15.106:0/1070578913 >> v2:172.21.15.171:3300/0 conn(0x7f69200b0270 0x7f69201563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.696+0000 7f691e800640 1 -- 172.21.15.106:0/1070578913 >> v1:172.21.15.106:6789/0 conn(0x7f6920155900 legacy=0x7f6920155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.696+0000 7f691e800640 1 -- 172.21.15.106:0/1070578913 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6920157040 con 0x7f6920158b30 2024-08-17T02:31:06.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.697+0000 7f691e800640 1 --2- 172.21.15.106:0/1070578913 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6920158b30 0x7f69200ae6b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f692006f430 tx=0x7f691800b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326ee0e151211cb7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:06.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.697+0000 7f691d400640 1 -- 172.21.15.106:0/1070578913 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691800b0d0 con 0x7f6920158b30 2024-08-17T02:31:06.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.697+0000 7f691d400640 1 -- 172.21.15.106:0/1070578913 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691800b230 con 0x7f6920158b30 2024-08-17T02:31:06.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.697+0000 7f691d400640 1 -- 172.21.15.106:0/1070578913 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6918009780 con 0x7f6920158b30 2024-08-17T02:31:06.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.697+0000 7f691f200640 1 -- 172.21.15.106:0/1070578913 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6920158b30 msgr2=0x7f69200ae6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.697+0000 7f691f200640 1 --2- 172.21.15.106:0/1070578913 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6920158b30 0x7f69200ae6b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f692006f430 tx=0x7f691800b990 comp rx=0 tx=0).stop 2024-08-17T02:31:06.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.697+0000 7f691f200640 1 -- 172.21.15.106:0/1070578913 shutdown_connections 2024-08-17T02:31:06.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.697+0000 7f691f200640 1 --2- 172.21.15.106:0/1070578913 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6920158b30 0x7f69200ae6b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.697+0000 7f691f200640 1 --2- 172.21.15.106:0/1070578913 >> v2:172.21.15.171:3300/0 conn(0x7f69200b0270 0x7f69201563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.697+0000 7f691f200640 1 -- 172.21.15.106:0/1070578913 >> 172.21.15.106:0/1070578913 conn(0x7f6920067750 msgr2=0x7f69200cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:06.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.698+0000 7f691f200640 1 -- 172.21.15.106:0/1070578913 shutdown_connections 2024-08-17T02:31:06.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.698+0000 7f691f200640 1 -- 172.21.15.106:0/1070578913 wait complete. 2024-08-17T02:31:06.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.699+0000 7f691f200640 1 Processor -- start 2024-08-17T02:31:06.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.699+0000 7f691f200640 1 -- start start 2024-08-17T02:31:06.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.700+0000 7f691f200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69200b0270 0x7f6920147230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.700+0000 7f691f200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6920155900 0x7f6920164590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.700+0000 7f691f200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6920158b30 0x7f692006dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.700+0000 7f691f200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6920165a90 con 0x7f6920158b30 2024-08-17T02:31:06.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.700+0000 7f691f200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6920164e80 con 0x7f69200b0270 2024-08-17T02:31:06.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.700+0000 7f691f200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6920165160 con 0x7f6920155900 2024-08-17T02:31:06.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.700+0000 7f691e800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6920158b30 0x7f692006dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.700+0000 7f691e800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6920158b30 0x7f692006dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49516/0 (socket says 172.21.15.106:49516) 2024-08-17T02:31:06.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.700+0000 7f691e800640 1 -- 172.21.15.106:0/2535995448 learned_addr learned my addr 172.21.15.106:0/2535995448 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:06.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.700+0000 7f691de00640 1 --2- 172.21.15.106:0/2535995448 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69200b0270 0x7f6920147230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.700+0000 7f6915400640 1 --2- 172.21.15.106:0/2535995448 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6920155900 0x7f6920164590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.700+0000 7f691e800640 1 -- 172.21.15.106:0/2535995448 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6920155900 msgr2=0x7f6920164590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.700+0000 7f691e800640 1 --2- 172.21.15.106:0/2535995448 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6920155900 0x7f6920164590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.701+0000 7f691e800640 1 -- 172.21.15.106:0/2535995448 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69200b0270 msgr2=0x7f6920147230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.701+0000 7f691e800640 1 --2- 172.21.15.106:0/2535995448 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69200b0270 0x7f6920147230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.701+0000 7f691e800640 1 -- 172.21.15.106:0/2535995448 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691800bc30 con 0x7f6920158b30 2024-08-17T02:31:06.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.701+0000 7f6915400640 1 --2- 172.21.15.106:0/2535995448 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6920155900 0x7f6920164590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:31:06.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.701+0000 7f691de00640 1 --2- 172.21.15.106:0/2535995448 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69200b0270 0x7f6920147230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:31:06.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.701+0000 7f691e800640 1 --2- 172.21.15.106:0/2535995448 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6920158b30 0x7f692006dac0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f691800d100 tx=0x7f6918039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:06.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.701+0000 7f6916000640 1 -- 172.21.15.106:0/2535995448 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691800b0d0 con 0x7f6920158b30 2024-08-17T02:31:06.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.701+0000 7f6916000640 1 -- 172.21.15.106:0/2535995448 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6918041070 con 0x7f6920158b30 2024-08-17T02:31:06.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.701+0000 7f6916000640 1 -- 172.21.15.106:0/2535995448 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6918032b20 con 0x7f6920158b30 2024-08-17T02:31:06.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.701+0000 7f691f200640 1 -- 172.21.15.106:0/2535995448 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6920165440 con 0x7f6920158b30 2024-08-17T02:31:06.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.701+0000 7f691f200640 1 -- 172.21.15.106:0/2535995448 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6920147770 con 0x7f6920158b30 2024-08-17T02:31:06.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.702+0000 7f691f200640 1 -- 172.21.15.106:0/2535995448 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6920165c40 con 0x7f6920158b30 2024-08-17T02:31:06.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.703+0000 7f6916000640 1 -- 172.21.15.106:0/2535995448 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6918043030 con 0x7f6920158b30 2024-08-17T02:31:06.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.704+0000 7f6916000640 1 --2- 172.21.15.106:0/2535995448 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f68fc065150 0x7f68fc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:06.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.704+0000 7f6916000640 1 -- 172.21.15.106:0/2535995448 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f69180a5920 con 0x7f6920158b30 2024-08-17T02:31:06.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.704+0000 7f691de00640 1 --2- 172.21.15.106:0/2535995448 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f68fc065150 0x7f68fc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:06.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.705+0000 7f691de00640 1 --2- 172.21.15.106:0/2535995448 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f68fc065150 0x7f68fc067600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6910005840 tx=0x7f6910009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:06.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.708+0000 7f6916000640 1 -- 172.21.15.106:0/2535995448 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6920165c40 con 0x7f6920158b30 2024-08-17T02:31:06.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.915+0000 7f691f200640 1 -- 172.21.15.106:0/2535995448 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000123149"} v 0) v1 -- 0x7f6920071050 con 0x7f6920158b30 2024-08-17T02:31:06.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-08-17T02:31:06.915+0000 7f141ae00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:31:06.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.920+0000 7f6916000640 1 -- 172.21.15.106:0/2535995448 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000123149"}]=0 volume_0000000000123149 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 195+0+0 (secure 0 0 0) 0x7f69180738c0 con 0x7f6920158b30 2024-08-17T02:31:06.922 INFO:teuthology.orchestra.run.smithi106.stderr:volume_0000000000123149 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:31:06.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.922+0000 7f691f200640 1 -- 172.21.15.106:0/2535995448 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f68fc065150 msgr2=0x7f68fc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.922+0000 7f691f200640 1 --2- 172.21.15.106:0/2535995448 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f68fc065150 0x7f68fc067600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6910005840 tx=0x7f6910009040 comp rx=0 tx=0).stop 2024-08-17T02:31:06.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.922+0000 7f691f200640 1 -- 172.21.15.106:0/2535995448 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6920158b30 msgr2=0x7f692006dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:06.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.922+0000 7f691f200640 1 --2- 172.21.15.106:0/2535995448 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6920158b30 0x7f692006dac0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f691800d100 tx=0x7f6918039000 comp rx=0 tx=0).stop 2024-08-17T02:31:06.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.922+0000 7f691f200640 1 -- 172.21.15.106:0/2535995448 shutdown_connections 2024-08-17T02:31:06.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.922+0000 7f691f200640 1 --2- 172.21.15.106:0/2535995448 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f68fc065150 0x7f68fc067600 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.922+0000 7f691f200640 1 --2- 172.21.15.106:0/2535995448 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6920158b30 0x7f692006dac0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.922+0000 7f691f200640 1 --2- 172.21.15.106:0/2535995448 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6920155900 0x7f6920164590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.922+0000 7f691f200640 1 --2- 172.21.15.106:0/2535995448 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69200b0270 0x7f6920147230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:06.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.922+0000 7f691f200640 1 -- 172.21.15.106:0/2535995448 >> 172.21.15.106:0/2535995448 conn(0x7f6920067750 msgr2=0x7f69200cb700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:06.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.923+0000 7f691f200640 1 -- 172.21.15.106:0/2535995448 shutdown_connections 2024-08-17T02:31:06.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:06.923+0000 7f691f200640 1 -- 172.21.15.106:0/2535995448 wait complete. 2024-08-17T02:31:06.930 INFO:tasks.ceph.mds.d.smithi171.stderr: -3084> 2024-08-17T02:28:59.490+0000 7effe8600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:31:06.939 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000123149 --yes-i-really-mean-it 2024-08-17T02:31:06.971 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-08-17T02:31:07.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.087+0000 7fa3ef000640 1 Processor -- start 2024-08-17T02:31:07.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.087+0000 7fa3ef000640 1 -- start start 2024-08-17T02:31:07.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.088+0000 7fa3ef000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa3e806d7a0 0x7fa3e806db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.088+0000 7fa3ef000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3e80c8060 0x7fa3e80caff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.088+0000 7fa3ef000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e80af860 con 0x7fa3e80ae6b0 2024-08-17T02:31:07.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.088+0000 7fa3ef000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e80aec50 con 0x7fa3e806d7a0 2024-08-17T02:31:07.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.088+0000 7fa3ef000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e80aef30 con 0x7fa3e80c8060 2024-08-17T02:31:07.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.089+0000 7fa3ee600640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa3e80ae6b0 0x7fa3e8154d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:54710/0 (socket says 172.21.15.106:54710) 2024-08-17T02:31:07.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.089+0000 7fa3ee600640 1 -- 172.21.15.106:0/2023357930 learned_addr learned my addr 172.21.15.106:0/2023357930 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:31:07.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.089+0000 7fa3edc00640 1 --2- 172.21.15.106:0/2023357930 >> v2:172.21.15.106:3300/0 conn(0x7fa3e806d7a0 0x7fa3e806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.089+0000 7fa3ed200640 1 --2- 172.21.15.106:0/2023357930 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3e80c8060 0x7fa3e80caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.089+0000 7fa3edc00640 1 -- 172.21.15.106:0/2023357930 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3e80c8060 msgr2=0x7fa3e80caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:07.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.089+0000 7fa3edc00640 1 --2- 172.21.15.106:0/2023357930 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3e80c8060 0x7fa3e80caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.089+0000 7fa3edc00640 1 -- 172.21.15.106:0/2023357930 >> v1:172.21.15.106:6789/0 conn(0x7fa3e80ae6b0 legacy=0x7fa3e8154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.089+0000 7fa3edc00640 1 -- 172.21.15.106:0/2023357930 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e80af210 con 0x7fa3e806d7a0 2024-08-17T02:31:07.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.089+0000 7fa3e7e00640 1 -- 172.21.15.106:0/2023357930 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1792940074 0 0) 0x7fa3e80af860 con 0x7fa3e80ae6b0 2024-08-17T02:31:07.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.090+0000 7fa3edc00640 1 --2- 172.21.15.106:0/2023357930 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e806d7a0 0x7fa3e806db70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009850 tx=0x7fa3dc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68472a310f2af85f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:07.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.090+0000 7fa3e7e00640 1 -- 172.21.15.106:0/2023357930 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc02ad00 con 0x7fa3e806d7a0 2024-08-17T02:31:07.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.090+0000 7fa3e7e00640 1 -- 172.21.15.106:0/2023357930 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc02ae60 con 0x7fa3e806d7a0 2024-08-17T02:31:07.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.090+0000 7fa3e7e00640 1 -- 172.21.15.106:0/2023357930 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc032670 con 0x7fa3e806d7a0 2024-08-17T02:31:07.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.091+0000 7fa3ef000640 1 -- 172.21.15.106:0/2023357930 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e806d7a0 msgr2=0x7fa3e806db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.091+0000 7fa3ef000640 1 --2- 172.21.15.106:0/2023357930 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e806d7a0 0x7fa3e806db70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009850 tx=0x7fa3dc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.091+0000 7fa3ef000640 1 -- 172.21.15.106:0/2023357930 shutdown_connections 2024-08-17T02:31:07.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.091+0000 7fa3ef000640 1 --2- 172.21.15.106:0/2023357930 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3e80c8060 0x7fa3e80caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.091+0000 7fa3ef000640 1 --2- 172.21.15.106:0/2023357930 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e806d7a0 0x7fa3e806db70 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.091+0000 7fa3ef000640 1 -- 172.21.15.106:0/2023357930 >> 172.21.15.106:0/2023357930 conn(0x7fa3e8067750 msgr2=0x7fa3e80cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:07.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.091+0000 7fa3ef000640 1 -- 172.21.15.106:0/2023357930 shutdown_connections 2024-08-17T02:31:07.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.091+0000 7fa3ef000640 1 -- 172.21.15.106:0/2023357930 wait complete. 2024-08-17T02:31:07.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.092+0000 7fa3ef000640 1 Processor -- start 2024-08-17T02:31:07.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.093+0000 7fa3ef000640 1 -- start start 2024-08-17T02:31:07.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.093+0000 7fa3ef000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3e806d7a0 0x7fa3e80c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.093+0000 7fa3ef000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e80ae6b0 0x7fa3e81502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.093+0000 7fa3ef000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3e80c8060 0x7fa3e8148c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.093+0000 7fa3ef000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e8151970 con 0x7fa3e80ae6b0 2024-08-17T02:31:07.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.093+0000 7fa3ef000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e80c2a30 con 0x7fa3e806d7a0 2024-08-17T02:31:07.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.093+0000 7fa3ef000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e8150d60 con 0x7fa3e80c8060 2024-08-17T02:31:07.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.094+0000 7fa3ed200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e80ae6b0 0x7fa3e81502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.094+0000 7fa3ed200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e80ae6b0 0x7fa3e81502a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49540/0 (socket says 172.21.15.106:49540) 2024-08-17T02:31:07.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.094+0000 7fa3ed200640 1 -- 172.21.15.106:0/171570113 learned_addr learned my addr 172.21.15.106:0/171570113 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:07.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.094+0000 7fa3edc00640 1 --2- 172.21.15.106:0/171570113 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3e806d7a0 0x7fa3e80c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.094+0000 7fa3ee600640 1 --2- 172.21.15.106:0/171570113 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3e80c8060 0x7fa3e8148c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.094+0000 7fa3ed200640 1 -- 172.21.15.106:0/171570113 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3e80c8060 msgr2=0x7fa3e8148c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.094+0000 7fa3ed200640 1 --2- 172.21.15.106:0/171570113 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3e80c8060 0x7fa3e8148c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.094+0000 7fa3ed200640 1 -- 172.21.15.106:0/171570113 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3e806d7a0 msgr2=0x7fa3e80c53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.094+0000 7fa3ed200640 1 --2- 172.21.15.106:0/171570113 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3e806d7a0 0x7fa3e80c53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.094+0000 7fa3ed200640 1 -- 172.21.15.106:0/171570113 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc009390 con 0x7fa3e80ae6b0 2024-08-17T02:31:07.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.094+0000 7fa3ee600640 1 --2- 172.21.15.106:0/171570113 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3e80c8060 0x7fa3e8148c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:31:07.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.094+0000 7fa3ed200640 1 --2- 172.21.15.106:0/171570113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e80ae6b0 0x7fa3e81502a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400d890 tx=0x7fa3d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:07.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.095+0000 7fa3e4c00640 1 -- 172.21.15.106:0/171570113 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d400de20 con 0x7fa3e80ae6b0 2024-08-17T02:31:07.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.095+0000 7fa3e4c00640 1 -- 172.21.15.106:0/171570113 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d40098b0 con 0x7fa3e80ae6b0 2024-08-17T02:31:07.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.095+0000 7fa3e4c00640 1 -- 172.21.15.106:0/171570113 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4009c50 con 0x7fa3e80ae6b0 2024-08-17T02:31:07.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.095+0000 7fa3ef000640 1 -- 172.21.15.106:0/171570113 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e8151040 con 0x7fa3e80ae6b0 2024-08-17T02:31:07.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.095+0000 7fa3ef000640 1 -- 172.21.15.106:0/171570113 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e8151600 con 0x7fa3e80ae6b0 2024-08-17T02:31:07.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.096+0000 7fa3ef000640 1 -- 172.21.15.106:0/171570113 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e8151b20 con 0x7fa3e80ae6b0 2024-08-17T02:31:07.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.097+0000 7fa3e4c00640 1 -- 172.21.15.106:0/171570113 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa3d4014620 con 0x7fa3e80ae6b0 2024-08-17T02:31:07.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.097+0000 7fa3e4c00640 1 --2- 172.21.15.106:0/171570113 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa3c8065150 0x7fa3c8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:07.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.097+0000 7fa3e4c00640 1 -- 172.21.15.106:0/171570113 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5923+0+0 (secure 0 0 0) 0x7fa3d4082d40 con 0x7fa3e80ae6b0 2024-08-17T02:31:07.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.098+0000 7fa3edc00640 1 --2- 172.21.15.106:0/171570113 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa3c8065150 0x7fa3c8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:07.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.098+0000 7fa3edc00640 1 --2- 172.21.15.106:0/171570113 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa3c8065150 0x7fa3c8067600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc034000 tx=0x7fa3dc032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:07.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.102+0000 7fa3e4c00640 1 -- 172.21.15.106:0/171570113 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa3e8151b20 con 0x7fa3e80ae6b0 2024-08-17T02:31:07.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.313+0000 7fa3ef000640 1 -- 172.21.15.106:0/171570113 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000123149", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa3e8071050 con 0x7fa3e80ae6b0 2024-08-17T02:31:07.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.921+0000 7fa3e4c00640 1 -- 172.21.15.106:0/171570113 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000123149", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 121+0+0 (secure 0 0 0) 0x7fa3d4054710 con 0x7fa3e80ae6b0 2024-08-17T02:31:07.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.924+0000 7fa3ef000640 1 -- 172.21.15.106:0/171570113 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa3c8065150 msgr2=0x7fa3c8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.924+0000 7fa3ef000640 1 --2- 172.21.15.106:0/171570113 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa3c8065150 0x7fa3c8067600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc034000 tx=0x7fa3dc032000 comp rx=0 tx=0).stop 2024-08-17T02:31:07.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.924+0000 7fa3ef000640 1 -- 172.21.15.106:0/171570113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e80ae6b0 msgr2=0x7fa3e81502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:07.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.924+0000 7fa3ef000640 1 --2- 172.21.15.106:0/171570113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e80ae6b0 0x7fa3e81502a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400d890 tx=0x7fa3d4008040 comp rx=0 tx=0).stop 2024-08-17T02:31:07.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.924+0000 7fa3ef000640 1 -- 172.21.15.106:0/171570113 shutdown_connections 2024-08-17T02:31:07.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.924+0000 7fa3ef000640 1 --2- 172.21.15.106:0/171570113 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3e80c8060 0x7fa3e8148c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.924+0000 7fa3ef000640 1 --2- 172.21.15.106:0/171570113 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa3c8065150 0x7fa3c8067600 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.924+0000 7fa3ef000640 1 --2- 172.21.15.106:0/171570113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e80ae6b0 0x7fa3e81502a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.924+0000 7fa3ef000640 1 --2- 172.21.15.106:0/171570113 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3e806d7a0 0x7fa3e80c53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:07.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.924+0000 7fa3ef000640 1 -- 172.21.15.106:0/171570113 >> 172.21.15.106:0/171570113 conn(0x7fa3e8067750 msgr2=0x7fa3e8153980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:07.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.924+0000 7fa3ef000640 1 -- 172.21.15.106:0/171570113 shutdown_connections 2024-08-17T02:31:07.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:07.924+0000 7fa3ef000640 1 -- 172.21.15.106:0/171570113 wait complete. 2024-08-17T02:31:07.943 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000123149.meta cephfs.volume_0000000000123149.meta --yes-i-really-really-mean-it 2024-08-17T02:31:08.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.094+0000 7f38b2800640 1 Processor -- start 2024-08-17T02:31:08.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.094+0000 7f38b2800640 1 -- start start 2024-08-17T02:31:08.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.095+0000 7f38b2800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f38ac15c4b0 0x7f38ac163a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:08.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.095+0000 7f38b2800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38ac0d0a80 con 0x7f38ac0b5740 2024-08-17T02:31:08.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.095+0000 7f38b2800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38ac0b2130 con 0x7f38ac0b2bb0 2024-08-17T02:31:08.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.095+0000 7f38b2800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38ac0b23f0 con 0x7f38ac15c4b0 2024-08-17T02:31:08.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.095+0000 7f38b1e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f38ac15c4b0 0x7f38ac163a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:08.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.095+0000 7f38b0a00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f38ac0b5740 0x7f38ac15bda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:54720/0 (socket says 172.21.15.106:54720) 2024-08-17T02:31:08.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.095+0000 7f38b0a00640 1 -- 172.21.15.106:0/1939242351 learned_addr learned my addr 172.21.15.106:0/1939242351 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:31:08.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.096+0000 7f38b1e00640 1 -- 172.21.15.106:0/1939242351 >> v1:172.21.15.171:6789/0 conn(0x7f38ac0b2bb0 legacy=0x7f38ac0b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:08.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.096+0000 7f38b1e00640 1 -- 172.21.15.106:0/1939242351 >> v1:172.21.15.106:6789/0 conn(0x7f38ac0b5740 legacy=0x7f38ac15bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:08.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.096+0000 7f38b1e00640 1 -- 172.21.15.106:0/1939242351 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ac0b37a0 con 0x7f38ac15c4b0 2024-08-17T02:31:08.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.097+0000 7f38b1e00640 1 --2- 172.21.15.106:0/1939242351 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38ac15c4b0 0x7f38ac163a00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f38a4009e60 tx=0x7f38a4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceac3b8ce045c23e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:08.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.097+0000 7f38abe00640 1 -- 172.21.15.106:0/1939242351 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a4007550 con 0x7f38ac15c4b0 2024-08-17T02:31:08.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.097+0000 7f38abe00640 1 -- 172.21.15.106:0/1939242351 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a40076b0 con 0x7f38ac15c4b0 2024-08-17T02:31:08.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.097+0000 7f38abe00640 1 -- 172.21.15.106:0/1939242351 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a4007a90 con 0x7f38ac15c4b0 2024-08-17T02:31:08.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.098+0000 7f38b2800640 1 -- 172.21.15.106:0/1939242351 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38ac15c4b0 msgr2=0x7f38ac163a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:08.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.098+0000 7f38b2800640 1 --2- 172.21.15.106:0/1939242351 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38ac15c4b0 0x7f38ac163a00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f38a4009e60 tx=0x7f38a4009780 comp rx=0 tx=0).stop 2024-08-17T02:31:08.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.098+0000 7f38b2800640 1 -- 172.21.15.106:0/1939242351 shutdown_connections 2024-08-17T02:31:08.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.098+0000 7f38b2800640 1 --2- 172.21.15.106:0/1939242351 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38ac15c4b0 0x7f38ac163a00 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:08.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.098+0000 7f38b2800640 1 -- 172.21.15.106:0/1939242351 >> 172.21.15.106:0/1939242351 conn(0x7f38ac0cfbc0 msgr2=0x7f38ac0cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:08.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.098+0000 7f38b2800640 1 -- 172.21.15.106:0/1939242351 shutdown_connections 2024-08-17T02:31:08.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.098+0000 7f38b2800640 1 -- 172.21.15.106:0/1939242351 wait complete. 2024-08-17T02:31:08.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.099+0000 7f38b2800640 1 Processor -- start 2024-08-17T02:31:08.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.099+0000 7f38b2800640 1 -- start start 2024-08-17T02:31:08.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.100+0000 7f38b2800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38ac0b2bb0 0x7f38ac169710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:08.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.100+0000 7f38b2800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38ac0b5740 0x7f38ac153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:08.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.100+0000 7f38b2800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38ac15c4b0 0x7f38ac0b1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:08.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.100+0000 7f38b2800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac169c50 con 0x7f38ac0b2bb0 2024-08-17T02:31:08.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.100+0000 7f38b2800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac153ec0 con 0x7f38ac0b5740 2024-08-17T02:31:08.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.100+0000 7f38b2800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac1540d0 con 0x7f38ac15c4b0 2024-08-17T02:31:08.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.100+0000 7f38b1400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38ac0b2bb0 0x7f38ac169710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:08.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.100+0000 7f38b1400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38ac0b2bb0 0x7f38ac169710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49556/0 (socket says 172.21.15.106:49556) 2024-08-17T02:31:08.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.100+0000 7f38b1400640 1 -- 172.21.15.106:0/4049199592 learned_addr learned my addr 172.21.15.106:0/4049199592 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:08.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.101+0000 7f38b0a00640 1 --2- 172.21.15.106:0/4049199592 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38ac0b5740 0x7f38ac153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:08.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.101+0000 7f38b1e00640 1 --2- 172.21.15.106:0/4049199592 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38ac15c4b0 0x7f38ac0b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:08.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.101+0000 7f38b1400640 1 -- 172.21.15.106:0/4049199592 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38ac15c4b0 msgr2=0x7f38ac0b1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:08.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.101+0000 7f38b1400640 1 --2- 172.21.15.106:0/4049199592 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38ac15c4b0 0x7f38ac0b1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:08.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.101+0000 7f38b1400640 1 -- 172.21.15.106:0/4049199592 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38ac0b5740 msgr2=0x7f38ac153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:08.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.101+0000 7f38b1400640 1 --2- 172.21.15.106:0/4049199592 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38ac0b5740 0x7f38ac153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:08.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.101+0000 7f38b1400640 1 -- 172.21.15.106:0/4049199592 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a4009a20 con 0x7f38ac0b2bb0 2024-08-17T02:31:08.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.101+0000 7f38b1400640 1 --2- 172.21.15.106:0/4049199592 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38ac0b2bb0 0x7f38ac169710 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f38a000c5e0 tx=0x7f38a0007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:08.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.101+0000 7f38a8c00640 1 -- 172.21.15.106:0/4049199592 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0012630 con 0x7f38ac0b2bb0 2024-08-17T02:31:08.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.101+0000 7f38a8c00640 1 -- 172.21.15.106:0/4049199592 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a00127b0 con 0x7f38ac0b2bb0 2024-08-17T02:31:08.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.101+0000 7f38a8c00640 1 -- 172.21.15.106:0/4049199592 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0012bb0 con 0x7f38ac0b2bb0 2024-08-17T02:31:08.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.101+0000 7f38b2800640 1 -- 172.21.15.106:0/4049199592 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38ac1543b0 con 0x7f38ac0b2bb0 2024-08-17T02:31:08.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.102+0000 7f38b2800640 1 -- 172.21.15.106:0/4049199592 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38ac154970 con 0x7f38ac0b2bb0 2024-08-17T02:31:08.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.103+0000 7f38b2800640 1 -- 172.21.15.106:0/4049199592 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38ac071050 con 0x7f38ac0b2bb0 2024-08-17T02:31:08.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.104+0000 7f38a8c00640 1 -- 172.21.15.106:0/4049199592 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f38a001a3b0 con 0x7f38ac0b2bb0 2024-08-17T02:31:08.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.104+0000 7f38a8c00640 1 --2- 172.21.15.106:0/4049199592 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f388c065150 0x7f388c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:08.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.104+0000 7f38a8c00640 1 -- 172.21.15.106:0/4049199592 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f38a0082130 con 0x7f38ac0b2bb0 2024-08-17T02:31:08.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.105+0000 7f38b0a00640 1 --2- 172.21.15.106:0/4049199592 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f388c065150 0x7f388c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:08.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.105+0000 7f38b0a00640 1 --2- 172.21.15.106:0/4049199592 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f388c065150 0x7f388c067600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3898007fd0 tx=0x7f3898009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:08.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.108+0000 7f38a8c00640 1 -- 172.21.15.106:0/4049199592 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f38a0050070 con 0x7f38ac0b2bb0 2024-08-17T02:31:08.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:08.280+0000 7f38b2800640 1 -- 172.21.15.106:0/4049199592 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000123149.meta", "pool2": "cephfs.volume_0000000000123149.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f38ac066ee0 con 0x7f38ac0b2bb0 2024-08-17T02:31:09.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.251+0000 7f38a8c00640 1 -- 172.21.15.106:0/4049199592 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000123149.meta", "pool2": "cephfs.volume_0000000000123149.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000123149.meta' removed v42) v1 ==== 241+0+0 (secure 0 0 0) 0x7f38a0053690 con 0x7f38ac0b2bb0 2024-08-17T02:31:09.253 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs.volume_0000000000123149.meta' removed 2024-08-17T02:31:09.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.254+0000 7f38b2800640 1 -- 172.21.15.106:0/4049199592 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f388c065150 msgr2=0x7f388c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:09.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.254+0000 7f38b2800640 1 --2- 172.21.15.106:0/4049199592 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f388c065150 0x7f388c067600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3898007fd0 tx=0x7f3898009040 comp rx=0 tx=0).stop 2024-08-17T02:31:09.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.254+0000 7f38b2800640 1 -- 172.21.15.106:0/4049199592 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38ac0b2bb0 msgr2=0x7f38ac169710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:09.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.254+0000 7f38b2800640 1 --2- 172.21.15.106:0/4049199592 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38ac0b2bb0 0x7f38ac169710 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f38a000c5e0 tx=0x7f38a0007ed0 comp rx=0 tx=0).stop 2024-08-17T02:31:09.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.254+0000 7f38b2800640 1 -- 172.21.15.106:0/4049199592 shutdown_connections 2024-08-17T02:31:09.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.254+0000 7f38b2800640 1 --2- 172.21.15.106:0/4049199592 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f38ac15c4b0 0x7f38ac0b1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:09.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.254+0000 7f38b2800640 1 --2- 172.21.15.106:0/4049199592 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f38ac0b5740 0x7f38ac153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:09.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.254+0000 7f38b2800640 1 --2- 172.21.15.106:0/4049199592 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f388c065150 0x7f388c067600 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:09.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.254+0000 7f38b2800640 1 --2- 172.21.15.106:0/4049199592 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38ac0b2bb0 0x7f38ac169710 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:09.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.254+0000 7f38b2800640 1 -- 172.21.15.106:0/4049199592 >> 172.21.15.106:0/4049199592 conn(0x7f38ac0cfbc0 msgr2=0x7f38ac067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:09.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.255+0000 7f38b2800640 1 -- 172.21.15.106:0/4049199592 shutdown_connections 2024-08-17T02:31:09.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.256+0000 7f38b2800640 1 -- 172.21.15.106:0/4049199592 wait complete. 2024-08-17T02:31:09.274 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000123149.data cephfs.volume_0000000000123149.data --yes-i-really-really-mean-it 2024-08-17T02:31:09.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.424+0000 7fde08400640 1 Processor -- start 2024-08-17T02:31:09.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.424+0000 7fde08400640 1 -- start start 2024-08-17T02:31:09.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.425+0000 7fde08400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fde001561c0 0x7fde000cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:09.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.426+0000 7fde08400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde00156910 con 0x7fde000ad170 2024-08-17T02:31:09.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.426+0000 7fde08400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde000cb580 con 0x7fde00152d80 2024-08-17T02:31:09.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.426+0000 7fde08400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde001565b0 con 0x7fde001561c0 2024-08-17T02:31:09.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.426+0000 7fde05000640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fde000ad170 0x7fde00157920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:54726/0 (socket says 172.21.15.106:54726) 2024-08-17T02:31:09.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.426+0000 7fde06400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fde001561c0 0x7fde000cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:09.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.426+0000 7fde05000640 1 -- 172.21.15.106:0/1088388844 learned_addr learned my addr 172.21.15.106:0/1088388844 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:31:09.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.426+0000 7fde06400640 1 -- 172.21.15.106:0/1088388844 >> v1:172.21.15.171:6789/0 conn(0x7fde00152d80 legacy=0x7fde000aca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:09.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.426+0000 7fde06400640 1 -- 172.21.15.106:0/1088388844 >> v1:172.21.15.106:6789/0 conn(0x7fde000ad170 legacy=0x7fde00157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:09.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.426+0000 7fde06400640 1 -- 172.21.15.106:0/1088388844 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde00153150 con 0x7fde001561c0 2024-08-17T02:31:09.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.426+0000 7fddffe00640 1 -- 172.21.15.106:0/1088388844 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260337211 0 0) 0x7fde00156910 con 0x7fde000ad170 2024-08-17T02:31:09.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.427+0000 7fde06400640 1 --2- 172.21.15.106:0/1088388844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde001561c0 0x7fde000cb040 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fddf8009e60 tx=0x7fddf8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec6a8cf2dcf6c1d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:09.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.427+0000 7fddffe00640 1 -- 172.21.15.106:0/1088388844 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf8007550 con 0x7fde001561c0 2024-08-17T02:31:09.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.428+0000 7fddffe00640 1 -- 172.21.15.106:0/1088388844 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf802d050 con 0x7fde001561c0 2024-08-17T02:31:09.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.428+0000 7fddffe00640 1 -- 172.21.15.106:0/1088388844 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf80078e0 con 0x7fde001561c0 2024-08-17T02:31:09.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.428+0000 7fde08400640 1 -- 172.21.15.106:0/1088388844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde001561c0 msgr2=0x7fde000cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:09.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.428+0000 7fde08400640 1 --2- 172.21.15.106:0/1088388844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde001561c0 0x7fde000cb040 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fddf8009e60 tx=0x7fddf8009780 comp rx=0 tx=0).stop 2024-08-17T02:31:09.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.428+0000 7fde08400640 1 -- 172.21.15.106:0/1088388844 shutdown_connections 2024-08-17T02:31:09.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.428+0000 7fde08400640 1 --2- 172.21.15.106:0/1088388844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde001561c0 0x7fde000cb040 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:09.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.428+0000 7fde08400640 1 -- 172.21.15.106:0/1088388844 >> 172.21.15.106:0/1088388844 conn(0x7fde00067750 msgr2=0x7fde0006c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:09.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.428+0000 7fde08400640 1 -- 172.21.15.106:0/1088388844 shutdown_connections 2024-08-17T02:31:09.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.428+0000 7fde08400640 1 -- 172.21.15.106:0/1088388844 wait complete. 2024-08-17T02:31:09.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.430+0000 7fde08400640 1 Processor -- start 2024-08-17T02:31:09.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.430+0000 7fde08400640 1 -- start start 2024-08-17T02:31:09.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.430+0000 7fde08400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde000ad170 0x7fde00151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:09.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.430+0000 7fde08400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde00152d80 0x7fde0014c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:09.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.431+0000 7fde08400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde001561c0 0x7fde000af980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:09.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.431+0000 7fde08400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0006da00 con 0x7fde000ad170 2024-08-17T02:31:09.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.431+0000 7fde08400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0006d570 con 0x7fde00152d80 2024-08-17T02:31:09.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.431+0000 7fde08400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0006c6c0 con 0x7fde001561c0 2024-08-17T02:31:09.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.431+0000 7fde05a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde000ad170 0x7fde00151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:09.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.431+0000 7fde05a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde000ad170 0x7fde00151c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49570/0 (socket says 172.21.15.106:49570) 2024-08-17T02:31:09.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.431+0000 7fde05a00640 1 -- 172.21.15.106:0/1214670976 learned_addr learned my addr 172.21.15.106:0/1214670976 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:09.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.431+0000 7fde06400640 1 --2- 172.21.15.106:0/1214670976 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde001561c0 0x7fde000af980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:09.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.431+0000 7fde05000640 1 --2- 172.21.15.106:0/1214670976 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde00152d80 0x7fde0014c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:09.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.431+0000 7fde05a00640 1 -- 172.21.15.106:0/1214670976 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde001561c0 msgr2=0x7fde000af980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:09.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.431+0000 7fde05a00640 1 --2- 172.21.15.106:0/1214670976 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde001561c0 0x7fde000af980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:09.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.431+0000 7fde05a00640 1 -- 172.21.15.106:0/1214670976 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde00152d80 msgr2=0x7fde0014c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:09.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.431+0000 7fde05a00640 1 --2- 172.21.15.106:0/1214670976 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde00152d80 0x7fde0014c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:09.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.431+0000 7fde05a00640 1 -- 172.21.15.106:0/1214670976 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf8009a20 con 0x7fde000ad170 2024-08-17T02:31:09.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.431+0000 7fde05a00640 1 --2- 172.21.15.106:0/1214670976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde000ad170 0x7fde00151c30 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fddf400c5e0 tx=0x7fddf4007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:09.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.432+0000 7fddfcc00640 1 -- 172.21.15.106:0/1214670976 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4012630 con 0x7fde000ad170 2024-08-17T02:31:09.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.432+0000 7fddfcc00640 1 -- 172.21.15.106:0/1214670976 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf40127b0 con 0x7fde000ad170 2024-08-17T02:31:09.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.432+0000 7fddfcc00640 1 -- 172.21.15.106:0/1214670976 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4012b70 con 0x7fde000ad170 2024-08-17T02:31:09.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.432+0000 7fde08400640 1 -- 172.21.15.106:0/1214670976 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde0006c960 con 0x7fde000ad170 2024-08-17T02:31:09.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.432+0000 7fde08400640 1 -- 172.21.15.106:0/1214670976 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0006cf20 con 0x7fde000ad170 2024-08-17T02:31:09.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.433+0000 7fde08400640 1 -- 172.21.15.106:0/1214670976 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde000710c0 con 0x7fde000ad170 2024-08-17T02:31:09.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.434+0000 7fddfcc00640 1 -- 172.21.15.106:0/1214670976 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fddf401b400 con 0x7fde000ad170 2024-08-17T02:31:09.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.434+0000 7fddfcc00640 1 --2- 172.21.15.106:0/1214670976 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fdde0065180 0x7fdde0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:09.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.435+0000 7fddfcc00640 1 -- 172.21.15.106:0/1214670976 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5448+0+0 (secure 0 0 0) 0x7fddf4082420 con 0x7fde000ad170 2024-08-17T02:31:09.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.435+0000 7fde05000640 1 --2- 172.21.15.106:0/1214670976 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fdde0065180 0x7fdde0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:09.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.435+0000 7fde05000640 1 --2- 172.21.15.106:0/1214670976 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fdde0065180 0x7fdde0067630 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fde0016c6f0 tx=0x7fddec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:09.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.439+0000 7fddfcc00640 1 -- 172.21.15.106:0/1214670976 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fddf40506a0 con 0x7fde000ad170 2024-08-17T02:31:09.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:09.609+0000 7fde08400640 1 -- 172.21.15.106:0/1214670976 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000123149.data", "pool2": "cephfs.volume_0000000000123149.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fde000c8450 con 0x7fde000ad170 2024-08-17T02:31:10.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.257+0000 7fddfcc00640 1 -- 172.21.15.106:0/1214670976 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000123149.data", "pool2": "cephfs.volume_0000000000123149.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000123149.data' removed v43) v1 ==== 241+0+0 (secure 0 0 0) 0x7fddf4080e60 con 0x7fde000ad170 2024-08-17T02:31:10.259 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs.volume_0000000000123149.data' removed 2024-08-17T02:31:10.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.260+0000 7fde08400640 1 -- 172.21.15.106:0/1214670976 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fdde0065180 msgr2=0x7fdde0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:10.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.260+0000 7fde08400640 1 --2- 172.21.15.106:0/1214670976 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fdde0065180 0x7fdde0067630 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fde0016c6f0 tx=0x7fddec009040 comp rx=0 tx=0).stop 2024-08-17T02:31:10.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.260+0000 7fde08400640 1 -- 172.21.15.106:0/1214670976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde000ad170 msgr2=0x7fde00151c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:10.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.260+0000 7fde08400640 1 --2- 172.21.15.106:0/1214670976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde000ad170 0x7fde00151c30 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fddf400c5e0 tx=0x7fddf4007ed0 comp rx=0 tx=0).stop 2024-08-17T02:31:10.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.260+0000 7fde08400640 1 -- 172.21.15.106:0/1214670976 shutdown_connections 2024-08-17T02:31:10.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.260+0000 7fde08400640 1 --2- 172.21.15.106:0/1214670976 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde001561c0 0x7fde000af980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:10.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.260+0000 7fde08400640 1 --2- 172.21.15.106:0/1214670976 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde00152d80 0x7fde0014c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:10.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.260+0000 7fde08400640 1 --2- 172.21.15.106:0/1214670976 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fdde0065180 0x7fdde0067630 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:10.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.260+0000 7fde08400640 1 --2- 172.21.15.106:0/1214670976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde000ad170 0x7fde00151c30 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:10.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.260+0000 7fde08400640 1 -- 172.21.15.106:0/1214670976 >> 172.21.15.106:0/1214670976 conn(0x7fde00067750 msgr2=0x7fde001557b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:10.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.260+0000 7fde08400640 1 -- 172.21.15.106:0/1214670976 shutdown_connections 2024-08-17T02:31:10.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.260+0000 7fde08400640 1 -- 172.21.15.106:0/1214670976 wait complete. 2024-08-17T02:31:10.278 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-17T02:31:10.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.426+0000 7f1fe9a00640 1 Processor -- start 2024-08-17T02:31:10.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.426+0000 7f1fe9a00640 1 -- start start 2024-08-17T02:31:10.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.427+0000 7f1fe9a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1fe4156990 0x7f1fe40b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:10.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.427+0000 7f1fe9a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1fe4156d60 0x7f1fe40b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:10.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.427+0000 7f1fe9a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fe40ad7b0 0x7f1fe40adc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:10.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.427+0000 7f1fe9a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe40ae170 con 0x7f1fe4156d60 2024-08-17T02:31:10.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.427+0000 7f1fe9a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe415b030 con 0x7f1fe4156990 2024-08-17T02:31:10.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.427+0000 7f1fe9a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe40cc2e0 con 0x7f1fe40ad7b0 2024-08-17T02:31:10.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.427+0000 7f1fe2000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1fe4156d60 0x7f1fe40b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:10.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.427+0000 7f1fe2000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1fe4156d60 0x7f1fe40b0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34600/0 (socket says 172.21.15.106:34600) 2024-08-17T02:31:10.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.427+0000 7f1fe2000640 1 -- 172.21.15.106:0/3488251958 learned_addr learned my addr 172.21.15.106:0/3488251958 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:10.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.428+0000 7f1fe2a00640 1 --2- 172.21.15.106:0/3488251958 >> v2:172.21.15.171:3300/0 conn(0x7f1fe4156990 0x7f1fe40b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:10.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.428+0000 7f1fe3400640 1 --2- 172.21.15.106:0/3488251958 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fe40ad7b0 0x7f1fe40adc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:10.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.428+0000 7f1fe2000640 1 -- 172.21.15.106:0/3488251958 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fe40ad7b0 msgr2=0x7f1fe40adc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:10.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.428+0000 7f1fe2000640 1 --2- 172.21.15.106:0/3488251958 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fe40ad7b0 0x7f1fe40adc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:10.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.428+0000 7f1fe2000640 1 -- 172.21.15.106:0/3488251958 >> v2:172.21.15.171:3300/0 conn(0x7f1fe4156990 msgr2=0x7f1fe40b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:10.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.428+0000 7f1fe2000640 1 --2- 172.21.15.106:0/3488251958 >> v2:172.21.15.171:3300/0 conn(0x7f1fe4156990 0x7f1fe40b05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:10.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.428+0000 7f1fe2000640 1 -- 172.21.15.106:0/3488251958 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe40b1110 con 0x7f1fe4156d60 2024-08-17T02:31:10.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.429+0000 7f1fe2000640 1 --2- 172.21.15.106:0/3488251958 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fe4156d60 0x7f1fe40b0ae0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1fe40635c0 tx=0x7f1fd00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc458bed42e340e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:10.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.429+0000 7f1fe1600640 1 -- 172.21.15.106:0/3488251958 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd002add0 con 0x7f1fe4156d60 2024-08-17T02:31:10.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.429+0000 7f1fe1600640 1 -- 172.21.15.106:0/3488251958 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd0032440 con 0x7f1fe4156d60 2024-08-17T02:31:10.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.429+0000 7f1fe1600640 1 -- 172.21.15.106:0/3488251958 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd0032820 con 0x7f1fe4156d60 2024-08-17T02:31:10.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.430+0000 7f1fe9a00640 1 -- 172.21.15.106:0/3488251958 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fe4156d60 msgr2=0x7f1fe40b0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:10.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.430+0000 7f1fe9a00640 1 --2- 172.21.15.106:0/3488251958 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fe4156d60 0x7f1fe40b0ae0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1fe40635c0 tx=0x7f1fd00091d0 comp rx=0 tx=0).stop 2024-08-17T02:31:10.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.430+0000 7f1fe9a00640 1 -- 172.21.15.106:0/3488251958 shutdown_connections 2024-08-17T02:31:10.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.430+0000 7f1fe9a00640 1 --2- 172.21.15.106:0/3488251958 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fe40ad7b0 0x7f1fe40adc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:10.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.430+0000 7f1fe9a00640 1 --2- 172.21.15.106:0/3488251958 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fe4156d60 0x7f1fe40b0ae0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:10.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.430+0000 7f1fe9a00640 1 --2- 172.21.15.106:0/3488251958 >> v2:172.21.15.171:3300/0 conn(0x7f1fe4156990 0x7f1fe40b05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:10.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.430+0000 7f1fe9a00640 1 -- 172.21.15.106:0/3488251958 >> 172.21.15.106:0/3488251958 conn(0x7f1fe4067750 msgr2=0x7f1fe40cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:10.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.430+0000 7f1fe9a00640 1 -- 172.21.15.106:0/3488251958 shutdown_connections 2024-08-17T02:31:10.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.430+0000 7f1fe9a00640 1 -- 172.21.15.106:0/3488251958 wait complete. 2024-08-17T02:31:10.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.431+0000 7f1fe9a00640 1 Processor -- start 2024-08-17T02:31:10.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.431+0000 7f1fe9a00640 1 -- start start 2024-08-17T02:31:10.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.432+0000 7f1fe9a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fe40ad7b0 0x7f1fe4169110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:10.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.432+0000 7f1fe9a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fe4156990 0x7f1fe40c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:10.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.432+0000 7f1fe9a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fe4156d60 0x7f1fe40c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:10.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.432+0000 7f1fe9a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe4157da0 con 0x7f1fe40ad7b0 2024-08-17T02:31:10.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.432+0000 7f1fe9a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe4169650 con 0x7f1fe4156990 2024-08-17T02:31:10.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.432+0000 7f1fe9a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe41571d0 con 0x7f1fe4156d60 2024-08-17T02:31:10.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.432+0000 7f1fe2a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fe40ad7b0 0x7f1fe4169110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:10.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.432+0000 7f1fe2a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fe40ad7b0 0x7f1fe4169110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34608/0 (socket says 172.21.15.106:34608) 2024-08-17T02:31:10.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.432+0000 7f1fe2a00640 1 -- 172.21.15.106:0/3435166873 learned_addr learned my addr 172.21.15.106:0/3435166873 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:10.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.432+0000 7f1fe2000640 1 --2- 172.21.15.106:0/3435166873 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fe4156990 0x7f1fe40c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:10.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.433+0000 7f1fe3400640 1 --2- 172.21.15.106:0/3435166873 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fe4156d60 0x7f1fe40c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:10.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.433+0000 7f1fe2a00640 1 -- 172.21.15.106:0/3435166873 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fe4156d60 msgr2=0x7f1fe40c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:10.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.433+0000 7f1fe2a00640 1 --2- 172.21.15.106:0/3435166873 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fe4156d60 0x7f1fe40c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:10.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.433+0000 7f1fe2a00640 1 -- 172.21.15.106:0/3435166873 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fe4156990 msgr2=0x7f1fe40c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:10.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.433+0000 7f1fe2a00640 1 --2- 172.21.15.106:0/3435166873 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fe4156990 0x7f1fe40c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:10.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.433+0000 7f1fe2a00640 1 -- 172.21.15.106:0/3435166873 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd0009450 con 0x7f1fe40ad7b0 2024-08-17T02:31:10.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.433+0000 7f1fe2a00640 1 --2- 172.21.15.106:0/3435166873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fe40ad7b0 0x7f1fe4169110 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400d8c0 tx=0x7f1fd4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:10.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.433+0000 7f1fda000640 1 -- 172.21.15.106:0/3435166873 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd400de50 con 0x7f1fe40ad7b0 2024-08-17T02:31:10.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.433+0000 7f1fda000640 1 -- 172.21.15.106:0/3435166873 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd40098b0 con 0x7f1fe40ad7b0 2024-08-17T02:31:10.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.433+0000 7f1fe9a00640 1 -- 172.21.15.106:0/3435166873 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe4157470 con 0x7f1fe40ad7b0 2024-08-17T02:31:10.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.433+0000 7f1fda000640 1 -- 172.21.15.106:0/3435166873 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4009c50 con 0x7f1fe40ad7b0 2024-08-17T02:31:10.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.434+0000 7f1fe9a00640 1 -- 172.21.15.106:0/3435166873 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe4157a30 con 0x7f1fe40ad7b0 2024-08-17T02:31:10.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.435+0000 7f1fe9a00640 1 -- 172.21.15.106:0/3435166873 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe4071050 con 0x7f1fe40ad7b0 2024-08-17T02:31:10.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.435+0000 7f1fda000640 1 -- 172.21.15.106:0/3435166873 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1fd4014620 con 0x7f1fe40ad7b0 2024-08-17T02:31:10.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.437+0000 7f1fda000640 1 --2- 172.21.15.106:0/3435166873 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1fc4065180 0x7f1fc4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:10.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.437+0000 7f1fda000640 1 -- 172.21.15.106:0/3435166873 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f1fd40828c0 con 0x7f1fe40ad7b0 2024-08-17T02:31:10.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.437+0000 7f1fe2000640 1 --2- 172.21.15.106:0/3435166873 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1fc4065180 0x7f1fc4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:10.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.437+0000 7f1fe2000640 1 --2- 172.21.15.106:0/3435166873 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1fc4065180 0x7f1fc4067630 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0034000 tx=0x7f1fd0032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:10.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.441+0000 7f1fda000640 1 -- 172.21.15.106:0/3435166873 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1fd4050c30 con 0x7f1fe40ad7b0 2024-08-17T02:31:10.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.620+0000 7f1fe9a00640 1 -- 172.21.15.106:0/3435166873 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1fe40640d0 con 0x7f1fe40ad7b0 2024-08-17T02:31:10.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.624+0000 7f1fda000640 1 -- 172.21.15.106:0/3435166873 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1fd4054250 con 0x7f1fe40ad7b0 2024-08-17T02:31:10.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.626+0000 7f1fe9a00640 1 -- 172.21.15.106:0/3435166873 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1fc4065180 msgr2=0x7f1fc4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:10.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.626+0000 7f1fe9a00640 1 --2- 172.21.15.106:0/3435166873 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1fc4065180 0x7f1fc4067630 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0034000 tx=0x7f1fd0032000 comp rx=0 tx=0).stop 2024-08-17T02:31:10.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.626+0000 7f1fe9a00640 1 -- 172.21.15.106:0/3435166873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fe40ad7b0 msgr2=0x7f1fe4169110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:10.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.626+0000 7f1fe9a00640 1 --2- 172.21.15.106:0/3435166873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fe40ad7b0 0x7f1fe4169110 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400d8c0 tx=0x7f1fd4008040 comp rx=0 tx=0).stop 2024-08-17T02:31:10.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.626+0000 7f1fe9a00640 1 -- 172.21.15.106:0/3435166873 shutdown_connections 2024-08-17T02:31:10.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.626+0000 7f1fe9a00640 1 --2- 172.21.15.106:0/3435166873 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fe4156d60 0x7f1fe40c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:10.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.626+0000 7f1fe9a00640 1 --2- 172.21.15.106:0/3435166873 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fe4156990 0x7f1fe40c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:10.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.626+0000 7f1fe9a00640 1 --2- 172.21.15.106:0/3435166873 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1fc4065180 0x7f1fc4067630 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:10.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.626+0000 7f1fe9a00640 1 --2- 172.21.15.106:0/3435166873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fe40ad7b0 0x7f1fe4169110 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:10.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.627+0000 7f1fe9a00640 1 -- 172.21.15.106:0/3435166873 >> 172.21.15.106:0/3435166873 conn(0x7f1fe4067750 msgr2=0x7f1fe4155970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:10.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.627+0000 7f1fe9a00640 1 -- 172.21.15.106:0/3435166873 shutdown_connections 2024-08-17T02:31:10.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.627+0000 7f1fe9a00640 1 -- 172.21.15.106:0/3435166873 wait complete. 2024-08-17T02:31:10.643 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:31:10.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.788+0000 7fd62ba00640 1 Processor -- start 2024-08-17T02:31:10.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.789+0000 7fd62ba00640 1 -- start start 2024-08-17T02:31:10.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.791+0000 7fd62ba00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd624155a20 0x7fd6240adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:10.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.791+0000 7fd62ba00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd624155df0 0x7fd6240ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:10.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.791+0000 7fd62ba00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd62406d7f0 0x7fd62406dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:10.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.791+0000 7fd62ba00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6240b0350 con 0x7fd624155df0 2024-08-17T02:31:10.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.791+0000 7fd62ba00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd62406e1d0 con 0x7fd62406d7f0 2024-08-17T02:31:10.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.791+0000 7fd62ba00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd624156670 con 0x7fd624155a20 2024-08-17T02:31:10.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.791+0000 7fd623e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd624155df0 0x7fd6240ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:10.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.791+0000 7fd623e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd624155df0 0x7fd6240ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34612/0 (socket says 172.21.15.106:34612) 2024-08-17T02:31:10.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.791+0000 7fd623e00640 1 -- 172.21.15.106:0/2598748673 learned_addr learned my addr 172.21.15.106:0/2598748673 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:10.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.791+0000 7fd623e00640 1 -- 172.21.15.106:0/2598748673 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd624155a20 msgr2=0x7fd6240adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:10.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.791+0000 7fd623e00640 1 --2- 172.21.15.106:0/2598748673 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd624155a20 0x7fd6240adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:10.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.791+0000 7fd623e00640 1 -- 172.21.15.106:0/2598748673 >> v2:172.21.15.171:3300/0 conn(0x7fd62406d7f0 msgr2=0x7fd62406dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:10.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.791+0000 7fd629a00640 1 --2- 172.21.15.106:0/2598748673 >> v2:172.21.15.171:3300/0 conn(0x7fd62406d7f0 0x7fd62406dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:10.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.791+0000 7fd623e00640 1 --2- 172.21.15.106:0/2598748673 >> v2:172.21.15.171:3300/0 conn(0x7fd62406d7f0 0x7fd62406dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:10.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.791+0000 7fd623e00640 1 -- 172.21.15.106:0/2598748673 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62406e5e0 con 0x7fd624155df0 2024-08-17T02:31:10.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.791+0000 7fd623e00640 1 --2- 172.21.15.106:0/2598748673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd624155df0 0x7fd6240ad9b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd6241565e0 tx=0x7fd6100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b61555638d0596e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:10.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.792+0000 7fd623400640 1 -- 172.21.15.106:0/2598748673 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61002add0 con 0x7fd624155df0 2024-08-17T02:31:10.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.792+0000 7fd623400640 1 -- 172.21.15.106:0/2598748673 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd610032440 con 0x7fd624155df0 2024-08-17T02:31:10.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.792+0000 7fd623400640 1 -- 172.21.15.106:0/2598748673 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd610032820 con 0x7fd624155df0 2024-08-17T02:31:10.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.792+0000 7fd62ba00640 1 -- 172.21.15.106:0/2598748673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd624155df0 msgr2=0x7fd6240ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:10.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.792+0000 7fd62ba00640 1 --2- 172.21.15.106:0/2598748673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd624155df0 0x7fd6240ad9b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd6241565e0 tx=0x7fd6100091d0 comp rx=0 tx=0).stop 2024-08-17T02:31:10.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.792+0000 7fd62ba00640 1 -- 172.21.15.106:0/2598748673 shutdown_connections 2024-08-17T02:31:10.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.792+0000 7fd62ba00640 1 --2- 172.21.15.106:0/2598748673 >> v2:172.21.15.171:3300/0 conn(0x7fd62406d7f0 0x7fd62406dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:10.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.792+0000 7fd62ba00640 1 --2- 172.21.15.106:0/2598748673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd624155df0 0x7fd6240ad9b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:10.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.792+0000 7fd62ba00640 1 --2- 172.21.15.106:0/2598748673 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd624155a20 0x7fd6240adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:10.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.792+0000 7fd62ba00640 1 -- 172.21.15.106:0/2598748673 >> 172.21.15.106:0/2598748673 conn(0x7fd6240cb9b0 msgr2=0x7fd6240cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:10.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.792+0000 7fd62ba00640 1 -- 172.21.15.106:0/2598748673 shutdown_connections 2024-08-17T02:31:10.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.792+0000 7fd62ba00640 1 -- 172.21.15.106:0/2598748673 wait complete. 2024-08-17T02:31:10.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.794+0000 7fd62ba00640 1 Processor -- start 2024-08-17T02:31:10.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.794+0000 7fd62ba00640 1 -- start start 2024-08-17T02:31:10.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.795+0000 7fd62ba00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd62406d7f0 0x7fd6240a9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:10.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.795+0000 7fd62ba00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd624155a20 0x7fd6240ad980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:10.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.795+0000 7fd62ba00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd624155df0 0x7fd6240adec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:10.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.795+0000 7fd62ba00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6241685f0 con 0x7fd624155a20 2024-08-17T02:31:10.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.795+0000 7fd62ba00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6240aaed0 con 0x7fd62406d7f0 2024-08-17T02:31:10.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.795+0000 7fd62ba00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6240aa630 con 0x7fd624155df0 2024-08-17T02:31:10.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.795+0000 7fd623e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd624155a20 0x7fd6240ad980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:10.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.795+0000 7fd623e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd624155a20 0x7fd6240ad980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34618/0 (socket says 172.21.15.106:34618) 2024-08-17T02:31:10.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.795+0000 7fd623e00640 1 -- 172.21.15.106:0/3983301724 learned_addr learned my addr 172.21.15.106:0/3983301724 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:10.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.795+0000 7fd623e00640 1 -- 172.21.15.106:0/3983301724 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd624155df0 msgr2=0x7fd6240adec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:10.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.795+0000 7fd623e00640 1 --2- 172.21.15.106:0/3983301724 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd624155df0 0x7fd6240adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:10.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.795+0000 7fd623e00640 1 -- 172.21.15.106:0/3983301724 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd62406d7f0 msgr2=0x7fd6240a9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:10.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.795+0000 7fd623e00640 1 --2- 172.21.15.106:0/3983301724 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd62406d7f0 0x7fd6240a9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:10.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.796+0000 7fd623e00640 1 -- 172.21.15.106:0/3983301724 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd610009450 con 0x7fd624155a20 2024-08-17T02:31:10.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.796+0000 7fd623e00640 1 --2- 172.21.15.106:0/3983301724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd624155a20 0x7fd6240ad980 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd610035040 tx=0x7fd610032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:10.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.796+0000 7fd617e00640 1 -- 172.21.15.106:0/3983301724 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd610031a60 con 0x7fd624155a20 2024-08-17T02:31:10.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.796+0000 7fd617e00640 1 -- 172.21.15.106:0/3983301724 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd610031c00 con 0x7fd624155a20 2024-08-17T02:31:10.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.796+0000 7fd62ba00640 1 -- 172.21.15.106:0/3983301724 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6240aa910 con 0x7fd624155a20 2024-08-17T02:31:10.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.796+0000 7fd617e00640 1 -- 172.21.15.106:0/3983301724 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61003d420 con 0x7fd624155a20 2024-08-17T02:31:10.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.796+0000 7fd62ba00640 1 -- 172.21.15.106:0/3983301724 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6240aa310 con 0x7fd624155a20 2024-08-17T02:31:10.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.797+0000 7fd62ba00640 1 -- 172.21.15.106:0/3983301724 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd624064620 con 0x7fd624155a20 2024-08-17T02:31:10.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.798+0000 7fd617e00640 1 -- 172.21.15.106:0/3983301724 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd610039040 con 0x7fd624155a20 2024-08-17T02:31:10.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.799+0000 7fd617e00640 1 --2- 172.21.15.106:0/3983301724 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd604065150 0x7fd604067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:10.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.799+0000 7fd617e00640 1 -- 172.21.15.106:0/3983301724 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fd6100a2410 con 0x7fd624155a20 2024-08-17T02:31:10.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.799+0000 7fd629000640 1 --2- 172.21.15.106:0/3983301724 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd604065150 0x7fd604067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:10.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.800+0000 7fd629000640 1 --2- 172.21.15.106:0/3983301724 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd604065150 0x7fd604067600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd6180097e0 tx=0x7fd618006d20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:10.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:10.803+0000 7fd617e00640 1 -- 172.21.15.106:0/3983301724 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd624064620 con 0x7fd624155a20 2024-08-17T02:31:11.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:11.034+0000 7fd62ba00640 1 -- 172.21.15.106:0/3983301724 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7fd624064620 con 0x7fd624155a20 2024-08-17T02:31:11.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:11.261+0000 7fd617e00640 1 -- 172.21.15.106:0/3983301724 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v166) v1 ==== 135+0+0 (secure 0 0 0) 0x7fd624064620 con 0x7fd624155a20 2024-08-17T02:31:11.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:11.263+0000 7fd62ba00640 1 -- 172.21.15.106:0/3983301724 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd604065150 msgr2=0x7fd604067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:11.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:11.263+0000 7fd62ba00640 1 --2- 172.21.15.106:0/3983301724 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd604065150 0x7fd604067600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd6180097e0 tx=0x7fd618006d20 comp rx=0 tx=0).stop 2024-08-17T02:31:11.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:11.263+0000 7fd62ba00640 1 -- 172.21.15.106:0/3983301724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd624155a20 msgr2=0x7fd6240ad980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:11.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:11.263+0000 7fd62ba00640 1 --2- 172.21.15.106:0/3983301724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd624155a20 0x7fd6240ad980 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd610035040 tx=0x7fd610032000 comp rx=0 tx=0).stop 2024-08-17T02:31:11.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:11.263+0000 7fd62ba00640 1 -- 172.21.15.106:0/3983301724 shutdown_connections 2024-08-17T02:31:11.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:11.263+0000 7fd62ba00640 1 --2- 172.21.15.106:0/3983301724 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd624155df0 0x7fd6240adec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:11.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:11.263+0000 7fd62ba00640 1 --2- 172.21.15.106:0/3983301724 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd604065150 0x7fd604067600 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:11.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:11.263+0000 7fd62ba00640 1 --2- 172.21.15.106:0/3983301724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd624155a20 0x7fd6240ad980 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:11.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:11.263+0000 7fd62ba00640 1 --2- 172.21.15.106:0/3983301724 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd62406d7f0 0x7fd6240a9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:11.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:11.263+0000 7fd62ba00640 1 -- 172.21.15.106:0/3983301724 >> 172.21.15.106:0/3983301724 conn(0x7fd6240cb9b0 msgr2=0x7fd624156b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:11.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:11.263+0000 7fd62ba00640 1 -- 172.21.15.106:0/3983301724 shutdown_connections 2024-08-17T02:31:11.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:11.263+0000 7fd62ba00640 1 -- 172.21.15.106:0/3983301724 wait complete. 2024-08-17T02:31:11.283 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ERROR 2024-08-17T02:31:11.283 INFO:tasks.cephfs_test_runner: 2024-08-17T02:31:11.283 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:31:11.283 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:31:11.283 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:31:11.284 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:31:11.284 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:31:11.284 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:31:11.284 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:31:11.284 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:31:11.284 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:31:11.284 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:31:11.284 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:31:11.284 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:31:11.284 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:31:11.284 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:31:11.284 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:31:11.284 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:31:11.284 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:31:11.284 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:31:11.284 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:31:11.284 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:31:11.284 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:31:11.285 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:31:11.285 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:31:11.285 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi106 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000123149 --yes-i-really-mean-it' 2024-08-17T02:31:11.285 INFO:tasks.cephfs_test_runner: 2024-08-17T02:31:11.285 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:31:11.285 INFO:tasks.cephfs_test_runner:Ran 1 test in 169.449s 2024-08-17T02:31:11.285 INFO:tasks.cephfs_test_runner: 2024-08-17T02:31:11.285 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-08-17T02:31:11.285 INFO:tasks.cephfs_test_runner: 2024-08-17T02:31:11.285 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:31:11.285 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:31:11.285 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:31:11.285 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:31:11.285 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:31:11.286 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:31:11.286 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:31:11.286 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:31:11.286 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:31:11.286 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:31:11.286 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:31:11.286 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:31:11.286 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:31:11.286 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:31:11.286 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:31:11.286 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:31:11.286 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:31:11.286 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:31:11.286 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:31:11.286 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:31:11.286 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:31:11.286 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:31:11.286 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:31:11.287 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi106 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000123149 --yes-i-really-mean-it' 2024-08-17T02:31:11.287 INFO:tasks.cephfs_test_runner: 2024-08-17T02:31:11.287 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:31:11.504 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=b9c47e2f1126403fbd5addc54c52c945 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:31:11.505 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-08-17T02:31:11.514 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-17T02:31:11.536 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-17T02:31:11.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:31:11.536 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-08-17T02:31:11.575 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:31:11.576 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:31:11.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:31:11.576 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:31:11.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:31:11.674 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:31:11.845 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:11.849 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:11.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:31:11.929 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link delete ceph-brx 2024-08-17T02:31:12.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:31:12.246 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-08-17T02:31:12.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:31:12.283 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link delete ceph-brx 2024-08-17T02:31:12.384 INFO:teuthology.orchestra.run.smithi106.stderr:Cannot find device "ceph-brx" 2024-08-17T02:31:12.386 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:31:12.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:31:12.387 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-08-17T02:31:12.426 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:31:12.427 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:31:12.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:31:12.427 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:31:12.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:31:12.527 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:31:12.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:31:12.793 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link delete ceph-brx 2024-08-17T02:31:13.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:31:13.099 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2024-08-17T02:31:13.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:31:13.136 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link delete ceph-brx 2024-08-17T02:31:13.238 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:31:13.239 INFO:teuthology.orchestra.run.smithi171.stderr:Cannot find device "ceph-brx" 2024-08-17T02:31:13.239 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-17T02:31:13.254 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-08-17T02:31:13.255 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:31:13.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.410+0000 7f0b5b000640 1 Processor -- start 2024-08-17T02:31:13.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.411+0000 7f0b5b000640 1 -- start start 2024-08-17T02:31:13.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.412+0000 7f0b5b000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0b54155900 0x7f0b54155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:13.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.412+0000 7f0b5b000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0b540b0270 0x7f0b54156210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:13.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.412+0000 7f0b5b000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b54157690 con 0x7f0b54157b20 2024-08-17T02:31:13.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.412+0000 7f0b5b000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b54156a80 con 0x7f0b54155900 2024-08-17T02:31:13.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.412+0000 7f0b5b000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b54156d60 con 0x7f0b540b0270 2024-08-17T02:31:13.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.412+0000 7f0b59c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0b54155900 0x7f0b54155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:13.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.412+0000 7f0b59c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0b54155900 0x7f0b54155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34622/0 (socket says 172.21.15.106:34622) 2024-08-17T02:31:13.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.412+0000 7f0b59c00640 1 -- 172.21.15.106:0/1313139630 learned_addr learned my addr 172.21.15.106:0/1313139630 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:13.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.412+0000 7f0b59200640 1 --2- 172.21.15.106:0/1313139630 >> v2:172.21.15.171:3300/0 conn(0x7f0b540b0270 0x7f0b54156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:13.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.412+0000 7f0b59c00640 1 -- 172.21.15.106:0/1313139630 >> v2:172.21.15.171:3300/0 conn(0x7f0b540b0270 msgr2=0x7f0b54156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:13.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.413+0000 7f0b59c00640 1 --2- 172.21.15.106:0/1313139630 >> v2:172.21.15.171:3300/0 conn(0x7f0b540b0270 0x7f0b54156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:13.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.413+0000 7f0b59c00640 1 -- 172.21.15.106:0/1313139630 >> v1:172.21.15.171:6789/0 conn(0x7f0b54157b20 legacy=0x7f0b54157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:13.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.413+0000 7f0b59c00640 1 -- 172.21.15.106:0/1313139630 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b54157040 con 0x7f0b54155900 2024-08-17T02:31:13.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.414+0000 7f0b59c00640 1 --2- 172.21.15.106:0/1313139630 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b54155900 0x7f0b54155cd0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0b5406f430 tx=0x7f0b480091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9928ce9b2787b419 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:13.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.414+0000 7f0b53e00640 1 -- 172.21.15.106:0/1313139630 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4802adf0 con 0x7f0b54155900 2024-08-17T02:31:13.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.414+0000 7f0b53e00640 1 -- 172.21.15.106:0/1313139630 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b48032440 con 0x7f0b54155900 2024-08-17T02:31:13.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.414+0000 7f0b53e00640 1 -- 172.21.15.106:0/1313139630 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b48032820 con 0x7f0b54155900 2024-08-17T02:31:13.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.414+0000 7f0b5b000640 1 -- 172.21.15.106:0/1313139630 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b54155900 msgr2=0x7f0b54155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:13.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.414+0000 7f0b5b000640 1 --2- 172.21.15.106:0/1313139630 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b54155900 0x7f0b54155cd0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0b5406f430 tx=0x7f0b480091d0 comp rx=0 tx=0).stop 2024-08-17T02:31:13.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.415+0000 7f0b5b000640 1 -- 172.21.15.106:0/1313139630 shutdown_connections 2024-08-17T02:31:13.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.415+0000 7f0b5b000640 1 --2- 172.21.15.106:0/1313139630 >> v2:172.21.15.171:3300/0 conn(0x7f0b540b0270 0x7f0b54156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:13.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.415+0000 7f0b5b000640 1 --2- 172.21.15.106:0/1313139630 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b54155900 0x7f0b54155cd0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:13.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.415+0000 7f0b5b000640 1 -- 172.21.15.106:0/1313139630 >> 172.21.15.106:0/1313139630 conn(0x7f0b54067750 msgr2=0x7f0b540cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:13.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.415+0000 7f0b5b000640 1 -- 172.21.15.106:0/1313139630 shutdown_connections 2024-08-17T02:31:13.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.415+0000 7f0b5b000640 1 -- 172.21.15.106:0/1313139630 wait complete. 2024-08-17T02:31:13.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.416+0000 7f0b5b000640 1 Processor -- start 2024-08-17T02:31:13.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.416+0000 7f0b5b000640 1 -- start start 2024-08-17T02:31:13.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.417+0000 7f0b5b000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b540b0270 0x7f0b540c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:13.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.417+0000 7f0b5b000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b54155900 0x7f0b540c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:13.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.417+0000 7f0b5b000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b54157b20 0x7f0b540c1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:13.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.417+0000 7f0b5b000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b541461c0 con 0x7f0b540b0270 2024-08-17T02:31:13.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.417+0000 7f0b5b000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b540c3730 con 0x7f0b54157b20 2024-08-17T02:31:13.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.417+0000 7f0b5b000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b540c3fd0 con 0x7f0b54155900 2024-08-17T02:31:13.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.417+0000 7f0b59c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b540b0270 0x7f0b540c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:13.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.417+0000 7f0b59c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b540b0270 0x7f0b540c5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34634/0 (socket says 172.21.15.106:34634) 2024-08-17T02:31:13.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.417+0000 7f0b59c00640 1 -- 172.21.15.106:0/3558731519 learned_addr learned my addr 172.21.15.106:0/3558731519 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:13.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.417+0000 7f0b59200640 1 --2- 172.21.15.106:0/3558731519 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b54155900 0x7f0b540c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:13.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.417+0000 7f0b5a600640 1 --2- 172.21.15.106:0/3558731519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b54157b20 0x7f0b540c1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:13.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.418+0000 7f0b59c00640 1 -- 172.21.15.106:0/3558731519 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b54155900 msgr2=0x7f0b540c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:13.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.418+0000 7f0b59c00640 1 --2- 172.21.15.106:0/3558731519 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b54155900 0x7f0b540c5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:13.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.418+0000 7f0b59c00640 1 -- 172.21.15.106:0/3558731519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b54157b20 msgr2=0x7f0b540c1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:13.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.418+0000 7f0b59c00640 1 --2- 172.21.15.106:0/3558731519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b54157b20 0x7f0b540c1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:13.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.418+0000 7f0b59c00640 1 -- 172.21.15.106:0/3558731519 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b48009450 con 0x7f0b540b0270 2024-08-17T02:31:13.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.418+0000 7f0b59c00640 1 --2- 172.21.15.106:0/3558731519 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b540b0270 0x7f0b540c5790 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0b48009940 tx=0x7f0b48032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:13.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.418+0000 7f0b50c00640 1 -- 172.21.15.106:0/3558731519 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b48031a60 con 0x7f0b540b0270 2024-08-17T02:31:13.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.418+0000 7f0b50c00640 1 -- 172.21.15.106:0/3558731519 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b48031be0 con 0x7f0b540b0270 2024-08-17T02:31:13.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.418+0000 7f0b5b000640 1 -- 172.21.15.106:0/3558731519 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b540c20c0 con 0x7f0b540b0270 2024-08-17T02:31:13.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.418+0000 7f0b50c00640 1 -- 172.21.15.106:0/3558731519 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4803d420 con 0x7f0b540b0270 2024-08-17T02:31:13.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.418+0000 7f0b5b000640 1 -- 172.21.15.106:0/3558731519 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b540c3c60 con 0x7f0b540b0270 2024-08-17T02:31:13.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.419+0000 7f0b5b000640 1 -- 172.21.15.106:0/3558731519 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b54071050 con 0x7f0b540b0270 2024-08-17T02:31:13.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.420+0000 7f0b50c00640 1 -- 172.21.15.106:0/3558731519 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0b48039040 con 0x7f0b540b0270 2024-08-17T02:31:13.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.421+0000 7f0b50c00640 1 --2- 172.21.15.106:0/3558731519 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0b34065150 0x7f0b34067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:13.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.421+0000 7f0b50c00640 1 -- 172.21.15.106:0/3558731519 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f0b480a2160 con 0x7f0b540b0270 2024-08-17T02:31:13.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.421+0000 7f0b59200640 1 --2- 172.21.15.106:0/3558731519 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0b34065150 0x7f0b34067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:13.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.422+0000 7f0b59200640 1 --2- 172.21.15.106:0/3558731519 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0b34065150 0x7f0b34067600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0b5416c6b0 tx=0x7f0b400090f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:13.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.425+0000 7f0b50c00640 1 -- 172.21.15.106:0/3558731519 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0b480704d0 con 0x7f0b540b0270 2024-08-17T02:31:13.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.598+0000 7f0b5b000640 1 -- 172.21.15.106:0/3558731519 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b5406f480 con 0x7f0b540b0270 2024-08-17T02:31:13.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.599+0000 7f0b50c00640 1 -- 172.21.15.106:0/3558731519 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12443 (secure 0 0 0) 0x7f0b48073af0 con 0x7f0b540b0270 2024-08-17T02:31:13.600 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:31:13.600 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":43,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:31:10.251940+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.171:6833/3251295288":"2024-08-18T02:31:06.917308+0000","172.21.15.171:6835/3251295288":"2024-08-18T02:31:06.917308+0000","172.21.15.171:6834/754665763":"2024-08-18T02:31:00.016136+0000","172.21.15.171:6832/754665763":"2024-08-18T02:31:00.016136+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:31:13.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.601+0000 7f0b5b000640 1 -- 172.21.15.106:0/3558731519 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0b34065150 msgr2=0x7f0b34067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:13.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.601+0000 7f0b5b000640 1 --2- 172.21.15.106:0/3558731519 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0b34065150 0x7f0b34067600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0b5416c6b0 tx=0x7f0b400090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:13.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.601+0000 7f0b5b000640 1 -- 172.21.15.106:0/3558731519 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b540b0270 msgr2=0x7f0b540c5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:13.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.601+0000 7f0b5b000640 1 --2- 172.21.15.106:0/3558731519 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b540b0270 0x7f0b540c5790 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0b48009940 tx=0x7f0b48032000 comp rx=0 tx=0).stop 2024-08-17T02:31:13.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.601+0000 7f0b5b000640 1 -- 172.21.15.106:0/3558731519 shutdown_connections 2024-08-17T02:31:13.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.601+0000 7f0b5b000640 1 --2- 172.21.15.106:0/3558731519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0b54157b20 0x7f0b540c1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:13.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.601+0000 7f0b5b000640 1 --2- 172.21.15.106:0/3558731519 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0b54155900 0x7f0b540c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:13.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.601+0000 7f0b5b000640 1 --2- 172.21.15.106:0/3558731519 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f0b34065150 0x7f0b34067600 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:13.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.601+0000 7f0b5b000640 1 --2- 172.21.15.106:0/3558731519 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b540b0270 0x7f0b540c5790 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:13.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.601+0000 7f0b5b000640 1 -- 172.21.15.106:0/3558731519 >> 172.21.15.106:0/3558731519 conn(0x7f0b54067750 msgr2=0x7f0b5406dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:13.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.602+0000 7f0b5b000640 1 -- 172.21.15.106:0/3558731519 shutdown_connections 2024-08-17T02:31:13.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.602+0000 7f0b5b000640 1 -- 172.21.15.106:0/3558731519 wait complete. 2024-08-17T02:31:13.617 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:31:13.618 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:31:13.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.765+0000 7fea43800640 1 Processor -- start 2024-08-17T02:31:13.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.765+0000 7fea43800640 1 -- start start 2024-08-17T02:31:13.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.766+0000 7fea43800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea3c158f80 0x7fea3c0ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:13.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.766+0000 7fea43800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fea3c0cf280 0x7fea3c0ade50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:13.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.766+0000 7fea43800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea3c0cb560 con 0x7fea3c159350 2024-08-17T02:31:13.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.766+0000 7fea43800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea3c0cf7e0 con 0x7fea3c0cf280 2024-08-17T02:31:13.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.766+0000 7fea43800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c0cfac0 con 0x7fea3c158f80 2024-08-17T02:31:13.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.766+0000 7fea40e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea3c158f80 0x7fea3c0ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:13.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.766+0000 7fea41800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fea3c0cf280 0x7fea3c0ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:13.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.767+0000 7fea41800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fea3c0cf280 0x7fea3c0ade50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:53358/0 (socket says 172.21.15.106:53358) 2024-08-17T02:31:13.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.767+0000 7fea40e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea3c158f80 0x7fea3c0ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.106:52796/0 (socket says 172.21.15.106:52796) 2024-08-17T02:31:13.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.767+0000 7fea41800640 1 -- 172.21.15.106:0/1058353266 learned_addr learned my addr 172.21.15.106:0/1058353266 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:13.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.766+0000 7fea3be00640 1 --1- 172.21.15.106:0/1058353266 >> v1:172.21.15.171:6789/0 conn(0x7fea3c159350 0x7fea3c0cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:42086/0 (socket says 172.21.15.106:42086) 2024-08-17T02:31:13.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.767+0000 7fea41800640 1 -- 172.21.15.106:0/1058353266 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea3c158f80 msgr2=0x7fea3c0ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:13.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.767+0000 7fea41800640 1 --2- 172.21.15.106:0/1058353266 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea3c158f80 0x7fea3c0ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:13.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.767+0000 7fea41800640 1 -- 172.21.15.106:0/1058353266 >> v1:172.21.15.171:6789/0 conn(0x7fea3c159350 legacy=0x7fea3c0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:13.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.767+0000 7fea41800640 1 -- 172.21.15.106:0/1058353266 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3c0caf10 con 0x7fea3c0cf280 2024-08-17T02:31:13.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.767+0000 7fea3b400640 1 -- 172.21.15.106:0/1058353266 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889417754 0 0) 0x7fea3c0cb560 con 0x7fea3c159350 2024-08-17T02:31:13.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.767+0000 7fea40e00640 1 --2- 172.21.15.106:0/1058353266 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea3c158f80 0x7fea3c0ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:31:13.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.768+0000 7fea41800640 1 --2- 172.21.15.106:0/1058353266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea3c0cf280 0x7fea3c0ade50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fea34009f20 tx=0x7fea34009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf2ccca92fb0b6c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:13.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.768+0000 7fea3b400640 1 -- 172.21.15.106:0/1058353266 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea34031400 con 0x7fea3c0cf280 2024-08-17T02:31:13.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.768+0000 7fea3b400640 1 -- 172.21.15.106:0/1058353266 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3402d050 con 0x7fea3c0cf280 2024-08-17T02:31:13.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.768+0000 7fea3b400640 1 -- 172.21.15.106:0/1058353266 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea34031790 con 0x7fea3c0cf280 2024-08-17T02:31:13.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.769+0000 7fea43800640 1 -- 172.21.15.106:0/1058353266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea3c0cf280 msgr2=0x7fea3c0ade50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:13.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.769+0000 7fea43800640 1 --2- 172.21.15.106:0/1058353266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea3c0cf280 0x7fea3c0ade50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fea34009f20 tx=0x7fea34009840 comp rx=0 tx=0).stop 2024-08-17T02:31:13.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.769+0000 7fea43800640 1 -- 172.21.15.106:0/1058353266 shutdown_connections 2024-08-17T02:31:13.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.769+0000 7fea43800640 1 --2- 172.21.15.106:0/1058353266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea3c0cf280 0x7fea3c0ade50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:13.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.769+0000 7fea43800640 1 --2- 172.21.15.106:0/1058353266 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea3c158f80 0x7fea3c0ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:13.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.769+0000 7fea43800640 1 -- 172.21.15.106:0/1058353266 >> 172.21.15.106:0/1058353266 conn(0x7fea3c0cfd90 msgr2=0x7fea3c0d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:13.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.769+0000 7fea43800640 1 -- 172.21.15.106:0/1058353266 shutdown_connections 2024-08-17T02:31:13.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.769+0000 7fea43800640 1 -- 172.21.15.106:0/1058353266 wait complete. 2024-08-17T02:31:13.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.771+0000 7fea43800640 1 Processor -- start 2024-08-17T02:31:13.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.771+0000 7fea43800640 1 -- start start 2024-08-17T02:31:13.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.772+0000 7fea43800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea3c0cf280 0x7fea3c0b5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:13.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.772+0000 7fea43800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea3c158f80 0x7fea3c15ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:13.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.772+0000 7fea43800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea3c159350 0x7fea3c0b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:13.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.772+0000 7fea43800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c15daa0 con 0x7fea3c159350 2024-08-17T02:31:13.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.772+0000 7fea43800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c15a260 con 0x7fea3c0cf280 2024-08-17T02:31:13.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.772+0000 7fea43800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c15f220 con 0x7fea3c158f80 2024-08-17T02:31:13.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.772+0000 7fea41800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea3c159350 0x7fea3c0b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:13.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.772+0000 7fea40e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea3c0cf280 0x7fea3c0b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:13.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.772+0000 7fea3be00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea3c158f80 0x7fea3c15ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:13.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.772+0000 7fea40e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea3c0cf280 0x7fea3c0b5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.106:53374/0 (socket says 172.21.15.106:53374) 2024-08-17T02:31:13.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.772+0000 7fea40e00640 1 -- 172.21.15.106:0/4238319255 learned_addr learned my addr 172.21.15.106:0/4238319255 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:13.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.772+0000 7fea41800640 1 -- 172.21.15.106:0/4238319255 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea3c158f80 msgr2=0x7fea3c15ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:13.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.772+0000 7fea41800640 1 --2- 172.21.15.106:0/4238319255 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea3c158f80 0x7fea3c15ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:13.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.772+0000 7fea41800640 1 -- 172.21.15.106:0/4238319255 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea3c0cf280 msgr2=0x7fea3c0b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:13.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.772+0000 7fea41800640 1 --2- 172.21.15.106:0/4238319255 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea3c0cf280 0x7fea3c0b5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:13.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.772+0000 7fea41800640 1 -- 172.21.15.106:0/4238319255 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea30009390 con 0x7fea3c159350 2024-08-17T02:31:13.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.772+0000 7fea40e00640 1 --2- 172.21.15.106:0/4238319255 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea3c0cf280 0x7fea3c0b5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:31:13.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.773+0000 7fea41800640 1 --2- 172.21.15.106:0/4238319255 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea3c159350 0x7fea3c0b35e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fea34030000 tx=0x7fea34036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:13.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.773+0000 7fea2fe00640 1 -- 172.21.15.106:0/4238319255 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea34007760 con 0x7fea3c159350 2024-08-17T02:31:13.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.773+0000 7fea2fe00640 1 -- 172.21.15.106:0/4238319255 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea340078e0 con 0x7fea3c159350 2024-08-17T02:31:13.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.773+0000 7fea43800640 1 -- 172.21.15.106:0/4238319255 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea34009ae0 con 0x7fea3c159350 2024-08-17T02:31:13.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.773+0000 7fea2fe00640 1 -- 172.21.15.106:0/4238319255 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea34007ca0 con 0x7fea3c159350 2024-08-17T02:31:13.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.773+0000 7fea43800640 1 -- 172.21.15.106:0/4238319255 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea3c159930 con 0x7fea3c159350 2024-08-17T02:31:13.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.774+0000 7fea43800640 1 -- 172.21.15.106:0/4238319255 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea3c064db0 con 0x7fea3c159350 2024-08-17T02:31:13.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.775+0000 7fea2fe00640 1 -- 172.21.15.106:0/4238319255 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fea3403c630 con 0x7fea3c159350 2024-08-17T02:31:13.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.775+0000 7fea2fe00640 1 --2- 172.21.15.106:0/4238319255 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fea1c065150 0x7fea1c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:13.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.776+0000 7fea2fe00640 1 -- 172.21.15.106:0/4238319255 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fea340a3250 con 0x7fea3c159350 2024-08-17T02:31:13.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.776+0000 7fea40e00640 1 --2- 172.21.15.106:0/4238319255 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fea1c065150 0x7fea1c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:13.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.776+0000 7fea40e00640 1 --2- 172.21.15.106:0/4238319255 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fea1c065150 0x7fea1c067600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fea30009fd0 tx=0x7fea300090f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:13.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.780+0000 7fea2fe00640 1 -- 172.21.15.106:0/4238319255 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fea340715c0 con 0x7fea3c159350 2024-08-17T02:31:13.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.948+0000 7fea43800640 1 -- 172.21.15.106:0/4238319255 --> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fea3c15a3a0 con 0x7fea1c065150 2024-08-17T02:31:13.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.951+0000 7fea2fe00640 1 -- 172.21.15.106:0/4238319255 <== mgr.4107 v2:172.21.15.106:6832/36860 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50687 (secure 0 0 0) 0x7fea3c15a3a0 con 0x7fea1c065150 2024-08-17T02:31:13.951 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:31:13.952 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-08-17T02:31:13.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.953+0000 7fea43800640 1 -- 172.21.15.106:0/4238319255 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fea1c065150 msgr2=0x7fea1c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:13.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.953+0000 7fea43800640 1 --2- 172.21.15.106:0/4238319255 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fea1c065150 0x7fea1c067600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fea30009fd0 tx=0x7fea300090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:13.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.953+0000 7fea43800640 1 -- 172.21.15.106:0/4238319255 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea3c159350 msgr2=0x7fea3c0b35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:13.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.953+0000 7fea43800640 1 --2- 172.21.15.106:0/4238319255 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea3c159350 0x7fea3c0b35e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fea34030000 tx=0x7fea34036000 comp rx=0 tx=0).stop 2024-08-17T02:31:13.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.953+0000 7fea43800640 1 -- 172.21.15.106:0/4238319255 shutdown_connections 2024-08-17T02:31:13.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.953+0000 7fea43800640 1 --2- 172.21.15.106:0/4238319255 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fea1c065150 0x7fea1c067600 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:13.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.953+0000 7fea43800640 1 --2- 172.21.15.106:0/4238319255 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea3c159350 0x7fea3c0b35e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:13.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.953+0000 7fea43800640 1 --2- 172.21.15.106:0/4238319255 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fea3c158f80 0x7fea3c15ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:13.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.953+0000 7fea43800640 1 --2- 172.21.15.106:0/4238319255 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fea3c0cf280 0x7fea3c0b5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:13.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.953+0000 7fea43800640 1 -- 172.21.15.106:0/4238319255 >> 172.21.15.106:0/4238319255 conn(0x7fea3c0cfd90 msgr2=0x7fea3c0ace00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:13.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.953+0000 7fea43800640 1 -- 172.21.15.106:0/4238319255 shutdown_connections 2024-08-17T02:31:13.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:13.953+0000 7fea43800640 1 -- 172.21.15.106:0/4238319255 wait complete. 2024-08-17T02:31:13.969 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2024-08-17T02:31:13.925472+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2388200,"kb_used_data":5160,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586520,"statfs":{"total":773094113280,"available":770648596480,"internally_reserved":0,"allocated":5283840,"data_stored":2894536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.005348"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":183,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:31:09.705640+0000","last_change":"2024-08-17T02:27:39.552321+0000","last_active":"2024-08-17T02:31:09.705640+0000","last_peered":"2024-08-17T02:31:09.705640+0000","last_clean":"2024-08-17T02:31:09.705640+0000","last_became_active":"2024-08-17T02:27:39.551203+0000","last_became_peered":"2024-08-17T02:27:39.551203+0000","last_unstale":"2024-08-17T02:31:09.705640+0000","last_undegraded":"2024-08-17T02:31:09.705640+0000","last_fullsized":"2024-08-17T02:31:09.705640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.155679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.155679+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.155679+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:02.785032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1105920,"data_stored":804593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.71399999999999997,"15min":0.69399999999999995},"min":{"1min":0.55500000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93000000000000005,"5min":1.03,"15min":1.03},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.72299999999999998,"15min":0.70699999999999996},"min":{"1min":0.57099999999999995,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.877,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.623}]},{"osd":1,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69599999999999995,"15min":0.68799999999999994},"min":{"1min":0.53200000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89200000000000002,"5min":1.536,"15min":1.536},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.85499999999999998,"15min":0.91800000000000004},"min":{"1min":0.56399999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.878,"5min":6.819,"15min":6.819},"last":0.41999999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.67600000000000005,"15min":0.66300000000000003},"min":{"1min":0.52900000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71199999999999997,"15min":0.70599999999999996},"min":{"1min":0.58799999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91500000000000004,"5min":1.081,"15min":1.081},"last":0.58799999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.69599999999999995,"15min":0.68899999999999995},"min":{"1min":0.625,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.86299999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70499999999999996,"15min":0.69899999999999995},"min":{"1min":0.48899999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.67500000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.622,"15min":0.63800000000000001},"min":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91200000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.65000000000000002,"15min":0.66200000000000003},"min":{"1min":0.48999999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93100000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.65400000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.65700000000000003,"15min":0.67300000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.69799999999999995,"15min":0.72599999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.875,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.56799999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.77200000000000002,"15min":0.79400000000000004},"min":{"1min":0.52400000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96399999999999997,"5min":1.095,"15min":1.095},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.745,"15min":0.76800000000000002},"min":{"1min":0.54900000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89300000000000002,"5min":1.002,"15min":1.002},"last":0.60099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67600000000000005,"15min":0.67300000000000004},"min":{"1min":0.52000000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.94899999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66900000000000004,"15min":0.67700000000000005},"min":{"1min":0.439,"5min":0.435,"15min":0.435},"max":{"1min":0.81699999999999995,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.77000000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64300000000000002,"15min":0.63800000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83099999999999996,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71099999999999997,"15min":0.71599999999999997},"min":{"1min":0.54700000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.92000000000000004,"5min":1.032,"15min":1.032},"last":0.61599999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.57699999999999996,"5min":0.432,"15min":0.432},"max":{"1min":0.90900000000000003,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76400000000000001,"15min":0.78000000000000003},"min":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.88700000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.76200000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.55900000000000005,"5min":0.502,"15min":0.502},"max":{"1min":0.85499999999999998,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.754,"15min":0.76200000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.86799999999999999,"5min":1.123,"15min":1.123},"last":0.65700000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.65300000000000002,"15min":0.69099999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.67700000000000005,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.64900000000000002,"15min":0.67700000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.79400000000000004,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.63400000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.65900000000000003,"15min":0.68700000000000006},"min":{"1min":0.45900000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.81100000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.72999999999999998,"15min":0.76800000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91200000000000003,"5min":1.075,"15min":1.075},"last":0.81299999999999994}]},{"osd":7,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.71599999999999997,"15min":0.74299999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84899999999999998,"5min":1.157,"15min":1.157},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.78300000000000003,"15min":0.80500000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.89700000000000002,"5min":1.038,"15min":1.038},"last":0.86899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84299999999999997,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.623},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.67400000000000004,"15min":0.65600000000000003},"min":{"1min":0.41999999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85599999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.48899999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.67700000000000005,"15min":0.68500000000000005},"min":{"1min":0.48699999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.871,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.68600000000000005,"15min":0.67000000000000004},"min":{"1min":0.52800000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88400000000000001,"5min":1.327,"15min":1.327},"last":0.67200000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.65200000000000002,"15min":0.63300000000000001},"min":{"1min":0.502,"5min":0.433,"15min":0.433},"max":{"1min":0.89100000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86199999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.50700000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69699999999999995,"15min":0.70399999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.84299999999999997,"5min":1.048,"15min":1.048},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69099999999999995,"15min":0.67700000000000005},"min":{"1min":0.432,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84199999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.53400000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.59299999999999997,"15min":0.625},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.63,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.61099999999999999,"15min":0.629},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.61399999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.64300000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.63400000000000001,"15min":0.66200000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82799999999999996,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.72199999999999998,"15min":0.746},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.85599999999999998,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.70799999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.68400000000000005,"15min":0.69599999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.81999999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.70899999999999996,"15min":0.72999999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.80800000000000005,"5min":1.046,"15min":1.046},"last":0.65600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.63,"15min":0.60699999999999998},"min":{"1min":0.53800000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.628,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.88,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.51000000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.66800000000000004,"15min":0.64500000000000002},"min":{"1min":0.55500000000000005,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89300000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.65600000000000003,"15min":0.64200000000000002},"min":{"1min":0.49099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.60599999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.67800000000000005,"15min":0.65300000000000002},"min":{"1min":0.63,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.96099999999999997,"5min":1.034,"15min":1.034},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.71999999999999997,"15min":0.71099999999999997},"min":{"1min":0.63700000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.624}]},{"osd":3,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.69899999999999995,"15min":0.68300000000000005},"min":{"1min":0.65900000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85599999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.73299999999999998,"15min":0.72099999999999997},"min":{"1min":0.65800000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.94099999999999995,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.65600000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.60799999999999998,"15min":0.63400000000000001},"min":{"1min":0.41399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.65100000000000002,"15min":0.67400000000000004},"min":{"1min":0.48699999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.68300000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.54300000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.69899999999999995,"15min":0.71299999999999997},"min":{"1min":0.46200000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.82999999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.72699999999999998,"15min":0.751},"min":{"1min":0.49099999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.79400000000000004,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.64400000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.71199999999999997,"15min":0.72399999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.84899999999999998,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.76300000000000001,"15min":0.79300000000000004},"min":{"1min":0.51600000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.89800000000000002,"5min":1.018,"15min":1.018},"last":0.67700000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41899999999999998,"15min":0.41799999999999998},"min":{"1min":0.29699999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.58099999999999996,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46200000000000002,"15min":0.46999999999999997},"min":{"1min":0.32600000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.70899999999999996,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.35199999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.45700000000000002,"15min":0.45500000000000002},"min":{"1min":0.40699999999999997,"5min":0.307,"15min":0.307},"max":{"1min":0.60599999999999998,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.34799999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70099999999999996,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.41299999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55700000000000005,"15min":0.56100000000000005},"min":{"1min":0.40000000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75600000000000001,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.79400000000000004,"5min":1.974,"15min":1.974},"last":0.497}]},{"osd":4,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.745,"15min":0.72499999999999998},"min":{"1min":0.61199999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.77200000000000002,"15min":0.76200000000000001},"min":{"1min":0.626,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2270000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.753}]},{"osd":5,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.77700000000000002,"15min":0.76500000000000001},"min":{"1min":0.55100000000000005,"5min":0.434,"15min":0.434},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.75,"15min":0.72799999999999998},"min":{"1min":0.63700000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.73899999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.77000000000000002,"15min":0.748},"min":{"1min":0.61899999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.78500000000000003,"15min":0.77100000000000002},"min":{"1min":0.58899999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.72699999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.56599999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.78400000000000003,"15min":0.76600000000000001},"min":{"1min":0.64700000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.83999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.39700000000000002,"15min":0.39000000000000001},"min":{"1min":0.30099999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.60699999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.443},{"interface":"front","average":{"1min":0.439,"5min":0.45200000000000001,"15min":0.44900000000000001},"min":{"1min":0.28499999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.66600000000000004,"5min":1.415,"15min":1.415},"last":0.42999999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55000000000000004,"15min":0.54100000000000004},"min":{"1min":0.441,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.74399999999999999,"5min":1.456,"15min":1.456},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.44400000000000001},"min":{"1min":0.34200000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.64100000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.55100000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.50600000000000001,"15min":0.51900000000000002},"min":{"1min":0.34999999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.65600000000000003,"5min":1.95,"15min":1.95},"last":0.5},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56200000000000006,"15min":0.57199999999999995},"min":{"1min":0.436,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.748,"5min":1.946,"15min":1.946},"last":0.58299999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72199999999999998,"15min":0.73199999999999998},"min":{"1min":0.498,"5min":0.379,"15min":0.379},"max":{"1min":0.97999999999999998,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76800000000000002,"15min":0.79000000000000004},"min":{"1min":0.55600000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88400000000000001,"5min":1.859,"15min":1.859},"last":0.82899999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.53500000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93100000000000005,"5min":1.722,"15min":1.722},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.745,"15min":0.76800000000000002},"min":{"1min":0.53100000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91400000000000003,"5min":1.889,"15min":1.889},"last":0.80500000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.76300000000000001,"15min":0.77800000000000002},"min":{"1min":0.58999999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95699999999999996,"5min":1.788,"15min":1.788},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.77400000000000002,"15min":0.78600000000000003},"min":{"1min":0.61899999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0409999999999999,"5min":1.889,"15min":1.889},"last":0.95499999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.83799999999999997,"15min":0.85599999999999998},"min":{"1min":0.68100000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0049999999999999,"5min":1.919,"15min":1.919},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.82799999999999996,"15min":0.85499999999999998},"min":{"1min":0.56599999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.98199999999999998,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.96999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.44800000000000001,"15min":0.45600000000000002},"min":{"1min":0.307,"5min":0.249,"15min":0.249},"max":{"1min":0.67900000000000005,"5min":1.284,"15min":1.284},"last":0.309},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.47399999999999998,"15min":0.48099999999999998},"min":{"1min":0.33900000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59699999999999998,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.443}]},{"osd":2,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.45400000000000001,"15min":0.44400000000000001},"min":{"1min":0.372,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.60399999999999998,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.499,"15min":0.495},"min":{"1min":0.40500000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.67000000000000004,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.41899999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55400000000000005,"15min":0.54700000000000004},"min":{"1min":0.45100000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.752,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.54900000000000004,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63500000000000001,"5min":2.617,"15min":2.617},"last":0.39800000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72099999999999997,"15min":0.70399999999999996},"min":{"1min":0.55100000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97999999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.59099999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.99399999999999999,"5min":1.056,"15min":1.056},"last":0.77800000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79700000000000004,"15min":0.80700000000000005},"min":{"1min":0.60599999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.034,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.747},{"interface":"front","average":{"1min":0.751,"5min":0.78700000000000003,"15min":0.79700000000000004},"min":{"1min":0.56799999999999995,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0569999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.72399999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.82299999999999995,"15min":0.83899999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1100000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.77500000000000002,"15min":0.77300000000000002},"min":{"1min":0.628,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.02,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.80400000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79100000000000004,"15min":0.79600000000000004},"min":{"1min":0.627,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96499999999999997,"5min":1.218,"15min":1.218},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.84699999999999998,"15min":0.86899999999999999},"min":{"1min":0.55900000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0820000000000001,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.77200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298440,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073400,"statfs":{"total":96636764160,"available":96331161600,"internally_reserved":0,"allocated":1105920,"data_stored":804593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.32800000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52800000000000002,"15min":0.52000000000000002},"min":{"1min":0.435,"5min":0.377,"15min":0.377},"max":{"1min":0.75600000000000001,"5min":1.03,"15min":1.03},"last":0.52500000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.48599999999999999},"min":{"1min":0.36899999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.64900000000000002,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.47599999999999998,"15min":0.45900000000000002},"min":{"1min":0.39400000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70299999999999996,"5min":0.755,"15min":0.755},"last":0.48999999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.47199999999999998,"15min":0.45700000000000002},"min":{"1min":0.38200000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.71199999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.45400000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.67000000000000004,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.754,"15min":0.75},"min":{"1min":0.60899999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.004,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.76700000000000002,"15min":0.76000000000000001},"min":{"1min":0.61699999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0409999999999999,"5min":1.24,"15min":1.24},"last":0.72399999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.74199999999999999,"15min":0.71099999999999997},"min":{"1min":0.61499999999999999,"5min":0.501,"15min":0.501},"max":{"1min":0.99199999999999999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76600000000000001,"15min":0.76800000000000002},"min":{"1min":0.59499999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95899999999999996,"5min":1.212,"15min":1.212},"last":0.68600000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.77600000000000002,"15min":0.77100000000000002},"min":{"1min":0.627,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95099999999999996,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.78200000000000003,"15min":0.77900000000000003},"min":{"1min":0.625,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0900000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":5.4939999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.78600000000000003,"15min":0.78400000000000003},"min":{"1min":0.64700000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0189999999999999,"5min":1.286,"15min":1.286},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78500000000000003,"15min":0.77900000000000003},"min":{"1min":0.61899999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.93899999999999995,"5min":1.234,"15min":1.234},"last":0.67100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:31:13.971 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:31:14.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.118+0000 7fe829600640 1 Processor -- start 2024-08-17T02:31:14.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.119+0000 7fe829600640 1 -- start start 2024-08-17T02:31:14.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.120+0000 7fe829600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe8240b0270 0x7fe8241563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:14.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.120+0000 7fe829600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe824157690 con 0x7fe824155900 2024-08-17T02:31:14.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.120+0000 7fe829600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe824156a80 con 0x7fe824158b30 2024-08-17T02:31:14.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.120+0000 7fe829600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe824156d60 con 0x7fe8240b0270 2024-08-17T02:31:14.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.120+0000 7fe823e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe824155900 0x7fe824155cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50490/0 (socket says 172.21.15.106:50490) 2024-08-17T02:31:14.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.120+0000 7fe823e00640 1 -- 172.21.15.106:0/87040303 learned_addr learned my addr 172.21.15.106:0/87040303 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:31:14.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.120+0000 7fe81b400640 1 --2- 172.21.15.106:0/87040303 >> v2:172.21.15.106:3300/0 conn(0x7fe8240b0270 0x7fe8241563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:14.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.120+0000 7fe823400640 1 -- 172.21.15.106:0/87040303 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3880533172 0 0) 0x7fe824157690 con 0x7fe824155900 2024-08-17T02:31:14.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.121+0000 7fe823400640 1 -- 172.21.15.106:0/87040303 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8080034e0 con 0x7fe824155900 2024-08-17T02:31:14.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.121+0000 7fe81b400640 1 -- 172.21.15.106:0/87040303 >> v1:172.21.15.171:6789/0 conn(0x7fe824158b30 legacy=0x7fe8240ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:14.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.121+0000 7fe81b400640 1 -- 172.21.15.106:0/87040303 >> v1:172.21.15.106:6789/0 conn(0x7fe824155900 legacy=0x7fe824155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:14.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.121+0000 7fe81b400640 1 -- 172.21.15.106:0/87040303 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe824157040 con 0x7fe8240b0270 2024-08-17T02:31:14.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.122+0000 7fe81b400640 1 --2- 172.21.15.106:0/87040303 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8240b0270 0x7fe8241563e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009850 tx=0x7fe80c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777a4dc01f257c4c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:14.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.122+0000 7fe823400640 1 -- 172.21.15.106:0/87040303 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c02ae20 con 0x7fe8240b0270 2024-08-17T02:31:14.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.122+0000 7fe823400640 1 -- 172.21.15.106:0/87040303 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80c032440 con 0x7fe8240b0270 2024-08-17T02:31:14.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.122+0000 7fe823400640 1 -- 172.21.15.106:0/87040303 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c0327e0 con 0x7fe8240b0270 2024-08-17T02:31:14.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.122+0000 7fe829600640 1 -- 172.21.15.106:0/87040303 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8240b0270 msgr2=0x7fe8241563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:14.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.122+0000 7fe829600640 1 --2- 172.21.15.106:0/87040303 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8240b0270 0x7fe8241563e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009850 tx=0x7fe80c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:14.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.122+0000 7fe829600640 1 -- 172.21.15.106:0/87040303 shutdown_connections 2024-08-17T02:31:14.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.122+0000 7fe829600640 1 --2- 172.21.15.106:0/87040303 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8240b0270 0x7fe8241563e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:14.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.122+0000 7fe829600640 1 -- 172.21.15.106:0/87040303 >> 172.21.15.106:0/87040303 conn(0x7fe824067750 msgr2=0x7fe8240cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:14.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.123+0000 7fe829600640 1 -- 172.21.15.106:0/87040303 shutdown_connections 2024-08-17T02:31:14.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.123+0000 7fe829600640 1 -- 172.21.15.106:0/87040303 wait complete. 2024-08-17T02:31:14.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.124+0000 7fe829600640 1 Processor -- start 2024-08-17T02:31:14.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.124+0000 7fe829600640 1 -- start start 2024-08-17T02:31:14.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.125+0000 7fe829600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8240b0270 0x7fe82414b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:14.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.125+0000 7fe829600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe824155900 0x7fe8240a6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:14.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.125+0000 7fe829600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe824158b30 0x7fe8240a6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:14.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.125+0000 7fe829600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8240c99d0 con 0x7fe824158b30 2024-08-17T02:31:14.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.125+0000 7fe829600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8240c9cb0 con 0x7fe8240b0270 2024-08-17T02:31:14.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.125+0000 7fe829600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8240c9f90 con 0x7fe824155900 2024-08-17T02:31:14.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.125+0000 7fe828c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe824158b30 0x7fe8240a6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:14.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.125+0000 7fe828c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe824158b30 0x7fe8240a6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34656/0 (socket says 172.21.15.106:34656) 2024-08-17T02:31:14.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.125+0000 7fe828c00640 1 -- 172.21.15.106:0/3465595820 learned_addr learned my addr 172.21.15.106:0/3465595820 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:14.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.125+0000 7fe823e00640 1 --2- 172.21.15.106:0/3465595820 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8240b0270 0x7fe82414b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:14.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.125+0000 7fe81b400640 1 --2- 172.21.15.106:0/3465595820 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe824155900 0x7fe8240a6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:14.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.126+0000 7fe828c00640 1 -- 172.21.15.106:0/3465595820 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe824155900 msgr2=0x7fe8240a6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:14.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.126+0000 7fe828c00640 1 --2- 172.21.15.106:0/3465595820 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe824155900 0x7fe8240a6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:14.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.126+0000 7fe828c00640 1 -- 172.21.15.106:0/3465595820 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8240b0270 msgr2=0x7fe82414b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:14.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.126+0000 7fe828c00640 1 --2- 172.21.15.106:0/3465595820 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8240b0270 0x7fe82414b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:14.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.126+0000 7fe828c00640 1 -- 172.21.15.106:0/3465595820 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c009390 con 0x7fe824158b30 2024-08-17T02:31:14.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.126+0000 7fe828c00640 1 --2- 172.21.15.106:0/3465595820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe824158b30 0x7fe8240a6a40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe81c00c7c0 tx=0x7fe81c0015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:14.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.126+0000 7fe81be00640 1 -- 172.21.15.106:0/3465595820 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c00a6d0 con 0x7fe824158b30 2024-08-17T02:31:14.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.126+0000 7fe81be00640 1 -- 172.21.15.106:0/3465595820 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81c00a850 con 0x7fe824158b30 2024-08-17T02:31:14.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.126+0000 7fe81be00640 1 -- 172.21.15.106:0/3465595820 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c00ac10 con 0x7fe824158b30 2024-08-17T02:31:14.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.126+0000 7fe829600640 1 -- 172.21.15.106:0/3465595820 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8240ca270 con 0x7fe824158b30 2024-08-17T02:31:14.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.126+0000 7fe829600640 1 -- 172.21.15.106:0/3465595820 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8240ca830 con 0x7fe824158b30 2024-08-17T02:31:14.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.127+0000 7fe829600640 1 -- 172.21.15.106:0/3465595820 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe824071050 con 0x7fe824158b30 2024-08-17T02:31:14.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.128+0000 7fe81be00640 1 -- 172.21.15.106:0/3465595820 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe81c003030 con 0x7fe824158b30 2024-08-17T02:31:14.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.129+0000 7fe81be00640 1 --2- 172.21.15.106:0/3465595820 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe800065150 0x7fe800067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:14.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.129+0000 7fe81be00640 1 -- 172.21.15.106:0/3465595820 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fe81c0821f0 con 0x7fe824158b30 2024-08-17T02:31:14.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.129+0000 7fe823e00640 1 --2- 172.21.15.106:0/3465595820 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe800065150 0x7fe800067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:14.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.130+0000 7fe823e00640 1 --2- 172.21.15.106:0/3465595820 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe800065150 0x7fe800067600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe814005840 tx=0x7fe814009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:14.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.133+0000 7fe81be00640 1 -- 172.21.15.106:0/3465595820 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe81c0504b0 con 0x7fe824158b30 2024-08-17T02:31:14.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.301+0000 7fe829600640 1 -- 172.21.15.106:0/3465595820 --> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe82406f480 con 0x7fe800065150 2024-08-17T02:31:14.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.303+0000 7fe81be00640 1 -- 172.21.15.106:0/3465595820 <== mgr.4107 v2:172.21.15.106:6832/36860 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50687 (secure 0 0 0) 0x7fe82406f480 con 0x7fe800065150 2024-08-17T02:31:14.304 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:31:14.305 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-08-17T02:31:14.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.305+0000 7fe829600640 1 -- 172.21.15.106:0/3465595820 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe800065150 msgr2=0x7fe800067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:14.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.305+0000 7fe829600640 1 --2- 172.21.15.106:0/3465595820 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe800065150 0x7fe800067600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe814005840 tx=0x7fe814009040 comp rx=0 tx=0).stop 2024-08-17T02:31:14.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.305+0000 7fe829600640 1 -- 172.21.15.106:0/3465595820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe824158b30 msgr2=0x7fe8240a6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:14.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.305+0000 7fe829600640 1 --2- 172.21.15.106:0/3465595820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe824158b30 0x7fe8240a6a40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe81c00c7c0 tx=0x7fe81c0015f0 comp rx=0 tx=0).stop 2024-08-17T02:31:14.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.306+0000 7fe829600640 1 -- 172.21.15.106:0/3465595820 shutdown_connections 2024-08-17T02:31:14.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.306+0000 7fe829600640 1 --2- 172.21.15.106:0/3465595820 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe800065150 0x7fe800067600 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:14.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.306+0000 7fe829600640 1 --2- 172.21.15.106:0/3465595820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe824158b30 0x7fe8240a6a40 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:14.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.306+0000 7fe829600640 1 --2- 172.21.15.106:0/3465595820 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe824155900 0x7fe8240a6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:14.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.306+0000 7fe829600640 1 --2- 172.21.15.106:0/3465595820 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8240b0270 0x7fe82414b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:14.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.306+0000 7fe829600640 1 -- 172.21.15.106:0/3465595820 >> 172.21.15.106:0/3465595820 conn(0x7fe824067750 msgr2=0x7fe82406d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:14.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.306+0000 7fe829600640 1 -- 172.21.15.106:0/3465595820 shutdown_connections 2024-08-17T02:31:14.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.306+0000 7fe829600640 1 -- 172.21.15.106:0/3465595820 wait complete. 2024-08-17T02:31:14.321 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2024-08-17T02:31:13.925472+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2388200,"kb_used_data":5160,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586520,"statfs":{"total":773094113280,"available":770648596480,"internally_reserved":0,"allocated":5283840,"data_stored":2894536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.005348"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":183,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:31:09.705640+0000","last_change":"2024-08-17T02:27:39.552321+0000","last_active":"2024-08-17T02:31:09.705640+0000","last_peered":"2024-08-17T02:31:09.705640+0000","last_clean":"2024-08-17T02:31:09.705640+0000","last_became_active":"2024-08-17T02:27:39.551203+0000","last_became_peered":"2024-08-17T02:27:39.551203+0000","last_unstale":"2024-08-17T02:31:09.705640+0000","last_undegraded":"2024-08-17T02:31:09.705640+0000","last_fullsized":"2024-08-17T02:31:09.705640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.155679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.155679+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.155679+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:02.785032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1105920,"data_stored":804593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.71399999999999997,"15min":0.69399999999999995},"min":{"1min":0.55500000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93000000000000005,"5min":1.03,"15min":1.03},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.72299999999999998,"15min":0.70699999999999996},"min":{"1min":0.57099999999999995,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.877,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.623}]},{"osd":1,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69599999999999995,"15min":0.68799999999999994},"min":{"1min":0.53200000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89200000000000002,"5min":1.536,"15min":1.536},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.85499999999999998,"15min":0.91800000000000004},"min":{"1min":0.56399999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.878,"5min":6.819,"15min":6.819},"last":0.41999999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.67600000000000005,"15min":0.66300000000000003},"min":{"1min":0.52900000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71199999999999997,"15min":0.70599999999999996},"min":{"1min":0.58799999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91500000000000004,"5min":1.081,"15min":1.081},"last":0.58799999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.69599999999999995,"15min":0.68899999999999995},"min":{"1min":0.625,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.86299999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70499999999999996,"15min":0.69899999999999995},"min":{"1min":0.48899999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.67500000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.622,"15min":0.63800000000000001},"min":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91200000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.65000000000000002,"15min":0.66200000000000003},"min":{"1min":0.48999999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93100000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.65400000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.65700000000000003,"15min":0.67300000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.69799999999999995,"15min":0.72599999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.875,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.56799999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.77200000000000002,"15min":0.79400000000000004},"min":{"1min":0.52400000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96399999999999997,"5min":1.095,"15min":1.095},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.745,"15min":0.76800000000000002},"min":{"1min":0.54900000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89300000000000002,"5min":1.002,"15min":1.002},"last":0.60099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67600000000000005,"15min":0.67300000000000004},"min":{"1min":0.52000000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.94899999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66900000000000004,"15min":0.67700000000000005},"min":{"1min":0.439,"5min":0.435,"15min":0.435},"max":{"1min":0.81699999999999995,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.77000000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64300000000000002,"15min":0.63800000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83099999999999996,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71099999999999997,"15min":0.71599999999999997},"min":{"1min":0.54700000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.92000000000000004,"5min":1.032,"15min":1.032},"last":0.61599999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.57699999999999996,"5min":0.432,"15min":0.432},"max":{"1min":0.90900000000000003,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76400000000000001,"15min":0.78000000000000003},"min":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.88700000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.76200000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.55900000000000005,"5min":0.502,"15min":0.502},"max":{"1min":0.85499999999999998,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.754,"15min":0.76200000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.86799999999999999,"5min":1.123,"15min":1.123},"last":0.65700000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.65300000000000002,"15min":0.69099999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.67700000000000005,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.64900000000000002,"15min":0.67700000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.79400000000000004,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.63400000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.65900000000000003,"15min":0.68700000000000006},"min":{"1min":0.45900000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.81100000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.72999999999999998,"15min":0.76800000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91200000000000003,"5min":1.075,"15min":1.075},"last":0.81299999999999994}]},{"osd":7,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.71599999999999997,"15min":0.74299999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84899999999999998,"5min":1.157,"15min":1.157},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.78300000000000003,"15min":0.80500000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.89700000000000002,"5min":1.038,"15min":1.038},"last":0.86899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84299999999999997,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.623},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.67400000000000004,"15min":0.65600000000000003},"min":{"1min":0.41999999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85599999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.48899999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.67700000000000005,"15min":0.68500000000000005},"min":{"1min":0.48699999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.871,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.68600000000000005,"15min":0.67000000000000004},"min":{"1min":0.52800000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88400000000000001,"5min":1.327,"15min":1.327},"last":0.67200000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.65200000000000002,"15min":0.63300000000000001},"min":{"1min":0.502,"5min":0.433,"15min":0.433},"max":{"1min":0.89100000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86199999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.50700000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69699999999999995,"15min":0.70399999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.84299999999999997,"5min":1.048,"15min":1.048},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69099999999999995,"15min":0.67700000000000005},"min":{"1min":0.432,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84199999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.53400000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.59299999999999997,"15min":0.625},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.63,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.61099999999999999,"15min":0.629},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.61399999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.64300000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.63400000000000001,"15min":0.66200000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82799999999999996,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.72199999999999998,"15min":0.746},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.85599999999999998,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.70799999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.68400000000000005,"15min":0.69599999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.81999999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.70899999999999996,"15min":0.72999999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.80800000000000005,"5min":1.046,"15min":1.046},"last":0.65600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.63,"15min":0.60699999999999998},"min":{"1min":0.53800000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.628,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.88,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.51000000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.66800000000000004,"15min":0.64500000000000002},"min":{"1min":0.55500000000000005,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89300000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.65600000000000003,"15min":0.64200000000000002},"min":{"1min":0.49099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.60599999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.67800000000000005,"15min":0.65300000000000002},"min":{"1min":0.63,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.96099999999999997,"5min":1.034,"15min":1.034},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.71999999999999997,"15min":0.71099999999999997},"min":{"1min":0.63700000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.624}]},{"osd":3,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.69899999999999995,"15min":0.68300000000000005},"min":{"1min":0.65900000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85599999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.73299999999999998,"15min":0.72099999999999997},"min":{"1min":0.65800000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.94099999999999995,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.65600000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.60799999999999998,"15min":0.63400000000000001},"min":{"1min":0.41399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.65100000000000002,"15min":0.67400000000000004},"min":{"1min":0.48699999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.68300000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.54300000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.69899999999999995,"15min":0.71299999999999997},"min":{"1min":0.46200000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.82999999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.72699999999999998,"15min":0.751},"min":{"1min":0.49099999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.79400000000000004,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.64400000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.71199999999999997,"15min":0.72399999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.84899999999999998,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.76300000000000001,"15min":0.79300000000000004},"min":{"1min":0.51600000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.89800000000000002,"5min":1.018,"15min":1.018},"last":0.67700000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41899999999999998,"15min":0.41799999999999998},"min":{"1min":0.29699999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.58099999999999996,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46200000000000002,"15min":0.46999999999999997},"min":{"1min":0.32600000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.70899999999999996,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.35199999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.45700000000000002,"15min":0.45500000000000002},"min":{"1min":0.40699999999999997,"5min":0.307,"15min":0.307},"max":{"1min":0.60599999999999998,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.34799999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70099999999999996,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.41299999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55700000000000005,"15min":0.56100000000000005},"min":{"1min":0.40000000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75600000000000001,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.79400000000000004,"5min":1.974,"15min":1.974},"last":0.497}]},{"osd":4,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.745,"15min":0.72499999999999998},"min":{"1min":0.61199999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.77200000000000002,"15min":0.76200000000000001},"min":{"1min":0.626,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2270000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.753}]},{"osd":5,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.77700000000000002,"15min":0.76500000000000001},"min":{"1min":0.55100000000000005,"5min":0.434,"15min":0.434},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.75,"15min":0.72799999999999998},"min":{"1min":0.63700000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.73899999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.77000000000000002,"15min":0.748},"min":{"1min":0.61899999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.78500000000000003,"15min":0.77100000000000002},"min":{"1min":0.58899999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.72699999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.56599999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.78400000000000003,"15min":0.76600000000000001},"min":{"1min":0.64700000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.83999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.39700000000000002,"15min":0.39000000000000001},"min":{"1min":0.30099999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.60699999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.443},{"interface":"front","average":{"1min":0.439,"5min":0.45200000000000001,"15min":0.44900000000000001},"min":{"1min":0.28499999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.66600000000000004,"5min":1.415,"15min":1.415},"last":0.42999999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55000000000000004,"15min":0.54100000000000004},"min":{"1min":0.441,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.74399999999999999,"5min":1.456,"15min":1.456},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.44400000000000001},"min":{"1min":0.34200000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.64100000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.55100000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.50600000000000001,"15min":0.51900000000000002},"min":{"1min":0.34999999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.65600000000000003,"5min":1.95,"15min":1.95},"last":0.5},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56200000000000006,"15min":0.57199999999999995},"min":{"1min":0.436,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.748,"5min":1.946,"15min":1.946},"last":0.58299999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72199999999999998,"15min":0.73199999999999998},"min":{"1min":0.498,"5min":0.379,"15min":0.379},"max":{"1min":0.97999999999999998,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76800000000000002,"15min":0.79000000000000004},"min":{"1min":0.55600000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88400000000000001,"5min":1.859,"15min":1.859},"last":0.82899999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.53500000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93100000000000005,"5min":1.722,"15min":1.722},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.745,"15min":0.76800000000000002},"min":{"1min":0.53100000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91400000000000003,"5min":1.889,"15min":1.889},"last":0.80500000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.76300000000000001,"15min":0.77800000000000002},"min":{"1min":0.58999999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95699999999999996,"5min":1.788,"15min":1.788},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.77400000000000002,"15min":0.78600000000000003},"min":{"1min":0.61899999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0409999999999999,"5min":1.889,"15min":1.889},"last":0.95499999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.83799999999999997,"15min":0.85599999999999998},"min":{"1min":0.68100000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0049999999999999,"5min":1.919,"15min":1.919},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.82799999999999996,"15min":0.85499999999999998},"min":{"1min":0.56599999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.98199999999999998,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.96999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.44800000000000001,"15min":0.45600000000000002},"min":{"1min":0.307,"5min":0.249,"15min":0.249},"max":{"1min":0.67900000000000005,"5min":1.284,"15min":1.284},"last":0.309},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.47399999999999998,"15min":0.48099999999999998},"min":{"1min":0.33900000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59699999999999998,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.443}]},{"osd":2,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.45400000000000001,"15min":0.44400000000000001},"min":{"1min":0.372,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.60399999999999998,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.499,"15min":0.495},"min":{"1min":0.40500000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.67000000000000004,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.41899999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55400000000000005,"15min":0.54700000000000004},"min":{"1min":0.45100000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.752,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.54900000000000004,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63500000000000001,"5min":2.617,"15min":2.617},"last":0.39800000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72099999999999997,"15min":0.70399999999999996},"min":{"1min":0.55100000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97999999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.59099999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.99399999999999999,"5min":1.056,"15min":1.056},"last":0.77800000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79700000000000004,"15min":0.80700000000000005},"min":{"1min":0.60599999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.034,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.747},{"interface":"front","average":{"1min":0.751,"5min":0.78700000000000003,"15min":0.79700000000000004},"min":{"1min":0.56799999999999995,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0569999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.72399999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.82299999999999995,"15min":0.83899999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1100000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.77500000000000002,"15min":0.77300000000000002},"min":{"1min":0.628,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.02,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.80400000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79100000000000004,"15min":0.79600000000000004},"min":{"1min":0.627,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96499999999999997,"5min":1.218,"15min":1.218},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.84699999999999998,"15min":0.86899999999999999},"min":{"1min":0.55900000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0820000000000001,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.77200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298440,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073400,"statfs":{"total":96636764160,"available":96331161600,"internally_reserved":0,"allocated":1105920,"data_stored":804593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.32800000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52800000000000002,"15min":0.52000000000000002},"min":{"1min":0.435,"5min":0.377,"15min":0.377},"max":{"1min":0.75600000000000001,"5min":1.03,"15min":1.03},"last":0.52500000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.48599999999999999},"min":{"1min":0.36899999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.64900000000000002,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.47599999999999998,"15min":0.45900000000000002},"min":{"1min":0.39400000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70299999999999996,"5min":0.755,"15min":0.755},"last":0.48999999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.47199999999999998,"15min":0.45700000000000002},"min":{"1min":0.38200000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.71199999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.45400000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.67000000000000004,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.754,"15min":0.75},"min":{"1min":0.60899999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.004,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.76700000000000002,"15min":0.76000000000000001},"min":{"1min":0.61699999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0409999999999999,"5min":1.24,"15min":1.24},"last":0.72399999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.74199999999999999,"15min":0.71099999999999997},"min":{"1min":0.61499999999999999,"5min":0.501,"15min":0.501},"max":{"1min":0.99199999999999999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76600000000000001,"15min":0.76800000000000002},"min":{"1min":0.59499999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95899999999999996,"5min":1.212,"15min":1.212},"last":0.68600000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.77600000000000002,"15min":0.77100000000000002},"min":{"1min":0.627,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95099999999999996,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.78200000000000003,"15min":0.77900000000000003},"min":{"1min":0.625,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0900000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":5.4939999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.78600000000000003,"15min":0.78400000000000003},"min":{"1min":0.64700000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0189999999999999,"5min":1.286,"15min":1.286},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78500000000000003,"15min":0.77900000000000003},"min":{"1min":0.61899999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.93899999999999995,"5min":1.234,"15min":1.234},"last":0.67100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:31:14.322 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:31:14.322 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:31:14.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.468+0000 7f8278a00640 1 Processor -- start 2024-08-17T02:31:14.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.468+0000 7f8278a00640 1 -- start start 2024-08-17T02:31:14.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.470+0000 7f8278a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f827406df00 0x7f82740adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:14.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.470+0000 7f8278a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8274155df0 0x7f82740ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:14.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.470+0000 7f8278a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8274156670 con 0x7f8274155a20 2024-08-17T02:31:14.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.470+0000 7f8278a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82740b0350 con 0x7f8274155df0 2024-08-17T02:31:14.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.470+0000 7f8278a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827406e5e0 con 0x7f827406df00 2024-08-17T02:31:14.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.470+0000 7f8271e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8274155a20 0x7f827406d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50492/0 (socket says 172.21.15.106:50492) 2024-08-17T02:31:14.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.470+0000 7f8271e00640 1 -- 172.21.15.106:0/3497270702 learned_addr learned my addr 172.21.15.106:0/3497270702 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:31:14.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.470+0000 7f8272800640 1 --2- 172.21.15.106:0/3497270702 >> v2:172.21.15.106:3300/0 conn(0x7f8274155df0 0x7f82740ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:14.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.470+0000 7f8271400640 1 -- 172.21.15.106:0/3497270702 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517184260 0 0) 0x7f8274156670 con 0x7f8274155a20 2024-08-17T02:31:14.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.470+0000 7f8269400640 1 --2- 172.21.15.106:0/3497270702 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f827406df00 0x7f82740adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:14.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.470+0000 7f8271400640 1 -- 172.21.15.106:0/3497270702 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82580034e0 con 0x7f8274155a20 2024-08-17T02:31:14.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.470+0000 7f8272800640 1 -- 172.21.15.106:0/3497270702 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f827406df00 msgr2=0x7f82740adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:14.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.470+0000 7f8272800640 1 --2- 172.21.15.106:0/3497270702 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f827406df00 0x7f82740adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:14.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.470+0000 7f8272800640 1 -- 172.21.15.106:0/3497270702 >> v1:172.21.15.106:6789/0 conn(0x7f8274155a20 legacy=0x7f827406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:14.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.470+0000 7f8272800640 1 -- 172.21.15.106:0/3497270702 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827406e8c0 con 0x7f8274155df0 2024-08-17T02:31:14.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.470+0000 7f8269400640 1 --2- 172.21.15.106:0/3497270702 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f827406df00 0x7f82740adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:31:14.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.471+0000 7f8272800640 1 --2- 172.21.15.106:0/3497270702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8274155df0 0x7f82740ad9b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f826c009e90 tx=0x7f826c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673581a636d0dc8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:14.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.472+0000 7f8271400640 1 -- 172.21.15.106:0/3497270702 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c007550 con 0x7f8274155df0 2024-08-17T02:31:14.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.472+0000 7f8271400640 1 -- 172.21.15.106:0/3497270702 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826c02d050 con 0x7f8274155df0 2024-08-17T02:31:14.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.472+0000 7f8271400640 1 -- 172.21.15.106:0/3497270702 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c007900 con 0x7f8274155df0 2024-08-17T02:31:14.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.472+0000 7f8278a00640 1 -- 172.21.15.106:0/3497270702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8274155df0 msgr2=0x7f82740ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:14.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.472+0000 7f8278a00640 1 --2- 172.21.15.106:0/3497270702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8274155df0 0x7f82740ad9b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f826c009e90 tx=0x7f826c009780 comp rx=0 tx=0).stop 2024-08-17T02:31:14.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.472+0000 7f8278a00640 1 -- 172.21.15.106:0/3497270702 shutdown_connections 2024-08-17T02:31:14.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.472+0000 7f8278a00640 1 --2- 172.21.15.106:0/3497270702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8274155df0 0x7f82740ad9b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:14.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.472+0000 7f8278a00640 1 --2- 172.21.15.106:0/3497270702 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f827406df00 0x7f82740adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:14.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.472+0000 7f8278a00640 1 -- 172.21.15.106:0/3497270702 >> 172.21.15.106:0/3497270702 conn(0x7f82740cb9b0 msgr2=0x7f82740cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:14.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.472+0000 7f8278a00640 1 -- 172.21.15.106:0/3497270702 shutdown_connections 2024-08-17T02:31:14.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.472+0000 7f8278a00640 1 -- 172.21.15.106:0/3497270702 wait complete. 2024-08-17T02:31:14.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.474+0000 7f8278a00640 1 Processor -- start 2024-08-17T02:31:14.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.474+0000 7f8278a00640 1 -- start start 2024-08-17T02:31:14.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.475+0000 7f8278a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f827406df00 0x7f827413df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:14.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.475+0000 7f8278a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8274155a20 0x7f82740a8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:14.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.475+0000 7f8278a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8274155df0 0x7f82740aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:14.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.475+0000 7f8278a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82740ad860 con 0x7f8274155a20 2024-08-17T02:31:14.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.475+0000 7f8278a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82740a54d0 con 0x7f827406df00 2024-08-17T02:31:14.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.475+0000 7f8278a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82740a5d70 con 0x7f8274155df0 2024-08-17T02:31:14.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.475+0000 7f8269400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8274155a20 0x7f82740a8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:14.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.475+0000 7f8269400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8274155a20 0x7f82740a8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34672/0 (socket says 172.21.15.106:34672) 2024-08-17T02:31:14.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.475+0000 7f8269400640 1 -- 172.21.15.106:0/1852810063 learned_addr learned my addr 172.21.15.106:0/1852810063 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:14.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.475+0000 7f8271e00640 1 --2- 172.21.15.106:0/1852810063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f827406df00 0x7f827413df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:14.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.475+0000 7f8272800640 1 --2- 172.21.15.106:0/1852810063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8274155df0 0x7f82740aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:14.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.475+0000 7f8269400640 1 -- 172.21.15.106:0/1852810063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8274155df0 msgr2=0x7f82740aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:14.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.475+0000 7f8269400640 1 --2- 172.21.15.106:0/1852810063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8274155df0 0x7f82740aaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:14.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.475+0000 7f8269400640 1 -- 172.21.15.106:0/1852810063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f827406df00 msgr2=0x7f827413df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:14.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.475+0000 7f8269400640 1 --2- 172.21.15.106:0/1852810063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f827406df00 0x7f827413df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:14.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.475+0000 7f8269400640 1 -- 172.21.15.106:0/1852810063 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826c009a20 con 0x7f8274155a20 2024-08-17T02:31:14.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.475+0000 7f8272800640 1 --2- 172.21.15.106:0/1852810063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8274155df0 0x7f82740aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:31:14.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.476+0000 7f8269400640 1 --2- 172.21.15.106:0/1852810063 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8274155a20 0x7f82740a8a10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f825c00c880 tx=0x7f825c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:14.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.476+0000 7f826a000640 1 -- 172.21.15.106:0/1852810063 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c00ce10 con 0x7f8274155a20 2024-08-17T02:31:14.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.476+0000 7f826a000640 1 -- 172.21.15.106:0/1852810063 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825c007890 con 0x7f8274155a20 2024-08-17T02:31:14.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.476+0000 7f8278a00640 1 -- 172.21.15.106:0/1852810063 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82740a8f50 con 0x7f8274155a20 2024-08-17T02:31:14.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.476+0000 7f826a000640 1 -- 172.21.15.106:0/1852810063 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c007c10 con 0x7f8274155a20 2024-08-17T02:31:14.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.476+0000 7f8278a00640 1 -- 172.21.15.106:0/1852810063 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82740a5720 con 0x7f8274155a20 2024-08-17T02:31:14.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.477+0000 7f8278a00640 1 -- 172.21.15.106:0/1852810063 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8274064db0 con 0x7f8274155a20 2024-08-17T02:31:14.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.478+0000 7f826a000640 1 -- 172.21.15.106:0/1852810063 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f825c0113f0 con 0x7f8274155a20 2024-08-17T02:31:14.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.479+0000 7f826a000640 1 --2- 172.21.15.106:0/1852810063 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8250065180 0x7f8250067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:14.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.479+0000 7f826a000640 1 -- 172.21.15.106:0/1852810063 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f825c082190 con 0x7f8274155a20 2024-08-17T02:31:14.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.479+0000 7f8271e00640 1 --2- 172.21.15.106:0/1852810063 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8250065180 0x7f8250067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:14.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.479+0000 7f8271e00640 1 --2- 172.21.15.106:0/1852810063 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8250065180 0x7f8250067630 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8264005840 tx=0x7f8264009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:14.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.483+0000 7f826a000640 1 -- 172.21.15.106:0/1852810063 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f825c053f90 con 0x7f8274155a20 2024-08-17T02:31:14.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.650+0000 7f8278a00640 1 -- 172.21.15.106:0/1852810063 --> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f82740a5eb0 con 0x7f8250065180 2024-08-17T02:31:14.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.652+0000 7f826a000640 1 -- 172.21.15.106:0/1852810063 <== mgr.4107 v2:172.21.15.106:6832/36860 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50687 (secure 0 0 0) 0x7f82740a5eb0 con 0x7f8250065180 2024-08-17T02:31:14.653 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:31:14.654 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-08-17T02:31:14.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.654+0000 7f8278a00640 1 -- 172.21.15.106:0/1852810063 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8250065180 msgr2=0x7f8250067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:14.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.654+0000 7f8278a00640 1 --2- 172.21.15.106:0/1852810063 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8250065180 0x7f8250067630 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8264005840 tx=0x7f8264009040 comp rx=0 tx=0).stop 2024-08-17T02:31:14.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.654+0000 7f8278a00640 1 -- 172.21.15.106:0/1852810063 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8274155a20 msgr2=0x7f82740a8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:14.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.654+0000 7f8278a00640 1 --2- 172.21.15.106:0/1852810063 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8274155a20 0x7f82740a8a10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f825c00c880 tx=0x7f825c008040 comp rx=0 tx=0).stop 2024-08-17T02:31:14.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.655+0000 7f8278a00640 1 -- 172.21.15.106:0/1852810063 shutdown_connections 2024-08-17T02:31:14.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.655+0000 7f8278a00640 1 --2- 172.21.15.106:0/1852810063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8274155df0 0x7f82740aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:14.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.655+0000 7f8278a00640 1 --2- 172.21.15.106:0/1852810063 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8250065180 0x7f8250067630 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:14.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.655+0000 7f8278a00640 1 --2- 172.21.15.106:0/1852810063 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8274155a20 0x7f82740a8a10 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:14.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.655+0000 7f8278a00640 1 --2- 172.21.15.106:0/1852810063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f827406df00 0x7f827413df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:14.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.655+0000 7f8278a00640 1 -- 172.21.15.106:0/1852810063 >> 172.21.15.106:0/1852810063 conn(0x7f82740cb9b0 msgr2=0x7f8274154a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:14.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.655+0000 7f8278a00640 1 -- 172.21.15.106:0/1852810063 shutdown_connections 2024-08-17T02:31:14.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.655+0000 7f8278a00640 1 -- 172.21.15.106:0/1852810063 wait complete. 2024-08-17T02:31:14.671 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2024-08-17T02:31:13.925472+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2388200,"kb_used_data":5160,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586520,"statfs":{"total":773094113280,"available":770648596480,"internally_reserved":0,"allocated":5283840,"data_stored":2894536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.005348"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":183,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:31:09.705640+0000","last_change":"2024-08-17T02:27:39.552321+0000","last_active":"2024-08-17T02:31:09.705640+0000","last_peered":"2024-08-17T02:31:09.705640+0000","last_clean":"2024-08-17T02:31:09.705640+0000","last_became_active":"2024-08-17T02:27:39.551203+0000","last_became_peered":"2024-08-17T02:27:39.551203+0000","last_unstale":"2024-08-17T02:31:09.705640+0000","last_undegraded":"2024-08-17T02:31:09.705640+0000","last_fullsized":"2024-08-17T02:31:09.705640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.155679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.155679+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.155679+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:02.785032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1105920,"data_stored":804593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.71399999999999997,"15min":0.69399999999999995},"min":{"1min":0.55500000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93000000000000005,"5min":1.03,"15min":1.03},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.72299999999999998,"15min":0.70699999999999996},"min":{"1min":0.57099999999999995,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.877,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.623}]},{"osd":1,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69599999999999995,"15min":0.68799999999999994},"min":{"1min":0.53200000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89200000000000002,"5min":1.536,"15min":1.536},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.85499999999999998,"15min":0.91800000000000004},"min":{"1min":0.56399999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.878,"5min":6.819,"15min":6.819},"last":0.41999999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.67600000000000005,"15min":0.66300000000000003},"min":{"1min":0.52900000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71199999999999997,"15min":0.70599999999999996},"min":{"1min":0.58799999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91500000000000004,"5min":1.081,"15min":1.081},"last":0.58799999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.69599999999999995,"15min":0.68899999999999995},"min":{"1min":0.625,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.86299999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70499999999999996,"15min":0.69899999999999995},"min":{"1min":0.48899999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.67500000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.622,"15min":0.63800000000000001},"min":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91200000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.65000000000000002,"15min":0.66200000000000003},"min":{"1min":0.48999999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93100000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.65400000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.65700000000000003,"15min":0.67300000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.69799999999999995,"15min":0.72599999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.875,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.56799999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.77200000000000002,"15min":0.79400000000000004},"min":{"1min":0.52400000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96399999999999997,"5min":1.095,"15min":1.095},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.745,"15min":0.76800000000000002},"min":{"1min":0.54900000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89300000000000002,"5min":1.002,"15min":1.002},"last":0.60099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67600000000000005,"15min":0.67300000000000004},"min":{"1min":0.52000000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.94899999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66900000000000004,"15min":0.67700000000000005},"min":{"1min":0.439,"5min":0.435,"15min":0.435},"max":{"1min":0.81699999999999995,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.77000000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64300000000000002,"15min":0.63800000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83099999999999996,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71099999999999997,"15min":0.71599999999999997},"min":{"1min":0.54700000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.92000000000000004,"5min":1.032,"15min":1.032},"last":0.61599999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.57699999999999996,"5min":0.432,"15min":0.432},"max":{"1min":0.90900000000000003,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76400000000000001,"15min":0.78000000000000003},"min":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.88700000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.76200000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.55900000000000005,"5min":0.502,"15min":0.502},"max":{"1min":0.85499999999999998,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.754,"15min":0.76200000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.86799999999999999,"5min":1.123,"15min":1.123},"last":0.65700000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.65300000000000002,"15min":0.69099999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.67700000000000005,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.64900000000000002,"15min":0.67700000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.79400000000000004,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.63400000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.65900000000000003,"15min":0.68700000000000006},"min":{"1min":0.45900000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.81100000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.72999999999999998,"15min":0.76800000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91200000000000003,"5min":1.075,"15min":1.075},"last":0.81299999999999994}]},{"osd":7,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.71599999999999997,"15min":0.74299999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84899999999999998,"5min":1.157,"15min":1.157},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.78300000000000003,"15min":0.80500000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.89700000000000002,"5min":1.038,"15min":1.038},"last":0.86899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84299999999999997,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.623},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.67400000000000004,"15min":0.65600000000000003},"min":{"1min":0.41999999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85599999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.48899999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.67700000000000005,"15min":0.68500000000000005},"min":{"1min":0.48699999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.871,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.68600000000000005,"15min":0.67000000000000004},"min":{"1min":0.52800000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88400000000000001,"5min":1.327,"15min":1.327},"last":0.67200000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.65200000000000002,"15min":0.63300000000000001},"min":{"1min":0.502,"5min":0.433,"15min":0.433},"max":{"1min":0.89100000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86199999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.50700000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69699999999999995,"15min":0.70399999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.84299999999999997,"5min":1.048,"15min":1.048},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69099999999999995,"15min":0.67700000000000005},"min":{"1min":0.432,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84199999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.53400000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.59299999999999997,"15min":0.625},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.63,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.61099999999999999,"15min":0.629},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.61399999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.64300000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.63400000000000001,"15min":0.66200000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82799999999999996,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.72199999999999998,"15min":0.746},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.85599999999999998,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.70799999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.68400000000000005,"15min":0.69599999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.81999999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.70899999999999996,"15min":0.72999999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.80800000000000005,"5min":1.046,"15min":1.046},"last":0.65600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.63,"15min":0.60699999999999998},"min":{"1min":0.53800000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.628,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.88,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.51000000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.66800000000000004,"15min":0.64500000000000002},"min":{"1min":0.55500000000000005,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89300000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.65600000000000003,"15min":0.64200000000000002},"min":{"1min":0.49099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.60599999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.67800000000000005,"15min":0.65300000000000002},"min":{"1min":0.63,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.96099999999999997,"5min":1.034,"15min":1.034},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.71999999999999997,"15min":0.71099999999999997},"min":{"1min":0.63700000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.624}]},{"osd":3,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.69899999999999995,"15min":0.68300000000000005},"min":{"1min":0.65900000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85599999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.73299999999999998,"15min":0.72099999999999997},"min":{"1min":0.65800000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.94099999999999995,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.65600000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.60799999999999998,"15min":0.63400000000000001},"min":{"1min":0.41399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.65100000000000002,"15min":0.67400000000000004},"min":{"1min":0.48699999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.68300000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.54300000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.69899999999999995,"15min":0.71299999999999997},"min":{"1min":0.46200000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.82999999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.72699999999999998,"15min":0.751},"min":{"1min":0.49099999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.79400000000000004,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.64400000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.71199999999999997,"15min":0.72399999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.84899999999999998,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.76300000000000001,"15min":0.79300000000000004},"min":{"1min":0.51600000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.89800000000000002,"5min":1.018,"15min":1.018},"last":0.67700000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41899999999999998,"15min":0.41799999999999998},"min":{"1min":0.29699999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.58099999999999996,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46200000000000002,"15min":0.46999999999999997},"min":{"1min":0.32600000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.70899999999999996,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.35199999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.45700000000000002,"15min":0.45500000000000002},"min":{"1min":0.40699999999999997,"5min":0.307,"15min":0.307},"max":{"1min":0.60599999999999998,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.34799999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70099999999999996,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.41299999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55700000000000005,"15min":0.56100000000000005},"min":{"1min":0.40000000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75600000000000001,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.79400000000000004,"5min":1.974,"15min":1.974},"last":0.497}]},{"osd":4,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.745,"15min":0.72499999999999998},"min":{"1min":0.61199999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.77200000000000002,"15min":0.76200000000000001},"min":{"1min":0.626,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2270000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.753}]},{"osd":5,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.77700000000000002,"15min":0.76500000000000001},"min":{"1min":0.55100000000000005,"5min":0.434,"15min":0.434},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.75,"15min":0.72799999999999998},"min":{"1min":0.63700000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.73899999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.77000000000000002,"15min":0.748},"min":{"1min":0.61899999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.78500000000000003,"15min":0.77100000000000002},"min":{"1min":0.58899999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.72699999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.56599999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.78400000000000003,"15min":0.76600000000000001},"min":{"1min":0.64700000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.83999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.39700000000000002,"15min":0.39000000000000001},"min":{"1min":0.30099999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.60699999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.443},{"interface":"front","average":{"1min":0.439,"5min":0.45200000000000001,"15min":0.44900000000000001},"min":{"1min":0.28499999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.66600000000000004,"5min":1.415,"15min":1.415},"last":0.42999999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55000000000000004,"15min":0.54100000000000004},"min":{"1min":0.441,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.74399999999999999,"5min":1.456,"15min":1.456},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.44400000000000001},"min":{"1min":0.34200000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.64100000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.55100000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.50600000000000001,"15min":0.51900000000000002},"min":{"1min":0.34999999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.65600000000000003,"5min":1.95,"15min":1.95},"last":0.5},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56200000000000006,"15min":0.57199999999999995},"min":{"1min":0.436,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.748,"5min":1.946,"15min":1.946},"last":0.58299999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72199999999999998,"15min":0.73199999999999998},"min":{"1min":0.498,"5min":0.379,"15min":0.379},"max":{"1min":0.97999999999999998,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76800000000000002,"15min":0.79000000000000004},"min":{"1min":0.55600000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88400000000000001,"5min":1.859,"15min":1.859},"last":0.82899999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.53500000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93100000000000005,"5min":1.722,"15min":1.722},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.745,"15min":0.76800000000000002},"min":{"1min":0.53100000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91400000000000003,"5min":1.889,"15min":1.889},"last":0.80500000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.76300000000000001,"15min":0.77800000000000002},"min":{"1min":0.58999999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95699999999999996,"5min":1.788,"15min":1.788},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.77400000000000002,"15min":0.78600000000000003},"min":{"1min":0.61899999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0409999999999999,"5min":1.889,"15min":1.889},"last":0.95499999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.83799999999999997,"15min":0.85599999999999998},"min":{"1min":0.68100000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0049999999999999,"5min":1.919,"15min":1.919},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.82799999999999996,"15min":0.85499999999999998},"min":{"1min":0.56599999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.98199999999999998,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.96999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.44800000000000001,"15min":0.45600000000000002},"min":{"1min":0.307,"5min":0.249,"15min":0.249},"max":{"1min":0.67900000000000005,"5min":1.284,"15min":1.284},"last":0.309},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.47399999999999998,"15min":0.48099999999999998},"min":{"1min":0.33900000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59699999999999998,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.443}]},{"osd":2,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.45400000000000001,"15min":0.44400000000000001},"min":{"1min":0.372,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.60399999999999998,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.499,"15min":0.495},"min":{"1min":0.40500000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.67000000000000004,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.41899999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55400000000000005,"15min":0.54700000000000004},"min":{"1min":0.45100000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.752,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.54900000000000004,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63500000000000001,"5min":2.617,"15min":2.617},"last":0.39800000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72099999999999997,"15min":0.70399999999999996},"min":{"1min":0.55100000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97999999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.59099999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.99399999999999999,"5min":1.056,"15min":1.056},"last":0.77800000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79700000000000004,"15min":0.80700000000000005},"min":{"1min":0.60599999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.034,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.747},{"interface":"front","average":{"1min":0.751,"5min":0.78700000000000003,"15min":0.79700000000000004},"min":{"1min":0.56799999999999995,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0569999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.72399999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.82299999999999995,"15min":0.83899999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1100000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.77500000000000002,"15min":0.77300000000000002},"min":{"1min":0.628,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.02,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.80400000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79100000000000004,"15min":0.79600000000000004},"min":{"1min":0.627,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96499999999999997,"5min":1.218,"15min":1.218},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.84699999999999998,"15min":0.86899999999999999},"min":{"1min":0.55900000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0820000000000001,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.77200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298440,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073400,"statfs":{"total":96636764160,"available":96331161600,"internally_reserved":0,"allocated":1105920,"data_stored":804593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.32800000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52800000000000002,"15min":0.52000000000000002},"min":{"1min":0.435,"5min":0.377,"15min":0.377},"max":{"1min":0.75600000000000001,"5min":1.03,"15min":1.03},"last":0.52500000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.48599999999999999},"min":{"1min":0.36899999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.64900000000000002,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.47599999999999998,"15min":0.45900000000000002},"min":{"1min":0.39400000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70299999999999996,"5min":0.755,"15min":0.755},"last":0.48999999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.47199999999999998,"15min":0.45700000000000002},"min":{"1min":0.38200000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.71199999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.45400000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.67000000000000004,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.754,"15min":0.75},"min":{"1min":0.60899999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.004,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.76700000000000002,"15min":0.76000000000000001},"min":{"1min":0.61699999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0409999999999999,"5min":1.24,"15min":1.24},"last":0.72399999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.74199999999999999,"15min":0.71099999999999997},"min":{"1min":0.61499999999999999,"5min":0.501,"15min":0.501},"max":{"1min":0.99199999999999999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76600000000000001,"15min":0.76800000000000002},"min":{"1min":0.59499999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95899999999999996,"5min":1.212,"15min":1.212},"last":0.68600000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.77600000000000002,"15min":0.77100000000000002},"min":{"1min":0.627,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95099999999999996,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.78200000000000003,"15min":0.77900000000000003},"min":{"1min":0.625,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0900000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":5.4939999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.78600000000000003,"15min":0.78400000000000003},"min":{"1min":0.64700000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0189999999999999,"5min":1.286,"15min":1.286},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78500000000000003,"15min":0.77900000000000003},"min":{"1min":0.61899999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.93899999999999995,"5min":1.234,"15min":1.234},"last":0.67100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:31:14.672 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:31:14.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.819+0000 7f1d15800640 1 Processor -- start 2024-08-17T02:31:14.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.820+0000 7f1d15800640 1 -- start start 2024-08-17T02:31:14.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.821+0000 7f1d15800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d10155180 0x7f1d100aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:14.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.821+0000 7f1d15800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1d10155550 0x7f1d100ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:14.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.821+0000 7f1d15800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1d1006e080 0x7f1d1006e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:14.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.821+0000 7f1d15800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d100afc10 con 0x7f1d1006e080 2024-08-17T02:31:14.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.821+0000 7f1d15800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d100ae5b0 con 0x7f1d10155550 2024-08-17T02:31:14.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.821+0000 7f1d15800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1006e9d0 con 0x7f1d10155180 2024-08-17T02:31:14.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.821+0000 7f1d0f400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1d1006e080 0x7f1d1006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:14.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.821+0000 7f1d0f400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1d1006e080 0x7f1d1006e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34676/0 (socket says 172.21.15.106:34676) 2024-08-17T02:31:14.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.821+0000 7f1d0f400640 1 -- 172.21.15.106:0/3079693397 learned_addr learned my addr 172.21.15.106:0/3079693397 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:14.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.821+0000 7f1d06000640 1 --2- 172.21.15.106:0/3079693397 >> v2:172.21.15.171:3300/0 conn(0x7f1d10155550 0x7f1d100ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:14.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.821+0000 7f1d0ea00640 1 --2- 172.21.15.106:0/3079693397 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d10155180 0x7f1d100aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:14.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.822+0000 7f1d0f400640 1 -- 172.21.15.106:0/3079693397 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d10155180 msgr2=0x7f1d100aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:14.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.822+0000 7f1d0f400640 1 --2- 172.21.15.106:0/3079693397 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d10155180 0x7f1d100aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:14.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.822+0000 7f1d0f400640 1 -- 172.21.15.106:0/3079693397 >> v2:172.21.15.171:3300/0 conn(0x7f1d10155550 msgr2=0x7f1d100ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:14.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.822+0000 7f1d0f400640 1 --2- 172.21.15.106:0/3079693397 >> v2:172.21.15.171:3300/0 conn(0x7f1d10155550 0x7f1d100ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:14.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.822+0000 7f1d0f400640 1 -- 172.21.15.106:0/3079693397 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d100af000 con 0x7f1d1006e080 2024-08-17T02:31:14.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.822+0000 7f1d06000640 1 --2- 172.21.15.106:0/3079693397 >> v2:172.21.15.171:3300/0 conn(0x7f1d10155550 0x7f1d100ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:31:14.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.823+0000 7f1d0f400640 1 --2- 172.21.15.106:0/3079693397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d1006e080 0x7f1d1006e490 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1d1006ec90 tx=0x7f1d08009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5dabba29f41bfe9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:14.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.823+0000 7f1d0e000640 1 -- 172.21.15.106:0/3079693397 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d08031400 con 0x7f1d1006e080 2024-08-17T02:31:14.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.823+0000 7f1d0e000640 1 -- 172.21.15.106:0/3079693397 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0802d050 con 0x7f1d1006e080 2024-08-17T02:31:14.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.823+0000 7f1d0e000640 1 -- 172.21.15.106:0/3079693397 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d080317d0 con 0x7f1d1006e080 2024-08-17T02:31:14.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.823+0000 7f1d15800640 1 -- 172.21.15.106:0/3079693397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d1006e080 msgr2=0x7f1d1006e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:14.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.823+0000 7f1d15800640 1 --2- 172.21.15.106:0/3079693397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d1006e080 0x7f1d1006e490 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1d1006ec90 tx=0x7f1d08009840 comp rx=0 tx=0).stop 2024-08-17T02:31:14.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.823+0000 7f1d15800640 1 -- 172.21.15.106:0/3079693397 shutdown_connections 2024-08-17T02:31:14.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.823+0000 7f1d15800640 1 --2- 172.21.15.106:0/3079693397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d1006e080 0x7f1d1006e490 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:14.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.823+0000 7f1d15800640 1 --2- 172.21.15.106:0/3079693397 >> v2:172.21.15.171:3300/0 conn(0x7f1d10155550 0x7f1d100ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:14.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.823+0000 7f1d15800640 1 --2- 172.21.15.106:0/3079693397 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d10155180 0x7f1d100aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:14.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.823+0000 7f1d15800640 1 -- 172.21.15.106:0/3079693397 >> 172.21.15.106:0/3079693397 conn(0x7f1d100cb9b0 msgr2=0x7f1d100cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:14.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.824+0000 7f1d15800640 1 -- 172.21.15.106:0/3079693397 shutdown_connections 2024-08-17T02:31:14.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.824+0000 7f1d15800640 1 -- 172.21.15.106:0/3079693397 wait complete. 2024-08-17T02:31:14.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.825+0000 7f1d15800640 1 Processor -- start 2024-08-17T02:31:14.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.825+0000 7f1d15800640 1 -- start start 2024-08-17T02:31:14.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.826+0000 7f1d15800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d1006e080 0x7f1d10144300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:14.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.826+0000 7f1d15800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d10155180 0x7f1d100c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:14.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.826+0000 7f1d15800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d10155550 0x7f1d100c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:14.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.826+0000 7f1d15800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d100ac1a0 con 0x7f1d10155180 2024-08-17T02:31:14.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.826+0000 7f1d15800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d100ab310 con 0x7f1d10155550 2024-08-17T02:31:14.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.826+0000 7f1d15800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d100ab590 con 0x7f1d1006e080 2024-08-17T02:31:14.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.826+0000 7f1d06000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d10155180 0x7f1d100c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:14.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.826+0000 7f1d06000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d10155180 0x7f1d100c96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34678/0 (socket says 172.21.15.106:34678) 2024-08-17T02:31:14.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.826+0000 7f1d06000640 1 -- 172.21.15.106:0/2652755223 learned_addr learned my addr 172.21.15.106:0/2652755223 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:14.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.827+0000 7f1d0ea00640 1 --2- 172.21.15.106:0/2652755223 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d1006e080 0x7f1d10144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:14.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.827+0000 7f1d0f400640 1 --2- 172.21.15.106:0/2652755223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d10155550 0x7f1d100c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:14.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.827+0000 7f1d06000640 1 -- 172.21.15.106:0/2652755223 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d1006e080 msgr2=0x7f1d10144300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:14.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.827+0000 7f1d06000640 1 --2- 172.21.15.106:0/2652755223 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d1006e080 0x7f1d10144300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:14.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.827+0000 7f1d06000640 1 -- 172.21.15.106:0/2652755223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d10155550 msgr2=0x7f1d100c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:14.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.827+0000 7f1d06000640 1 --2- 172.21.15.106:0/2652755223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d10155550 0x7f1d100c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:14.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.827+0000 7f1d06000640 1 -- 172.21.15.106:0/2652755223 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d08009ae0 con 0x7f1d10155180 2024-08-17T02:31:14.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.827+0000 7f1d0f400640 1 --2- 172.21.15.106:0/2652755223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d10155550 0x7f1d100c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:31:14.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.827+0000 7f1d06000640 1 --2- 172.21.15.106:0/2652755223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d10155180 0x7f1d100c96a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1cf800d840 tx=0x7f1cf8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:14.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.827+0000 7f1d06a00640 1 -- 172.21.15.106:0/2652755223 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf80096a0 con 0x7f1d10155180 2024-08-17T02:31:14.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.827+0000 7f1d06a00640 1 -- 172.21.15.106:0/2652755223 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf8009800 con 0x7f1d10155180 2024-08-17T02:31:14.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.827+0000 7f1d06a00640 1 -- 172.21.15.106:0/2652755223 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf8009bc0 con 0x7f1d10155180 2024-08-17T02:31:14.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.827+0000 7f1d15800640 1 -- 172.21.15.106:0/2652755223 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d100ab870 con 0x7f1d10155180 2024-08-17T02:31:14.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.827+0000 7f1d15800640 1 -- 172.21.15.106:0/2652755223 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d100abe30 con 0x7f1d10155180 2024-08-17T02:31:14.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.828+0000 7f1d15800640 1 -- 172.21.15.106:0/2652755223 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d100ac350 con 0x7f1d10155180 2024-08-17T02:31:14.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.829+0000 7f1d06a00640 1 -- 172.21.15.106:0/2652755223 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1cf8014430 con 0x7f1d10155180 2024-08-17T02:31:14.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.830+0000 7f1d06a00640 1 --2- 172.21.15.106:0/2652755223 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1cec065150 0x7f1cec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:14.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.830+0000 7f1d06a00640 1 -- 172.21.15.106:0/2652755223 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f1cf8082620 con 0x7f1d10155180 2024-08-17T02:31:14.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.830+0000 7f1d0ea00640 1 --2- 172.21.15.106:0/2652755223 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1cec065150 0x7f1cec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:14.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.831+0000 7f1d0ea00640 1 --2- 172.21.15.106:0/2652755223 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1cec065150 0x7f1cec067600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1d100a6890 tx=0x7f1d00008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:14.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:14.834+0000 7f1d06a00640 1 -- 172.21.15.106:0/2652755223 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1d100ac350 con 0x7f1d10155180 2024-08-17T02:31:15.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:15.008+0000 7f1d15800640 1 -- 172.21.15.106:0/2652755223 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d100ac350 con 0x7f1d10155180 2024-08-17T02:31:15.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:15.009+0000 7f1d06a00640 1 -- 172.21.15.106:0/2652755223 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12443 (secure 0 0 0) 0x7f1d100ac350 con 0x7f1d10155180 2024-08-17T02:31:15.009 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:31:15.009 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":43,"fsid":"2c52f2d2-3c39-4be0-9e1a-50df01bd49c4","created":"2024-08-17T02:27:24.716801+0000","modified":"2024-08-17T02:31:10.251940+0000","last_up_change":"2024-08-17T02:27:37.147787+0000","last_in_change":"2024-08-17T02:27:27.752271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:27:37.928826+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"214cec52-4ddb-4539-961a-93c769170f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":37127},{"type":"v1","addr":"172.21.15.106:6802","nonce":37127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":37127},{"type":"v1","addr":"172.21.15.106:6806","nonce":37127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":37127},{"type":"v1","addr":"172.21.15.106:6815","nonce":37127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":37127},{"type":"v1","addr":"172.21.15.106:6811","nonce":37127}]},"public_addr":"172.21.15.106:6802/37127","cluster_addr":"172.21.15.106:6806/37127","heartbeat_back_addr":"172.21.15.106:6815/37127","heartbeat_front_addr":"172.21.15.106:6811/37127","state":["exists","up"]},{"osd":1,"uuid":"309520a4-205e-449a-98c6-2b1c58811ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":37125},{"type":"v1","addr":"172.21.15.106:6825","nonce":37125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":37125},{"type":"v1","addr":"172.21.15.106:6827","nonce":37125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":37125},{"type":"v1","addr":"172.21.15.106:6831","nonce":37125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":37125},{"type":"v1","addr":"172.21.15.106:6829","nonce":37125}]},"public_addr":"172.21.15.106:6825/37125","cluster_addr":"172.21.15.106:6827/37125","heartbeat_back_addr":"172.21.15.106:6831/37125","heartbeat_front_addr":"172.21.15.106:6829/37125","state":["exists","up"]},{"osd":2,"uuid":"4fa92a94-7083-4644-a8e0-fbcb66361f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":37126},{"type":"v1","addr":"172.21.15.106:6817","nonce":37126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":37126},{"type":"v1","addr":"172.21.15.106:6819","nonce":37126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":37126},{"type":"v1","addr":"172.21.15.106:6823","nonce":37126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":37126},{"type":"v1","addr":"172.21.15.106:6821","nonce":37126}]},"public_addr":"172.21.15.106:6817/37126","cluster_addr":"172.21.15.106:6819/37126","heartbeat_back_addr":"172.21.15.106:6823/37126","heartbeat_front_addr":"172.21.15.106:6821/37126","state":["exists","up"]},{"osd":3,"uuid":"34cdc20c-f3aa-4b7e-9b2c-55920832ca9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":37124},{"type":"v1","addr":"172.21.15.106:6803","nonce":37124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":37124},{"type":"v1","addr":"172.21.15.106:6807","nonce":37124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":37124},{"type":"v1","addr":"172.21.15.106:6814","nonce":37124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":37124},{"type":"v1","addr":"172.21.15.106:6810","nonce":37124}]},"public_addr":"172.21.15.106:6803/37124","cluster_addr":"172.21.15.106:6807/37124","heartbeat_back_addr":"172.21.15.106:6814/37124","heartbeat_front_addr":"172.21.15.106:6810/37124","state":["exists","up"]},{"osd":4,"uuid":"2395e0bc-014d-4388-a765-0943301a9892","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":37336},{"type":"v1","addr":"172.21.15.171:6817","nonce":37336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":37336},{"type":"v1","addr":"172.21.15.171:6819","nonce":37336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":37336},{"type":"v1","addr":"172.21.15.171:6823","nonce":37336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":37336},{"type":"v1","addr":"172.21.15.171:6821","nonce":37336}]},"public_addr":"172.21.15.171:6817/37336","cluster_addr":"172.21.15.171:6819/37336","heartbeat_back_addr":"172.21.15.171:6823/37336","heartbeat_front_addr":"172.21.15.171:6821/37336","state":["exists","up"]},{"osd":5,"uuid":"f3ca27a0-7b37-4628-9af5-171467554bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":37334},{"type":"v1","addr":"172.21.15.171:6801","nonce":37334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":37334},{"type":"v1","addr":"172.21.15.171:6803","nonce":37334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":37334},{"type":"v1","addr":"172.21.15.171:6807","nonce":37334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":37334},{"type":"v1","addr":"172.21.15.171:6805","nonce":37334}]},"public_addr":"172.21.15.171:6801/37334","cluster_addr":"172.21.15.171:6803/37334","heartbeat_back_addr":"172.21.15.171:6807/37334","heartbeat_front_addr":"172.21.15.171:6805/37334","state":["exists","up"]},{"osd":6,"uuid":"8c0f2592-fabc-42b7-9b56-cdbc7045a468","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":37356},{"type":"v1","addr":"172.21.15.171:6825","nonce":37356}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":37356},{"type":"v1","addr":"172.21.15.171:6827","nonce":37356}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":37356},{"type":"v1","addr":"172.21.15.171:6831","nonce":37356}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":37356},{"type":"v1","addr":"172.21.15.171:6829","nonce":37356}]},"public_addr":"172.21.15.171:6825/37356","cluster_addr":"172.21.15.171:6827/37356","heartbeat_back_addr":"172.21.15.171:6831/37356","heartbeat_front_addr":"172.21.15.171:6829/37356","state":["exists","up"]},{"osd":7,"uuid":"bef737c2-444a-4c64-b11a-98e2b090d4f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":37335},{"type":"v1","addr":"172.21.15.171:6809","nonce":37335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":37335},{"type":"v1","addr":"172.21.15.171:6811","nonce":37335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":37335},{"type":"v1","addr":"172.21.15.171:6815","nonce":37335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":37335},{"type":"v1","addr":"172.21.15.171:6813","nonce":37335}]},"public_addr":"172.21.15.171:6809/37335","cluster_addr":"172.21.15.171:6811/37335","heartbeat_back_addr":"172.21.15.171:6815/37335","heartbeat_front_addr":"172.21.15.171:6813/37335","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.059182+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.095360+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.079263+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.027075+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.056416+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.276287+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.340460+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:27:33.107321+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.171:6833/3251295288":"2024-08-18T02:31:06.917308+0000","172.21.15.171:6835/3251295288":"2024-08-18T02:31:06.917308+0000","172.21.15.171:6834/754665763":"2024-08-18T02:31:00.016136+0000","172.21.15.171:6832/754665763":"2024-08-18T02:31:00.016136+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:31:15.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:15.011+0000 7f1d15800640 1 -- 172.21.15.106:0/2652755223 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1cec065150 msgr2=0x7f1cec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:15.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:15.011+0000 7f1d15800640 1 --2- 172.21.15.106:0/2652755223 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1cec065150 0x7f1cec067600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1d100a6890 tx=0x7f1d00008040 comp rx=0 tx=0).stop 2024-08-17T02:31:15.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:15.011+0000 7f1d15800640 1 -- 172.21.15.106:0/2652755223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d10155180 msgr2=0x7f1d100c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:15.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:15.011+0000 7f1d15800640 1 --2- 172.21.15.106:0/2652755223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d10155180 0x7f1d100c96a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1cf800d840 tx=0x7f1cf8008040 comp rx=0 tx=0).stop 2024-08-17T02:31:15.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:15.011+0000 7f1d15800640 1 -- 172.21.15.106:0/2652755223 shutdown_connections 2024-08-17T02:31:15.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:15.011+0000 7f1d15800640 1 --2- 172.21.15.106:0/2652755223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1d10155550 0x7f1d100c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:15.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:15.011+0000 7f1d15800640 1 --2- 172.21.15.106:0/2652755223 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1cec065150 0x7f1cec067600 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:15.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:15.011+0000 7f1d15800640 1 --2- 172.21.15.106:0/2652755223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d10155180 0x7f1d100c96a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:15.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:15.011+0000 7f1d15800640 1 --2- 172.21.15.106:0/2652755223 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1d1006e080 0x7f1d10144300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:15.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:15.011+0000 7f1d15800640 1 -- 172.21.15.106:0/2652755223 >> 172.21.15.106:0/2652755223 conn(0x7f1d100cb9b0 msgr2=0x7f1d100c8740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:15.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:15.011+0000 7f1d15800640 1 -- 172.21.15.106:0/2652755223 shutdown_connections 2024-08-17T02:31:15.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:15.011+0000 7f1d15800640 1 -- 172.21.15.106:0/2652755223 wait complete. 2024-08-17T02:31:16.027 INFO:tasks.ceph:Scrubbing osd.0 2024-08-17T02:31:16.027 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:31:16.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.181+0000 7f02a9a00640 1 Processor -- start 2024-08-17T02:31:16.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.181+0000 7f02a9a00640 1 -- start start 2024-08-17T02:31:16.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.182+0000 7f02a9a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02a4156890 0x7f02a406dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.182+0000 7f02a9a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f02a4156c60 0x7f02a406e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.182+0000 7f02a9a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f02a40c8130 0x7f02a40c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.182+0000 7f02a9a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a40ae9b0 con 0x7f02a4156c60 2024-08-17T02:31:16.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.182+0000 7f02a9a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a40ab320 con 0x7f02a40c8130 2024-08-17T02:31:16.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.182+0000 7f02a9a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a40aa730 con 0x7f02a4156890 2024-08-17T02:31:16.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.182+0000 7f02a2000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f02a4156c60 0x7f02a406e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.182+0000 7f02a2000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f02a4156c60 0x7f02a406e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34680/0 (socket says 172.21.15.106:34680) 2024-08-17T02:31:16.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.182+0000 7f02a2000640 1 -- 172.21.15.106:0/4169874057 learned_addr learned my addr 172.21.15.106:0/4169874057 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:16.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.182+0000 7f02a2a00640 1 --2- 172.21.15.106:0/4169874057 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02a4156890 0x7f02a406dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.182+0000 7f02a3400640 1 --2- 172.21.15.106:0/4169874057 >> v2:172.21.15.171:3300/0 conn(0x7f02a40c8130 0x7f02a40c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.183+0000 7f02a2000640 1 -- 172.21.15.106:0/4169874057 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02a4156890 msgr2=0x7f02a406dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:16.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.183+0000 7f02a2000640 1 --2- 172.21.15.106:0/4169874057 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02a4156890 0x7f02a406dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.183+0000 7f02a2000640 1 -- 172.21.15.106:0/4169874057 >> v2:172.21.15.171:3300/0 conn(0x7f02a40c8130 msgr2=0x7f02a40c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:16.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.183+0000 7f02a2000640 1 --2- 172.21.15.106:0/4169874057 >> v2:172.21.15.171:3300/0 conn(0x7f02a40c8130 0x7f02a40c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.183+0000 7f02a2000640 1 -- 172.21.15.106:0/4169874057 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a40aa9f0 con 0x7f02a4156c60 2024-08-17T02:31:16.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.184+0000 7f02a2000640 1 --2- 172.21.15.106:0/4169874057 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02a4156c60 0x7f02a406e420 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f02a40ab290 tx=0x7f02900091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a738d250ea0ef722 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:16.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.184+0000 7f02a1600640 1 -- 172.21.15.106:0/4169874057 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029002add0 con 0x7f02a4156c60 2024-08-17T02:31:16.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.184+0000 7f02a1600640 1 -- 172.21.15.106:0/4169874057 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0290032440 con 0x7f02a4156c60 2024-08-17T02:31:16.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.184+0000 7f02a1600640 1 -- 172.21.15.106:0/4169874057 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0290032820 con 0x7f02a4156c60 2024-08-17T02:31:16.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.184+0000 7f02a9a00640 1 -- 172.21.15.106:0/4169874057 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02a4156c60 msgr2=0x7f02a406e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.184+0000 7f02a9a00640 1 --2- 172.21.15.106:0/4169874057 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02a4156c60 0x7f02a406e420 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f02a40ab290 tx=0x7f02900091d0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.184+0000 7f02a9a00640 1 -- 172.21.15.106:0/4169874057 shutdown_connections 2024-08-17T02:31:16.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.184+0000 7f02a9a00640 1 --2- 172.21.15.106:0/4169874057 >> v2:172.21.15.171:3300/0 conn(0x7f02a40c8130 0x7f02a40c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.184+0000 7f02a9a00640 1 --2- 172.21.15.106:0/4169874057 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02a4156c60 0x7f02a406e420 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.184+0000 7f02a9a00640 1 --2- 172.21.15.106:0/4169874057 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02a4156890 0x7f02a406dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.184+0000 7f02a9a00640 1 -- 172.21.15.106:0/4169874057 >> 172.21.15.106:0/4169874057 conn(0x7f02a4067750 msgr2=0x7f02a406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:16.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.185+0000 7f02a9a00640 1 -- 172.21.15.106:0/4169874057 shutdown_connections 2024-08-17T02:31:16.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.185+0000 7f02a9a00640 1 -- 172.21.15.106:0/4169874057 wait complete. 2024-08-17T02:31:16.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.186+0000 7f02a9a00640 1 Processor -- start 2024-08-17T02:31:16.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.186+0000 7f02a9a00640 1 -- start start 2024-08-17T02:31:16.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.187+0000 7f02a9a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02a40c8130 0x7f02a4151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.187+0000 7f02a9a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02a4156890 0x7f02a40a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.187+0000 7f02a9a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02a4156c60 0x7f02a4149500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.187+0000 7f02a9a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a40a8ce0 con 0x7f02a4156890 2024-08-17T02:31:16.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.187+0000 7f02a9a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a40a64c0 con 0x7f02a40c8130 2024-08-17T02:31:16.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.187+0000 7f02a9a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a40a9840 con 0x7f02a4156c60 2024-08-17T02:31:16.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.187+0000 7f02a2000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02a4156890 0x7f02a40a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.187+0000 7f02a2000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02a4156890 0x7f02a40a5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34692/0 (socket says 172.21.15.106:34692) 2024-08-17T02:31:16.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.187+0000 7f02a2000640 1 -- 172.21.15.106:0/611885701 learned_addr learned my addr 172.21.15.106:0/611885701 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:16.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.187+0000 7f02a2a00640 1 --2- 172.21.15.106:0/611885701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02a40c8130 0x7f02a4151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.187+0000 7f02a3400640 1 --2- 172.21.15.106:0/611885701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02a4156c60 0x7f02a4149500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.188+0000 7f02a2000640 1 -- 172.21.15.106:0/611885701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02a4156c60 msgr2=0x7f02a4149500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.188+0000 7f02a2000640 1 --2- 172.21.15.106:0/611885701 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f02a4156c60 0x7f02a4149500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.188+0000 7f02a2000640 1 -- 172.21.15.106:0/611885701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02a40c8130 msgr2=0x7f02a4151650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.188+0000 7f02a2000640 1 --2- 172.21.15.106:0/611885701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02a40c8130 0x7f02a4151650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.188+0000 7f02a2000640 1 -- 172.21.15.106:0/611885701 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0290009450 con 0x7f02a4156890 2024-08-17T02:31:16.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.188+0000 7f02a2a00640 1 --2- 172.21.15.106:0/611885701 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f02a40c8130 0x7f02a4151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:31:16.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.188+0000 7f02a2000640 1 --2- 172.21.15.106:0/611885701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02a4156890 0x7f02a40a5d00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0290009210 tx=0x7f0290032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:16.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.188+0000 7f029a000640 1 -- 172.21.15.106:0/611885701 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0290000d10 con 0x7f02a4156890 2024-08-17T02:31:16.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.188+0000 7f029a000640 1 -- 172.21.15.106:0/611885701 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0290031de0 con 0x7f02a4156890 2024-08-17T02:31:16.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.188+0000 7f02a9a00640 1 -- 172.21.15.106:0/611885701 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a40a6240 con 0x7f02a4156890 2024-08-17T02:31:16.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.188+0000 7f029a000640 1 -- 172.21.15.106:0/611885701 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029003d650 con 0x7f02a4156890 2024-08-17T02:31:16.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.188+0000 7f02a9a00640 1 -- 172.21.15.106:0/611885701 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a40a9270 con 0x7f02a4156890 2024-08-17T02:31:16.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.189+0000 7f02a9a00640 1 -- 172.21.15.106:0/611885701 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f02a40710c0 con 0x7f02a4156890 2024-08-17T02:31:16.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.190+0000 7f029a000640 1 -- 172.21.15.106:0/611885701 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0290039040 con 0x7f02a4156890 2024-08-17T02:31:16.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.191+0000 7f029a000640 1 --2- 172.21.15.106:0/611885701 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f02840651d0 0x7f0284067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.191+0000 7f029a000640 1 -- 172.21.15.106:0/611885701 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f02900a2420 con 0x7f02a4156890 2024-08-17T02:31:16.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.191+0000 7f02a2a00640 1 --2- 172.21.15.106:0/611885701 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f02840651d0 0x7f0284067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.191+0000 7f029a000640 1 --2- 172.21.15.106:0/611885701 >> [v2:172.21.15.106:6800/37127,v1:172.21.15.106:6802/37127] conn(0x7f028406af50 0x7f028406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.191+0000 7f029a000640 1 -- 172.21.15.106:0/611885701 --> [v2:172.21.15.106:6800/37127,v1:172.21.15.106:6802/37127] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f028406da10 con 0x7f028406af50 2024-08-17T02:31:16.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.191+0000 7f029a000640 1 -- 172.21.15.106:0/611885701 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02900a4900 con 0x7f02a4156890 2024-08-17T02:31:16.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.192+0000 7f02a3400640 1 --2- 172.21.15.106:0/611885701 >> [v2:172.21.15.106:6800/37127,v1:172.21.15.106:6802/37127] conn(0x7f028406af50 0x7f028406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.192+0000 7f02a2a00640 1 --2- 172.21.15.106:0/611885701 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f02840651d0 0x7f0284067680 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f029400bb80 tx=0x7f0294008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:16.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.192+0000 7f02a3400640 1 --2- 172.21.15.106:0/611885701 >> [v2:172.21.15.106:6800/37127,v1:172.21.15.106:6802/37127] conn(0x7f028406af50 0x7f028406d360 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:16.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.193+0000 7f029a000640 1 -- 172.21.15.106:0/611885701 <== osd.0 v2:172.21.15.106:6800/37127 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f028406da10 con 0x7f028406af50 2024-08-17T02:31:16.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.206+0000 7f02a9a00640 1 -- 172.21.15.106:0/611885701 --> [v2:172.21.15.106:6800/37127,v1:172.21.15.106:6802/37127] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f02a4070740 con 0x7f028406af50 2024-08-17T02:31:16.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.206+0000 7f029a000640 1 -- 172.21.15.106:0/611885701 <== osd.0 v2:172.21.15.106:6800/37127 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f02a4070740 con 0x7f028406af50 2024-08-17T02:31:16.207 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-08-17T02:31:16.207 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:31:16.207 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-08-17T02:31:16.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.206+0000 7f02a9a00640 1 -- 172.21.15.106:0/611885701 >> [v2:172.21.15.106:6800/37127,v1:172.21.15.106:6802/37127] conn(0x7f028406af50 msgr2=0x7f028406d360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.206+0000 7f02a9a00640 1 --2- 172.21.15.106:0/611885701 >> [v2:172.21.15.106:6800/37127,v1:172.21.15.106:6802/37127] conn(0x7f028406af50 0x7f028406d360 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.206+0000 7f02a9a00640 1 -- 172.21.15.106:0/611885701 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f02840651d0 msgr2=0x7f0284067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.206+0000 7f02a9a00640 1 --2- 172.21.15.106:0/611885701 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f02840651d0 0x7f0284067680 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f029400bb80 tx=0x7f0294008040 comp rx=0 tx=0).stop 2024-08-17T02:31:16.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.206+0000 7f02a9a00640 1 -- 172.21.15.106:0/611885701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02a4156890 msgr2=0x7f02a40a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.206+0000 7f02a9a00640 1 --2- 172.21.15.106:0/611885701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02a4156890 0x7f02a40a5d00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0290009210 tx=0x7f0290032000 comp rx=0 tx=0).stop 2024-08-17T02:31:16.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.206+0000 7f02a3400640 1 -- 172.21.15.106:0/611885701 reap_dead start 2024-08-17T02:31:16.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.207+0000 7f02a9a00640 1 -- 172.21.15.106:0/611885701 shutdown_connections 2024-08-17T02:31:16.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.207+0000 7f02a9a00640 1 -- 172.21.15.106:0/611885701 >> 172.21.15.106:0/611885701 conn(0x7f02a4067750 msgr2=0x7f02a40aeb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:16.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.207+0000 7f02a9a00640 1 -- 172.21.15.106:0/611885701 shutdown_connections 2024-08-17T02:31:16.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.207+0000 7f02a9a00640 1 -- 172.21.15.106:0/611885701 wait complete. 2024-08-17T02:31:16.221 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-17T02:31:16.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.369+0000 7f88d1c00640 1 Processor -- start 2024-08-17T02:31:16.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.369+0000 7f88d1c00640 1 -- start start 2024-08-17T02:31:16.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.370+0000 7f88d1c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f88cc06df00 0x7f88cc0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.370+0000 7f88d1c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88cc156670 con 0x7f88cc155a20 2024-08-17T02:31:16.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.370+0000 7f88d1c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88cc06e5e0 con 0x7f88cc155df0 2024-08-17T02:31:16.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.370+0000 7f88d1c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88cc0b0350 con 0x7f88cc06df00 2024-08-17T02:31:16.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.370+0000 7f88caa00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f88cc155a20 0x7f88cc06d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50502/0 (socket says 172.21.15.106:50502) 2024-08-17T02:31:16.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.370+0000 7f88caa00640 1 -- 172.21.15.106:0/71767883 learned_addr learned my addr 172.21.15.106:0/71767883 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:31:16.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.371+0000 7f88ca000640 1 --2- 172.21.15.106:0/71767883 >> v2:172.21.15.171:3300/0 conn(0x7f88cc06df00 0x7f88cc0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.371+0000 7f88c9600640 1 -- 172.21.15.106:0/71767883 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732396181 0 0) 0x7f88cc156670 con 0x7f88cc155a20 2024-08-17T02:31:16.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.371+0000 7f88c9600640 1 -- 172.21.15.106:0/71767883 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88b00034e0 con 0x7f88cc155a20 2024-08-17T02:31:16.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.371+0000 7f88ca000640 1 -- 172.21.15.106:0/71767883 >> v1:172.21.15.171:6789/0 conn(0x7f88cc155df0 legacy=0x7f88cc156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.371+0000 7f88ca000640 1 -- 172.21.15.106:0/71767883 >> v1:172.21.15.106:6789/0 conn(0x7f88cc155a20 legacy=0x7f88cc06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.371+0000 7f88c9600640 1 -- 172.21.15.106:0/71767883 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3420494441 0 0) 0x7f88b00034e0 con 0x7f88cc155a20 2024-08-17T02:31:16.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.371+0000 7f88ca000640 1 -- 172.21.15.106:0/71767883 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88cc06e8c0 con 0x7f88cc06df00 2024-08-17T02:31:16.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.372+0000 7f88ca000640 1 --2- 172.21.15.106:0/71767883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88cc06df00 0x7f88cc0adf10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f88b8009850 tx=0x7f88b80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f14a9275e88481c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:16.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.373+0000 7f88c9600640 1 -- 172.21.15.106:0/71767883 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88bc001470 con 0x7f88cc06df00 2024-08-17T02:31:16.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.373+0000 7f88c9600640 1 -- 172.21.15.106:0/71767883 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b802aa50 con 0x7f88cc06df00 2024-08-17T02:31:16.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.373+0000 7f88c9600640 1 -- 172.21.15.106:0/71767883 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b802adf0 con 0x7f88cc06df00 2024-08-17T02:31:16.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.373+0000 7f88d1c00640 1 -- 172.21.15.106:0/71767883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88cc06df00 msgr2=0x7f88cc0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.373+0000 7f88d1c00640 1 --2- 172.21.15.106:0/71767883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88cc06df00 0x7f88cc0adf10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f88b8009850 tx=0x7f88b80090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.373+0000 7f88d1c00640 1 -- 172.21.15.106:0/71767883 shutdown_connections 2024-08-17T02:31:16.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.373+0000 7f88d1c00640 1 --2- 172.21.15.106:0/71767883 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88cc06df00 0x7f88cc0adf10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.373+0000 7f88d1c00640 1 -- 172.21.15.106:0/71767883 >> 172.21.15.106:0/71767883 conn(0x7f88cc0cb9b0 msgr2=0x7f88cc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:16.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.373+0000 7f88d1c00640 1 -- 172.21.15.106:0/71767883 shutdown_connections 2024-08-17T02:31:16.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.373+0000 7f88d1c00640 1 -- 172.21.15.106:0/71767883 wait complete. 2024-08-17T02:31:16.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.375+0000 7f88d1c00640 1 Processor -- start 2024-08-17T02:31:16.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.375+0000 7f88d1c00640 1 -- start start 2024-08-17T02:31:16.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.376+0000 7f88d1c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88cc06df00 0x7f88cc166940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.376+0000 7f88d1c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88cc155a20 0x7f88cc169730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.376+0000 7f88d1c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88cc155df0 0x7f88cc0adc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.376+0000 7f88d1c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc16b080 con 0x7f88cc155df0 2024-08-17T02:31:16.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.376+0000 7f88d1c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc16a470 con 0x7f88cc06df00 2024-08-17T02:31:16.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.376+0000 7f88d1c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc16a750 con 0x7f88cc155a20 2024-08-17T02:31:16.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.376+0000 7f88cb400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88cc155df0 0x7f88cc0adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.376+0000 7f88cb400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88cc155df0 0x7f88cc0adc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34706/0 (socket says 172.21.15.106:34706) 2024-08-17T02:31:16.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.376+0000 7f88cb400640 1 -- 172.21.15.106:0/2796213688 learned_addr learned my addr 172.21.15.106:0/2796213688 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:16.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.376+0000 7f88ca000640 1 --2- 172.21.15.106:0/2796213688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88cc155a20 0x7f88cc169730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.376+0000 7f88caa00640 1 --2- 172.21.15.106:0/2796213688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88cc06df00 0x7f88cc166940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.376+0000 7f88cb400640 1 -- 172.21.15.106:0/2796213688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88cc155a20 msgr2=0x7f88cc169730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.376+0000 7f88cb400640 1 --2- 172.21.15.106:0/2796213688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88cc155a20 0x7f88cc169730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.376+0000 7f88cb400640 1 -- 172.21.15.106:0/2796213688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88cc06df00 msgr2=0x7f88cc166940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.376+0000 7f88cb400640 1 --2- 172.21.15.106:0/2796213688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88cc06df00 0x7f88cc166940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.376+0000 7f88cb400640 1 -- 172.21.15.106:0/2796213688 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b8009390 con 0x7f88cc155df0 2024-08-17T02:31:16.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.377+0000 7f88cb400640 1 --2- 172.21.15.106:0/2796213688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88cc155df0 0x7f88cc0adc70 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f88c400c7c0 tx=0x7f88c40015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:16.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.377+0000 7f88c2000640 1 -- 172.21.15.106:0/2796213688 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c400a640 con 0x7f88cc155df0 2024-08-17T02:31:16.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.377+0000 7f88c2000640 1 -- 172.21.15.106:0/2796213688 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c400a7c0 con 0x7f88cc155df0 2024-08-17T02:31:16.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.377+0000 7f88d1c00640 1 -- 172.21.15.106:0/2796213688 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88cc16aa30 con 0x7f88cc155df0 2024-08-17T02:31:16.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.377+0000 7f88c2000640 1 -- 172.21.15.106:0/2796213688 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c400ab80 con 0x7f88cc155df0 2024-08-17T02:31:16.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.377+0000 7f88d1c00640 1 -- 172.21.15.106:0/2796213688 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88cc166e80 con 0x7f88cc155df0 2024-08-17T02:31:16.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.378+0000 7f88d1c00640 1 -- 172.21.15.106:0/2796213688 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88cc16b1f0 con 0x7f88cc155df0 2024-08-17T02:31:16.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.379+0000 7f88c2000640 1 -- 172.21.15.106:0/2796213688 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f88c4012420 con 0x7f88cc155df0 2024-08-17T02:31:16.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.380+0000 7f88c2000640 1 --2- 172.21.15.106:0/2796213688 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f88ac065180 0x7f88ac067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.380+0000 7f88c2000640 1 -- 172.21.15.106:0/2796213688 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f88c40822e0 con 0x7f88cc155df0 2024-08-17T02:31:16.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.380+0000 7f88caa00640 1 --2- 172.21.15.106:0/2796213688 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f88ac065180 0x7f88ac067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.381+0000 7f88caa00640 1 --2- 172.21.15.106:0/2796213688 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f88ac065180 0x7f88ac067630 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f88bc0011e0 tx=0x7f88bc000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:16.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.384+0000 7f88c2000640 1 -- 172.21.15.106:0/2796213688 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f88c4050640 con 0x7f88cc155df0 2024-08-17T02:31:16.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.558+0000 7f88d1c00640 1 -- 172.21.15.106:0/2796213688 --> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f88cc064db0 con 0x7f88ac065180 2024-08-17T02:31:16.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.559+0000 7f88c2000640 1 -- 172.21.15.106:0/2796213688 <== mgr.4107 v2:172.21.15.106:6832/36860 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f88cc064db0 con 0x7f88ac065180 2024-08-17T02:31:16.559 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 0 to deep-scrub 2024-08-17T02:31:16.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.561+0000 7f88d1c00640 1 -- 172.21.15.106:0/2796213688 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f88ac065180 msgr2=0x7f88ac067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.561+0000 7f88d1c00640 1 --2- 172.21.15.106:0/2796213688 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f88ac065180 0x7f88ac067630 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f88bc0011e0 tx=0x7f88bc000bc0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.561+0000 7f88d1c00640 1 -- 172.21.15.106:0/2796213688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88cc155df0 msgr2=0x7f88cc0adc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.561+0000 7f88d1c00640 1 --2- 172.21.15.106:0/2796213688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88cc155df0 0x7f88cc0adc70 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f88c400c7c0 tx=0x7f88c40015b0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.561+0000 7f88d1c00640 1 -- 172.21.15.106:0/2796213688 shutdown_connections 2024-08-17T02:31:16.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.561+0000 7f88d1c00640 1 --2- 172.21.15.106:0/2796213688 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f88ac065180 0x7f88ac067630 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.561+0000 7f88d1c00640 1 --2- 172.21.15.106:0/2796213688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88cc155df0 0x7f88cc0adc70 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.561+0000 7f88d1c00640 1 --2- 172.21.15.106:0/2796213688 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f88cc155a20 0x7f88cc169730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.561+0000 7f88d1c00640 1 --2- 172.21.15.106:0/2796213688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88cc06df00 0x7f88cc166940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.561+0000 7f88d1c00640 1 -- 172.21.15.106:0/2796213688 >> 172.21.15.106:0/2796213688 conn(0x7f88cc0cb9b0 msgr2=0x7f88cc153e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:16.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.561+0000 7f88d1c00640 1 -- 172.21.15.106:0/2796213688 shutdown_connections 2024-08-17T02:31:16.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.561+0000 7f88d1c00640 1 -- 172.21.15.106:0/2796213688 wait complete. 2024-08-17T02:31:16.576 INFO:tasks.ceph:Scrubbing osd.1 2024-08-17T02:31:16.576 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:31:16.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.727+0000 7f8b29e00640 1 Processor -- start 2024-08-17T02:31:16.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.727+0000 7f8b29e00640 1 -- start start 2024-08-17T02:31:16.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.728+0000 7f8b29e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8b24156890 0x7f8b2406dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.728+0000 7f8b29e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8b24156c60 0x7f8b2406e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.728+0000 7f8b29e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b240ae9b0 con 0x7f8b240c8130 2024-08-17T02:31:16.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.729+0000 7f8b29e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b240aa730 con 0x7f8b24156c60 2024-08-17T02:31:16.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.729+0000 7f8b29e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b240aa9f0 con 0x7f8b24156890 2024-08-17T02:31:16.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.729+0000 7f8b1a000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8b24156c60 0x7f8b2406e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.729+0000 7f8b1a000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8b24156c60 0x7f8b2406e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34708/0 (socket says 172.21.15.106:34708) 2024-08-17T02:31:16.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.729+0000 7f8b1a000640 1 -- 172.21.15.106:0/2784868550 learned_addr learned my addr 172.21.15.106:0/2784868550 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:16.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.729+0000 7f8b22a00640 1 --2- 172.21.15.106:0/2784868550 >> v2:172.21.15.171:3300/0 conn(0x7f8b24156890 0x7f8b2406dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.729+0000 7f8b1a000640 1 -- 172.21.15.106:0/2784868550 >> v2:172.21.15.171:3300/0 conn(0x7f8b24156890 msgr2=0x7f8b2406dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:16.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.729+0000 7f8b1a000640 1 --2- 172.21.15.106:0/2784868550 >> v2:172.21.15.171:3300/0 conn(0x7f8b24156890 0x7f8b2406dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.729+0000 7f8b1a000640 1 -- 172.21.15.106:0/2784868550 >> v1:172.21.15.171:6789/0 conn(0x7f8b240c8130 legacy=0x7f8b240c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:16.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.729+0000 7f8b1a000640 1 -- 172.21.15.106:0/2784868550 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b240ab320 con 0x7f8b24156c60 2024-08-17T02:31:16.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.730+0000 7f8b1a000640 1 --2- 172.21.15.106:0/2784868550 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b24156c60 0x7f8b2406e420 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8b2406c5c0 tx=0x7f8b0c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a15eb04a19b95fc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:16.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.730+0000 7f8b22000640 1 -- 172.21.15.106:0/2784868550 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c02adf0 con 0x7f8b24156c60 2024-08-17T02:31:16.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.731+0000 7f8b22000640 1 -- 172.21.15.106:0/2784868550 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0c032440 con 0x7f8b24156c60 2024-08-17T02:31:16.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.731+0000 7f8b22000640 1 -- 172.21.15.106:0/2784868550 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c032820 con 0x7f8b24156c60 2024-08-17T02:31:16.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.731+0000 7f8b29e00640 1 -- 172.21.15.106:0/2784868550 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b24156c60 msgr2=0x7f8b2406e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.731+0000 7f8b29e00640 1 --2- 172.21.15.106:0/2784868550 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b24156c60 0x7f8b2406e420 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8b2406c5c0 tx=0x7f8b0c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.731+0000 7f8b29e00640 1 -- 172.21.15.106:0/2784868550 shutdown_connections 2024-08-17T02:31:16.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.731+0000 7f8b29e00640 1 --2- 172.21.15.106:0/2784868550 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b24156c60 0x7f8b2406e420 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.731+0000 7f8b29e00640 1 --2- 172.21.15.106:0/2784868550 >> v2:172.21.15.171:3300/0 conn(0x7f8b24156890 0x7f8b2406dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.731+0000 7f8b29e00640 1 -- 172.21.15.106:0/2784868550 >> 172.21.15.106:0/2784868550 conn(0x7f8b24067750 msgr2=0x7f8b2406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:16.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.731+0000 7f8b29e00640 1 -- 172.21.15.106:0/2784868550 shutdown_connections 2024-08-17T02:31:16.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.731+0000 7f8b29e00640 1 -- 172.21.15.106:0/2784868550 wait complete. 2024-08-17T02:31:16.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.733+0000 7f8b29e00640 1 Processor -- start 2024-08-17T02:31:16.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.733+0000 7f8b29e00640 1 -- start start 2024-08-17T02:31:16.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.734+0000 7f8b29e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b240c8130 0x7f8b2414fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.734+0000 7f8b29e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b24156890 0x7f8b241519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.734+0000 7f8b29e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b24156c60 0x7f8b24151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.734+0000 7f8b29e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b24169e90 con 0x7f8b24156c60 2024-08-17T02:31:16.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.734+0000 7f8b29e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b24169c20 con 0x7f8b240c8130 2024-08-17T02:31:16.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.734+0000 7f8b29e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b241690a0 con 0x7f8b24156890 2024-08-17T02:31:16.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.734+0000 7f8b23400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b24156c60 0x7f8b24151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.734+0000 7f8b22a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b240c8130 0x7f8b2414fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.734+0000 7f8b23400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b24156c60 0x7f8b24151f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34716/0 (socket says 172.21.15.106:34716) 2024-08-17T02:31:16.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.734+0000 7f8b23400640 1 -- 172.21.15.106:0/3611866614 learned_addr learned my addr 172.21.15.106:0/3611866614 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:16.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.734+0000 7f8b1a000640 1 --2- 172.21.15.106:0/3611866614 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b24156890 0x7f8b241519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.735+0000 7f8b23400640 1 -- 172.21.15.106:0/3611866614 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b24156890 msgr2=0x7f8b241519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.735+0000 7f8b23400640 1 --2- 172.21.15.106:0/3611866614 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b24156890 0x7f8b241519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.735+0000 7f8b23400640 1 -- 172.21.15.106:0/3611866614 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b240c8130 msgr2=0x7f8b2414fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.735+0000 7f8b23400640 1 --2- 172.21.15.106:0/3611866614 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b240c8130 0x7f8b2414fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.735+0000 7f8b23400640 1 -- 172.21.15.106:0/3611866614 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0c009450 con 0x7f8b24156c60 2024-08-17T02:31:16.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.735+0000 7f8b23400640 1 --2- 172.21.15.106:0/3611866614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b24156c60 0x7f8b24151f00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00c860 tx=0x7f8b1c001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:16.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.735+0000 7f8b1aa00640 1 -- 172.21.15.106:0/3611866614 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c00ce50 con 0x7f8b24156c60 2024-08-17T02:31:16.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.735+0000 7f8b1aa00640 1 -- 172.21.15.106:0/3611866614 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1c00a850 con 0x7f8b24156c60 2024-08-17T02:31:16.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.735+0000 7f8b1aa00640 1 -- 172.21.15.106:0/3611866614 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c00ac10 con 0x7f8b24156c60 2024-08-17T02:31:16.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.735+0000 7f8b29e00640 1 -- 172.21.15.106:0/3611866614 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b24169380 con 0x7f8b24156c60 2024-08-17T02:31:16.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.735+0000 7f8b29e00640 1 -- 172.21.15.106:0/3611866614 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b24169940 con 0x7f8b24156c60 2024-08-17T02:31:16.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.736+0000 7f8b29e00640 1 -- 172.21.15.106:0/3611866614 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8b240710c0 con 0x7f8b24156c60 2024-08-17T02:31:16.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.737+0000 7f8b1aa00640 1 -- 172.21.15.106:0/3611866614 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8b1c012630 con 0x7f8b24156c60 2024-08-17T02:31:16.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.738+0000 7f8b1aa00640 1 --2- 172.21.15.106:0/3611866614 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8b00065150 0x7f8b00067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.738+0000 7f8b1aa00640 1 -- 172.21.15.106:0/3611866614 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f8b1c082340 con 0x7f8b24156c60 2024-08-17T02:31:16.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.738+0000 7f8b1aa00640 1 --2- 172.21.15.106:0/3611866614 >> [v2:172.21.15.106:6824/37125,v1:172.21.15.106:6825/37125] conn(0x7f8b0006b040 0x7f8b0006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.738+0000 7f8b1aa00640 1 -- 172.21.15.106:0/3611866614 --> [v2:172.21.15.106:6824/37125,v1:172.21.15.106:6825/37125] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8b0006db00 con 0x7f8b0006b040 2024-08-17T02:31:16.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.738+0000 7f8b1aa00640 1 -- 172.21.15.106:0/3611866614 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b1c0848a0 con 0x7f8b24156c60 2024-08-17T02:31:16.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.738+0000 7f8b22a00640 1 --2- 172.21.15.106:0/3611866614 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8b00065150 0x7f8b00067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.738+0000 7f8b1a000640 1 --2- 172.21.15.106:0/3611866614 >> [v2:172.21.15.106:6824/37125,v1:172.21.15.106:6825/37125] conn(0x7f8b0006b040 0x7f8b0006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.739+0000 7f8b22a00640 1 --2- 172.21.15.106:0/3611866614 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8b00065150 0x7f8b00067600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8b241564a0 tx=0x7f8b14008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:16.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.739+0000 7f8b1a000640 1 --2- 172.21.15.106:0/3611866614 >> [v2:172.21.15.106:6824/37125,v1:172.21.15.106:6825/37125] conn(0x7f8b0006b040 0x7f8b0006d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:16.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.740+0000 7f8b1aa00640 1 -- 172.21.15.106:0/3611866614 <== osd.1 v2:172.21.15.106:6824/37125 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f8b0006db00 con 0x7f8b0006b040 2024-08-17T02:31:16.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.752+0000 7f8b29e00640 1 -- 172.21.15.106:0/3611866614 --> [v2:172.21.15.106:6824/37125,v1:172.21.15.106:6825/37125] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8b24150200 con 0x7f8b0006b040 2024-08-17T02:31:16.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.753+0000 7f8b1aa00640 1 -- 172.21.15.106:0/3611866614 <== osd.1 v2:172.21.15.106:6824/37125 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8b24150200 con 0x7f8b0006b040 2024-08-17T02:31:16.753 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-08-17T02:31:16.753 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:31:16.754 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-08-17T02:31:16.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.753+0000 7f8b29e00640 1 -- 172.21.15.106:0/3611866614 >> [v2:172.21.15.106:6824/37125,v1:172.21.15.106:6825/37125] conn(0x7f8b0006b040 msgr2=0x7f8b0006d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.753+0000 7f8b29e00640 1 --2- 172.21.15.106:0/3611866614 >> [v2:172.21.15.106:6824/37125,v1:172.21.15.106:6825/37125] conn(0x7f8b0006b040 0x7f8b0006d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.753+0000 7f8b29e00640 1 -- 172.21.15.106:0/3611866614 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8b00065150 msgr2=0x7f8b00067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.753+0000 7f8b29e00640 1 --2- 172.21.15.106:0/3611866614 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f8b00065150 0x7f8b00067600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8b241564a0 tx=0x7f8b14008040 comp rx=0 tx=0).stop 2024-08-17T02:31:16.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.753+0000 7f8b29e00640 1 -- 172.21.15.106:0/3611866614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b24156c60 msgr2=0x7f8b24151f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.753+0000 7f8b29e00640 1 --2- 172.21.15.106:0/3611866614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b24156c60 0x7f8b24151f00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00c860 tx=0x7f8b1c001690 comp rx=0 tx=0).stop 2024-08-17T02:31:16.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.753+0000 7f8b23400640 1 -- 172.21.15.106:0/3611866614 reap_dead start 2024-08-17T02:31:16.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.753+0000 7f8b29e00640 1 -- 172.21.15.106:0/3611866614 shutdown_connections 2024-08-17T02:31:16.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.753+0000 7f8b29e00640 1 -- 172.21.15.106:0/3611866614 >> 172.21.15.106:0/3611866614 conn(0x7f8b24067750 msgr2=0x7f8b24068ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:16.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.753+0000 7f8b29e00640 1 -- 172.21.15.106:0/3611866614 shutdown_connections 2024-08-17T02:31:16.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.753+0000 7f8b29e00640 1 -- 172.21.15.106:0/3611866614 wait complete. 2024-08-17T02:31:16.767 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-17T02:31:16.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.915+0000 7f5ec1a00640 1 Processor -- start 2024-08-17T02:31:16.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.915+0000 7f5ec1a00640 1 -- start start 2024-08-17T02:31:16.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.916+0000 7f5ec1a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5ebc159ca0 0x7f5ebc0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.916+0000 7f5ec1a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ebc0cadc0 con 0x7f5ebc0ccca0 2024-08-17T02:31:16.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.916+0000 7f5ec1a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ebc0cb060 con 0x7f5ebc0ca8a0 2024-08-17T02:31:16.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.916+0000 7f5ec1a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ebc0cd6e0 con 0x7f5ebc159ca0 2024-08-17T02:31:16.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.916+0000 7f5ebbe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5ebc159ca0 0x7f5ebc0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.916+0000 7f5ec1000640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5ebc0ccca0 0x7f5ebc162860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50506/0 (socket says 172.21.15.106:50506) 2024-08-17T02:31:16.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.916+0000 7f5ec1000640 1 -- 172.21.15.106:0/3688195970 learned_addr learned my addr 172.21.15.106:0/3688195970 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:31:16.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.917+0000 7f5ebbe00640 1 -- 172.21.15.106:0/3688195970 >> v1:172.21.15.171:6789/0 conn(0x7f5ebc0ca8a0 legacy=0x7f5ebc0cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:16.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.917+0000 7f5ebbe00640 1 -- 172.21.15.106:0/3688195970 >> v1:172.21.15.106:6789/0 conn(0x7f5ebc0ccca0 legacy=0x7f5ebc162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.917+0000 7f5ebbe00640 1 -- 172.21.15.106:0/3688195970 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ebc0cb300 con 0x7f5ebc159ca0 2024-08-17T02:31:16.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.918+0000 7f5ebbe00640 1 --2- 172.21.15.106:0/3688195970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ebc159ca0 0x7f5ebc0ca360 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5eac009850 tx=0x7f5eac0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49bdf28284023376 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:16.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.918+0000 7f5ebb400640 1 -- 172.21.15.106:0/3688195970 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac02ad90 con 0x7f5ebc159ca0 2024-08-17T02:31:16.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.918+0000 7f5ebb400640 1 -- 172.21.15.106:0/3688195970 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eac032440 con 0x7f5ebc159ca0 2024-08-17T02:31:16.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.918+0000 7f5ebb400640 1 -- 172.21.15.106:0/3688195970 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac032820 con 0x7f5ebc159ca0 2024-08-17T02:31:16.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.919+0000 7f5ec1a00640 1 -- 172.21.15.106:0/3688195970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ebc159ca0 msgr2=0x7f5ebc0ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.919+0000 7f5ec1a00640 1 --2- 172.21.15.106:0/3688195970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ebc159ca0 0x7f5ebc0ca360 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5eac009850 tx=0x7f5eac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.919+0000 7f5ec1a00640 1 -- 172.21.15.106:0/3688195970 shutdown_connections 2024-08-17T02:31:16.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.919+0000 7f5ec1a00640 1 --2- 172.21.15.106:0/3688195970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ebc159ca0 0x7f5ebc0ca360 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.919+0000 7f5ec1a00640 1 -- 172.21.15.106:0/3688195970 >> 172.21.15.106:0/3688195970 conn(0x7f5ebc098e00 msgr2=0x7f5ebc06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:16.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.919+0000 7f5ec1a00640 1 -- 172.21.15.106:0/3688195970 shutdown_connections 2024-08-17T02:31:16.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.919+0000 7f5ec1a00640 1 -- 172.21.15.106:0/3688195970 wait complete. 2024-08-17T02:31:16.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.920+0000 7f5ec1a00640 1 Processor -- start 2024-08-17T02:31:16.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.920+0000 7f5ec1a00640 1 -- start start 2024-08-17T02:31:16.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.921+0000 7f5ec1a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ebc0ca8a0 0x7f5ebc149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.921+0000 7f5ec1a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ebc0ccca0 0x7f5ebc0ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.921+0000 7f5ec1a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ebc159ca0 0x7f5ebc0cef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.921+0000 7f5ec1a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc14afe0 con 0x7f5ebc0ccca0 2024-08-17T02:31:16.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.921+0000 7f5ec1a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc09d060 con 0x7f5ebc0ca8a0 2024-08-17T02:31:16.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.921+0000 7f5ec1a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc09d340 con 0x7f5ebc159ca0 2024-08-17T02:31:16.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.922+0000 7f5eb3400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ebc0ccca0 0x7f5ebc0ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.922+0000 7f5eb3400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ebc0ccca0 0x7f5ebc0ce9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34734/0 (socket says 172.21.15.106:34734) 2024-08-17T02:31:16.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.922+0000 7f5eb3400640 1 -- 172.21.15.106:0/238706000 learned_addr learned my addr 172.21.15.106:0/238706000 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:16.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.922+0000 7f5ebbe00640 1 --2- 172.21.15.106:0/238706000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ebc0ca8a0 0x7f5ebc149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.922+0000 7f5ec1000640 1 --2- 172.21.15.106:0/238706000 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ebc159ca0 0x7f5ebc0cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.922+0000 7f5eb3400640 1 -- 172.21.15.106:0/238706000 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ebc159ca0 msgr2=0x7f5ebc0cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.922+0000 7f5eb3400640 1 --2- 172.21.15.106:0/238706000 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ebc159ca0 0x7f5ebc0cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.922+0000 7f5eb3400640 1 -- 172.21.15.106:0/238706000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ebc0ca8a0 msgr2=0x7f5ebc149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:16.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.922+0000 7f5eb3400640 1 --2- 172.21.15.106:0/238706000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ebc0ca8a0 0x7f5ebc149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:16.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.922+0000 7f5eb3400640 1 -- 172.21.15.106:0/238706000 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eac009390 con 0x7f5ebc0ccca0 2024-08-17T02:31:16.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.922+0000 7f5ec1000640 1 --2- 172.21.15.106:0/238706000 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ebc159ca0 0x7f5ebc0cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:31:16.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.922+0000 7f5eb3400640 1 --2- 172.21.15.106:0/238706000 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ebc0ccca0 0x7f5ebc0ce9c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5ea400c5e0 tx=0x7f5ea4007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:16.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.922+0000 7f5eb3e00640 1 -- 172.21.15.106:0/238706000 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea4012630 con 0x7f5ebc0ccca0 2024-08-17T02:31:16.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.923+0000 7f5eb3e00640 1 -- 172.21.15.106:0/238706000 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea40127b0 con 0x7f5ebc0ccca0 2024-08-17T02:31:16.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.923+0000 7f5eb3e00640 1 -- 172.21.15.106:0/238706000 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea4012bb0 con 0x7f5ebc0ccca0 2024-08-17T02:31:16.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.923+0000 7f5ec1a00640 1 -- 172.21.15.106:0/238706000 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ebc09d620 con 0x7f5ebc0ccca0 2024-08-17T02:31:16.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.923+0000 7f5ec1a00640 1 -- 172.21.15.106:0/238706000 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ebc14a510 con 0x7f5ebc0ccca0 2024-08-17T02:31:16.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.924+0000 7f5ec1a00640 1 -- 172.21.15.106:0/238706000 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ebc071050 con 0x7f5ebc0ccca0 2024-08-17T02:31:16.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.925+0000 7f5eb3e00640 1 -- 172.21.15.106:0/238706000 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5ea401b400 con 0x7f5ebc0ccca0 2024-08-17T02:31:16.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.925+0000 7f5eb3e00640 1 --2- 172.21.15.106:0/238706000 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5e98065150 0x7f5e98067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:16.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.925+0000 7f5eb3e00640 1 -- 172.21.15.106:0/238706000 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f5ea4082420 con 0x7f5ebc0ccca0 2024-08-17T02:31:16.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.926+0000 7f5ebbe00640 1 --2- 172.21.15.106:0/238706000 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5e98065150 0x7f5e98067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:16.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.926+0000 7f5ebbe00640 1 --2- 172.21.15.106:0/238706000 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5e98065150 0x7f5e98067600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5eac034000 tx=0x7f5eac032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:16.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:16.929+0000 7f5eb3e00640 1 -- 172.21.15.106:0/238706000 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5ea40507a0 con 0x7f5ebc0ccca0 2024-08-17T02:31:17.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.099+0000 7f5ec1a00640 1 -- 172.21.15.106:0/238706000 --> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ebc159820 con 0x7f5e98065150 2024-08-17T02:31:17.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.100+0000 7f5eb3e00640 1 -- 172.21.15.106:0/238706000 <== mgr.4107 v2:172.21.15.106:6832/36860 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5ebc159820 con 0x7f5e98065150 2024-08-17T02:31:17.100 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 1 to deep-scrub 2024-08-17T02:31:17.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.102+0000 7f5ec1a00640 1 -- 172.21.15.106:0/238706000 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5e98065150 msgr2=0x7f5e98067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.102+0000 7f5ec1a00640 1 --2- 172.21.15.106:0/238706000 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5e98065150 0x7f5e98067600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5eac034000 tx=0x7f5eac032000 comp rx=0 tx=0).stop 2024-08-17T02:31:17.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.102+0000 7f5ec1a00640 1 -- 172.21.15.106:0/238706000 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ebc0ccca0 msgr2=0x7f5ebc0ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.102+0000 7f5ec1a00640 1 --2- 172.21.15.106:0/238706000 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ebc0ccca0 0x7f5ebc0ce9c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5ea400c5e0 tx=0x7f5ea4007ed0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.102+0000 7f5ec1a00640 1 -- 172.21.15.106:0/238706000 shutdown_connections 2024-08-17T02:31:17.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.102+0000 7f5ec1a00640 1 --2- 172.21.15.106:0/238706000 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5ebc159ca0 0x7f5ebc0cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.102+0000 7f5ec1a00640 1 --2- 172.21.15.106:0/238706000 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f5e98065150 0x7f5e98067600 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.102+0000 7f5ec1a00640 1 --2- 172.21.15.106:0/238706000 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ebc0ccca0 0x7f5ebc0ce9c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.102+0000 7f5ec1a00640 1 --2- 172.21.15.106:0/238706000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5ebc0ca8a0 0x7f5ebc149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.102+0000 7f5ec1a00640 1 -- 172.21.15.106:0/238706000 >> 172.21.15.106:0/238706000 conn(0x7f5ebc098e00 msgr2=0x7f5ebc0d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:17.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.102+0000 7f5ec1a00640 1 -- 172.21.15.106:0/238706000 shutdown_connections 2024-08-17T02:31:17.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.102+0000 7f5ec1a00640 1 -- 172.21.15.106:0/238706000 wait complete. 2024-08-17T02:31:17.118 INFO:tasks.ceph:Scrubbing osd.2 2024-08-17T02:31:17.119 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:31:17.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.269+0000 7fe6f0600640 1 Processor -- start 2024-08-17T02:31:17.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.269+0000 7fe6f0600640 1 -- start start 2024-08-17T02:31:17.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.270+0000 7fe6f0600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe6e8156890 0x7fe6e806dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.270+0000 7fe6f0600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6e80c8840 0x7fe6e806e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.270+0000 7fe6f0600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e80ae9b0 con 0x7fe6e8156c60 2024-08-17T02:31:17.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.270+0000 7fe6f0600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e80aa730 con 0x7fe6e8156890 2024-08-17T02:31:17.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.270+0000 7fe6f0600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e80aa9f0 con 0x7fe6e80c8840 2024-08-17T02:31:17.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.270+0000 7fe6edc00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe6e8156890 0x7fe6e806dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.270+0000 7fe6edc00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe6e8156890 0x7fe6e806dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34738/0 (socket says 172.21.15.106:34738) 2024-08-17T02:31:17.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.271+0000 7fe6edc00640 1 -- 172.21.15.106:0/796913700 learned_addr learned my addr 172.21.15.106:0/796913700 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:17.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.271+0000 7fe6ee600640 1 --2- 172.21.15.106:0/796913700 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6e80c8840 0x7fe6e806e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.271+0000 7fe6edc00640 1 -- 172.21.15.106:0/796913700 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6e80c8840 msgr2=0x7fe6e806e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:17.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.271+0000 7fe6edc00640 1 --2- 172.21.15.106:0/796913700 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6e80c8840 0x7fe6e806e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.271+0000 7fe6edc00640 1 -- 172.21.15.106:0/796913700 >> v1:172.21.15.171:6789/0 conn(0x7fe6e8156c60 legacy=0x7fe6e80c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.271+0000 7fe6edc00640 1 -- 172.21.15.106:0/796913700 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e80ab320 con 0x7fe6e8156890 2024-08-17T02:31:17.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.271+0000 7fe6ee600640 1 --2- 172.21.15.106:0/796913700 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6e80c8840 0x7fe6e806e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:31:17.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.272+0000 7fe6edc00640 1 --2- 172.21.15.106:0/796913700 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6e8156890 0x7fe6e806dee0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc009910 tx=0x7fe6dc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b546fbd93967e082 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:17.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.272+0000 7fe6e7e00640 1 -- 172.21.15.106:0/796913700 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc02adb0 con 0x7fe6e8156890 2024-08-17T02:31:17.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.272+0000 7fe6e7e00640 1 -- 172.21.15.106:0/796913700 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6dc032440 con 0x7fe6e8156890 2024-08-17T02:31:17.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.272+0000 7fe6e7e00640 1 -- 172.21.15.106:0/796913700 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc032820 con 0x7fe6e8156890 2024-08-17T02:31:17.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.273+0000 7fe6f0600640 1 -- 172.21.15.106:0/796913700 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6e8156890 msgr2=0x7fe6e806dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.273+0000 7fe6f0600640 1 --2- 172.21.15.106:0/796913700 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6e8156890 0x7fe6e806dee0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc009910 tx=0x7fe6dc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.273+0000 7fe6f0600640 1 -- 172.21.15.106:0/796913700 shutdown_connections 2024-08-17T02:31:17.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.273+0000 7fe6f0600640 1 --2- 172.21.15.106:0/796913700 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6e80c8840 0x7fe6e806e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.273+0000 7fe6f0600640 1 --2- 172.21.15.106:0/796913700 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6e8156890 0x7fe6e806dee0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.273+0000 7fe6f0600640 1 -- 172.21.15.106:0/796913700 >> 172.21.15.106:0/796913700 conn(0x7fe6e8067750 msgr2=0x7fe6e806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:17.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.273+0000 7fe6f0600640 1 -- 172.21.15.106:0/796913700 shutdown_connections 2024-08-17T02:31:17.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.273+0000 7fe6f0600640 1 -- 172.21.15.106:0/796913700 wait complete. 2024-08-17T02:31:17.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.274+0000 7fe6f0600640 1 Processor -- start 2024-08-17T02:31:17.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.274+0000 7fe6f0600640 1 -- start start 2024-08-17T02:31:17.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.275+0000 7fe6f0600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6e80c8840 0x7fe6e8155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.275+0000 7fe6f0600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6e8156890 0x7fe6e8159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.275+0000 7fe6f0600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6e8156c60 0x7fe6e81502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.275+0000 7fe6f0600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e8168110 con 0x7fe6e80c8840 2024-08-17T02:31:17.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.275+0000 7fe6f0600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e8158260 con 0x7fe6e8156890 2024-08-17T02:31:17.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.275+0000 7fe6f0600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e8158540 con 0x7fe6e8156c60 2024-08-17T02:31:17.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.276+0000 7fe6edc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6e80c8840 0x7fe6e8155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.276+0000 7fe6edc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6e80c8840 0x7fe6e8155590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34748/0 (socket says 172.21.15.106:34748) 2024-08-17T02:31:17.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.276+0000 7fe6edc00640 1 -- 172.21.15.106:0/1872912758 learned_addr learned my addr 172.21.15.106:0/1872912758 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:17.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.276+0000 7fe6ed200640 1 --2- 172.21.15.106:0/1872912758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6e8156890 0x7fe6e8159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.276+0000 7fe6ee600640 1 --2- 172.21.15.106:0/1872912758 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6e8156c60 0x7fe6e81502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.276+0000 7fe6edc00640 1 -- 172.21.15.106:0/1872912758 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6e8156c60 msgr2=0x7fe6e81502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.276+0000 7fe6edc00640 1 --2- 172.21.15.106:0/1872912758 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe6e8156c60 0x7fe6e81502d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.276+0000 7fe6edc00640 1 -- 172.21.15.106:0/1872912758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6e8156890 msgr2=0x7fe6e8159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.276+0000 7fe6edc00640 1 --2- 172.21.15.106:0/1872912758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6e8156890 0x7fe6e8159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.276+0000 7fe6edc00640 1 -- 172.21.15.106:0/1872912758 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6dc009450 con 0x7fe6e80c8840 2024-08-17T02:31:17.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.276+0000 7fe6edc00640 1 --2- 172.21.15.106:0/1872912758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6e80c8840 0x7fe6e8155590 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc035040 tx=0x7fe6dc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:17.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.277+0000 7fe6e4c00640 1 -- 172.21.15.106:0/1872912758 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc000c90 con 0x7fe6e80c8840 2024-08-17T02:31:17.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.277+0000 7fe6e4c00640 1 -- 172.21.15.106:0/1872912758 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6dc031a40 con 0x7fe6e80c8840 2024-08-17T02:31:17.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.277+0000 7fe6e4c00640 1 -- 172.21.15.106:0/1872912758 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc031e00 con 0x7fe6e80c8840 2024-08-17T02:31:17.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.277+0000 7fe6f0600640 1 -- 172.21.15.106:0/1872912758 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e8158820 con 0x7fe6e80c8840 2024-08-17T02:31:17.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.277+0000 7fe6f0600640 1 -- 172.21.15.106:0/1872912758 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e8158de0 con 0x7fe6e80c8840 2024-08-17T02:31:17.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.278+0000 7fe6f0600640 1 -- 172.21.15.106:0/1872912758 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe6e80710c0 con 0x7fe6e80c8840 2024-08-17T02:31:17.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.279+0000 7fe6e4c00640 1 -- 172.21.15.106:0/1872912758 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe6dc039040 con 0x7fe6e80c8840 2024-08-17T02:31:17.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.279+0000 7fe6e4c00640 1 --2- 172.21.15.106:0/1872912758 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe6c8065150 0x7fe6c8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.279+0000 7fe6e4c00640 1 -- 172.21.15.106:0/1872912758 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fe6dc0a1e70 con 0x7fe6e80c8840 2024-08-17T02:31:17.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.280+0000 7fe6ed200640 1 --2- 172.21.15.106:0/1872912758 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe6c8065150 0x7fe6c8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.280+0000 7fe6e4c00640 1 --2- 172.21.15.106:0/1872912758 >> [v2:172.21.15.106:6816/37126,v1:172.21.15.106:6817/37126] conn(0x7fe6c806b040 0x7fe6c806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.280+0000 7fe6e4c00640 1 -- 172.21.15.106:0/1872912758 --> [v2:172.21.15.106:6816/37126,v1:172.21.15.106:6817/37126] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe6c806db00 con 0x7fe6c806b040 2024-08-17T02:31:17.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.280+0000 7fe6e4c00640 1 -- 172.21.15.106:0/1872912758 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6dc0a44b0 con 0x7fe6e80c8840 2024-08-17T02:31:17.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.280+0000 7fe6ee600640 1 --2- 172.21.15.106:0/1872912758 >> [v2:172.21.15.106:6816/37126,v1:172.21.15.106:6817/37126] conn(0x7fe6c806b040 0x7fe6c806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.280+0000 7fe6ed200640 1 --2- 172.21.15.106:0/1872912758 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe6c8065150 0x7fe6c8067600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80af630 tx=0x7fe6d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:17.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.280+0000 7fe6ee600640 1 --2- 172.21.15.106:0/1872912758 >> [v2:172.21.15.106:6816/37126,v1:172.21.15.106:6817/37126] conn(0x7fe6c806b040 0x7fe6c806d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:17.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.281+0000 7fe6e4c00640 1 -- 172.21.15.106:0/1872912758 <== osd.2 v2:172.21.15.106:6816/37126 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe6c806db00 con 0x7fe6c806b040 2024-08-17T02:31:17.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.294+0000 7fe6f0600640 1 -- 172.21.15.106:0/1872912758 --> [v2:172.21.15.106:6816/37126,v1:172.21.15.106:6817/37126] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe6e80c7f10 con 0x7fe6c806b040 2024-08-17T02:31:17.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.294+0000 7fe6e4c00640 1 -- 172.21.15.106:0/1872912758 <== osd.2 v2:172.21.15.106:6816/37126 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe6e80c7f10 con 0x7fe6c806b040 2024-08-17T02:31:17.295 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-08-17T02:31:17.295 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:31:17.295 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-08-17T02:31:17.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.295+0000 7fe6f0600640 1 -- 172.21.15.106:0/1872912758 >> [v2:172.21.15.106:6816/37126,v1:172.21.15.106:6817/37126] conn(0x7fe6c806b040 msgr2=0x7fe6c806d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.295+0000 7fe6f0600640 1 --2- 172.21.15.106:0/1872912758 >> [v2:172.21.15.106:6816/37126,v1:172.21.15.106:6817/37126] conn(0x7fe6c806b040 0x7fe6c806d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.295+0000 7fe6f0600640 1 -- 172.21.15.106:0/1872912758 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe6c8065150 msgr2=0x7fe6c8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.295+0000 7fe6f0600640 1 --2- 172.21.15.106:0/1872912758 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fe6c8065150 0x7fe6c8067600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80af630 tx=0x7fe6d4009040 comp rx=0 tx=0).stop 2024-08-17T02:31:17.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.295+0000 7fe6f0600640 1 -- 172.21.15.106:0/1872912758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6e80c8840 msgr2=0x7fe6e8155590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.295+0000 7fe6f0600640 1 --2- 172.21.15.106:0/1872912758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6e80c8840 0x7fe6e8155590 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc035040 tx=0x7fe6dc032000 comp rx=0 tx=0).stop 2024-08-17T02:31:17.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.295+0000 7fe6ee600640 1 -- 172.21.15.106:0/1872912758 reap_dead start 2024-08-17T02:31:17.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.295+0000 7fe6f0600640 1 -- 172.21.15.106:0/1872912758 shutdown_connections 2024-08-17T02:31:17.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.295+0000 7fe6f0600640 1 -- 172.21.15.106:0/1872912758 >> 172.21.15.106:0/1872912758 conn(0x7fe6e8067750 msgr2=0x7fe6e80686f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:17.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.295+0000 7fe6f0600640 1 -- 172.21.15.106:0/1872912758 shutdown_connections 2024-08-17T02:31:17.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.295+0000 7fe6f0600640 1 -- 172.21.15.106:0/1872912758 wait complete. 2024-08-17T02:31:17.310 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-17T02:31:17.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.457+0000 7f06e2a00640 1 Processor -- start 2024-08-17T02:31:17.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.458+0000 7f06e2a00640 1 -- start start 2024-08-17T02:31:17.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.459+0000 7f06e2a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06dc155900 0x7f06dc155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.459+0000 7f06e2a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f06dc158b30 0x7f06dc0ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.459+0000 7f06e2a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06dc157690 con 0x7f06dc0b0270 2024-08-17T02:31:17.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.459+0000 7f06e2a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06dc156a80 con 0x7f06dc158b30 2024-08-17T02:31:17.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.459+0000 7f06e2a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc156d60 con 0x7f06dc155900 2024-08-17T02:31:17.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.459+0000 7f06e2000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f06dc158b30 0x7f06dc0ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.459+0000 7f06e2000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f06dc158b30 0x7f06dc0ae6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34762/0 (socket says 172.21.15.106:34762) 2024-08-17T02:31:17.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.459+0000 7f06e2000640 1 -- 172.21.15.106:0/1270933749 learned_addr learned my addr 172.21.15.106:0/1270933749 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:17.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.459+0000 7f06e1600640 1 --2- 172.21.15.106:0/1270933749 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06dc155900 0x7f06dc155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.459+0000 7f06e2000640 1 -- 172.21.15.106:0/1270933749 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06dc155900 msgr2=0x7f06dc155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:17.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.459+0000 7f06e2000640 1 --2- 172.21.15.106:0/1270933749 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06dc155900 0x7f06dc155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.459+0000 7f06e2000640 1 -- 172.21.15.106:0/1270933749 >> v1:172.21.15.171:6789/0 conn(0x7f06dc0b0270 legacy=0x7f06dc156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.460+0000 7f06e2000640 1 -- 172.21.15.106:0/1270933749 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc157040 con 0x7f06dc158b30 2024-08-17T02:31:17.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.460+0000 7f06e1600640 1 --2- 172.21.15.106:0/1270933749 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06dc155900 0x7f06dc155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:31:17.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.460+0000 7f06e2000640 1 --2- 172.21.15.106:0/1270933749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06dc158b30 0x7f06dc0ae6b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009f20 tx=0x7f06d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a4c60b2afba396 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:17.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.461+0000 7f06dbe00640 1 -- 172.21.15.106:0/1270933749 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d4031400 con 0x7f06dc158b30 2024-08-17T02:31:17.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.461+0000 7f06dbe00640 1 -- 172.21.15.106:0/1270933749 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d402d050 con 0x7f06dc158b30 2024-08-17T02:31:17.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.461+0000 7f06dbe00640 1 -- 172.21.15.106:0/1270933749 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d40317d0 con 0x7f06dc158b30 2024-08-17T02:31:17.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.461+0000 7f06e2a00640 1 -- 172.21.15.106:0/1270933749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06dc158b30 msgr2=0x7f06dc0ae6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.461+0000 7f06e2a00640 1 --2- 172.21.15.106:0/1270933749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06dc158b30 0x7f06dc0ae6b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009f20 tx=0x7f06d4009840 comp rx=0 tx=0).stop 2024-08-17T02:31:17.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.461+0000 7f06e2a00640 1 -- 172.21.15.106:0/1270933749 shutdown_connections 2024-08-17T02:31:17.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.461+0000 7f06e2a00640 1 --2- 172.21.15.106:0/1270933749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06dc158b30 0x7f06dc0ae6b0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.461+0000 7f06e2a00640 1 --2- 172.21.15.106:0/1270933749 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06dc155900 0x7f06dc155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.461+0000 7f06e2a00640 1 -- 172.21.15.106:0/1270933749 >> 172.21.15.106:0/1270933749 conn(0x7f06dc067750 msgr2=0x7f06dc0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:17.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.461+0000 7f06e2a00640 1 -- 172.21.15.106:0/1270933749 shutdown_connections 2024-08-17T02:31:17.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.461+0000 7f06e2a00640 1 -- 172.21.15.106:0/1270933749 wait complete. 2024-08-17T02:31:17.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.463+0000 7f06e2a00640 1 Processor -- start 2024-08-17T02:31:17.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.463+0000 7f06e2a00640 1 -- start start 2024-08-17T02:31:17.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.464+0000 7f06e2a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06dc0b0270 0x7f06dc150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.464+0000 7f06e2a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06dc155900 0x7f06dc153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.464+0000 7f06e2a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06dc158b30 0x7f06dc146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.464+0000 7f06e2a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc14e170 con 0x7f06dc0b0270 2024-08-17T02:31:17.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.464+0000 7f06e2a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc154070 con 0x7f06dc158b30 2024-08-17T02:31:17.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.464+0000 7f06e2a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc154350 con 0x7f06dc155900 2024-08-17T02:31:17.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.464+0000 7f06e1600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06dc0b0270 0x7f06dc150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.464+0000 7f06e1600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06dc0b0270 0x7f06dc150dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34774/0 (socket says 172.21.15.106:34774) 2024-08-17T02:31:17.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.464+0000 7f06e1600640 1 -- 172.21.15.106:0/2889725450 learned_addr learned my addr 172.21.15.106:0/2889725450 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:17.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.464+0000 7f06e1600640 1 -- 172.21.15.106:0/2889725450 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06dc155900 msgr2=0x7f06dc153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.464+0000 7f06e1600640 1 --2- 172.21.15.106:0/2889725450 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06dc155900 0x7f06dc153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.464+0000 7f06e1600640 1 -- 172.21.15.106:0/2889725450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06dc158b30 msgr2=0x7f06dc146f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.464+0000 7f06e1600640 1 --2- 172.21.15.106:0/2889725450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06dc158b30 0x7f06dc146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.464+0000 7f06e1600640 1 -- 172.21.15.106:0/2889725450 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d4009ae0 con 0x7f06dc0b0270 2024-08-17T02:31:17.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.465+0000 7f06e1600640 1 --2- 172.21.15.106:0/2889725450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06dc0b0270 0x7f06dc150dc0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f06d000d890 tx=0x7f06d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:17.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.465+0000 7f06d8c00640 1 -- 172.21.15.106:0/2889725450 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d000de80 con 0x7f06dc0b0270 2024-08-17T02:31:17.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.465+0000 7f06d8c00640 1 -- 172.21.15.106:0/2889725450 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d000b8d0 con 0x7f06dc0b0270 2024-08-17T02:31:17.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.465+0000 7f06d8c00640 1 -- 172.21.15.106:0/2889725450 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d000bc90 con 0x7f06dc0b0270 2024-08-17T02:31:17.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.465+0000 7f06e2a00640 1 -- 172.21.15.106:0/2889725450 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06dc154630 con 0x7f06dc0b0270 2024-08-17T02:31:17.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.465+0000 7f06e2a00640 1 -- 172.21.15.106:0/2889725450 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06dc14bd50 con 0x7f06dc0b0270 2024-08-17T02:31:17.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.466+0000 7f06e2a00640 1 -- 172.21.15.106:0/2889725450 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06dc071050 con 0x7f06dc0b0270 2024-08-17T02:31:17.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.467+0000 7f06d8c00640 1 -- 172.21.15.106:0/2889725450 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f06d001e460 con 0x7f06dc0b0270 2024-08-17T02:31:17.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.468+0000 7f06d8c00640 1 --2- 172.21.15.106:0/2889725450 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f06bc065150 0x7f06bc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.468+0000 7f06d8c00640 1 -- 172.21.15.106:0/2889725450 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f06d00829a0 con 0x7f06dc0b0270 2024-08-17T02:31:17.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.468+0000 7f06e0c00640 1 --2- 172.21.15.106:0/2889725450 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f06bc065150 0x7f06bc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.468+0000 7f06e0c00640 1 --2- 172.21.15.106:0/2889725450 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f06bc065150 0x7f06bc067600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f06dc14c710 tx=0x7f06c8007ab0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:17.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.471+0000 7f06d8c00640 1 -- 172.21.15.106:0/2889725450 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f06d0050c60 con 0x7f06dc0b0270 2024-08-17T02:31:17.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.644+0000 7f06e2a00640 1 -- 172.21.15.106:0/2889725450 --> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f06dc06f480 con 0x7f06bc065150 2024-08-17T02:31:17.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.645+0000 7f06d8c00640 1 -- 172.21.15.106:0/2889725450 <== mgr.4107 v2:172.21.15.106:6832/36860 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f06dc06f480 con 0x7f06bc065150 2024-08-17T02:31:17.645 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 2 to deep-scrub 2024-08-17T02:31:17.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.647+0000 7f06e2a00640 1 -- 172.21.15.106:0/2889725450 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f06bc065150 msgr2=0x7f06bc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.647+0000 7f06e2a00640 1 --2- 172.21.15.106:0/2889725450 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f06bc065150 0x7f06bc067600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f06dc14c710 tx=0x7f06c8007ab0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.647+0000 7f06e2a00640 1 -- 172.21.15.106:0/2889725450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06dc0b0270 msgr2=0x7f06dc150dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.647+0000 7f06e2a00640 1 --2- 172.21.15.106:0/2889725450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06dc0b0270 0x7f06dc150dc0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f06d000d890 tx=0x7f06d0008040 comp rx=0 tx=0).stop 2024-08-17T02:31:17.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.647+0000 7f06e2a00640 1 -- 172.21.15.106:0/2889725450 shutdown_connections 2024-08-17T02:31:17.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.647+0000 7f06e2a00640 1 --2- 172.21.15.106:0/2889725450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06dc158b30 0x7f06dc146f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.647+0000 7f06e2a00640 1 --2- 172.21.15.106:0/2889725450 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f06dc155900 0x7f06dc153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.647+0000 7f06e2a00640 1 --2- 172.21.15.106:0/2889725450 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f06bc065150 0x7f06bc067600 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.647+0000 7f06e2a00640 1 --2- 172.21.15.106:0/2889725450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06dc0b0270 0x7f06dc150dc0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.647+0000 7f06e2a00640 1 -- 172.21.15.106:0/2889725450 >> 172.21.15.106:0/2889725450 conn(0x7f06dc067750 msgr2=0x7f06dc0afae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:17.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.647+0000 7f06e2a00640 1 -- 172.21.15.106:0/2889725450 shutdown_connections 2024-08-17T02:31:17.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.647+0000 7f06e2a00640 1 -- 172.21.15.106:0/2889725450 wait complete. 2024-08-17T02:31:17.663 INFO:tasks.ceph:Scrubbing osd.3 2024-08-17T02:31:17.664 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:31:17.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.816+0000 7f670bc00640 1 Processor -- start 2024-08-17T02:31:17.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.816+0000 7f670bc00640 1 -- start start 2024-08-17T02:31:17.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.817+0000 7f670bc00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f670406e5f0 0x7f6704160650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.817+0000 7f670bc00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67041568b0 con 0x7f6704150130 2024-08-17T02:31:17.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.817+0000 7f670bc00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6704150500 con 0x7f6704156d40 2024-08-17T02:31:17.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.817+0000 7f670bc00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6704155fc0 con 0x7f670406e5f0 2024-08-17T02:31:17.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.817+0000 7f6709c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f670406e5f0 0x7f6704160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.817+0000 7f6709200640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6704150130 0x7f67040aa730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50516/0 (socket says 172.21.15.106:50516) 2024-08-17T02:31:17.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.817+0000 7f6709200640 1 -- 172.21.15.106:0/1079709909 learned_addr learned my addr 172.21.15.106:0/1079709909 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:31:17.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.818+0000 7f6709c00640 1 -- 172.21.15.106:0/1079709909 >> v1:172.21.15.171:6789/0 conn(0x7f6704156d40 legacy=0x7f670406dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.818+0000 7f6709c00640 1 -- 172.21.15.106:0/1079709909 >> v1:172.21.15.106:6789/0 conn(0x7f6704150130 legacy=0x7f67040aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.818+0000 7f6709c00640 1 -- 172.21.15.106:0/1079709909 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67040add60 con 0x7f670406e5f0 2024-08-17T02:31:17.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.819+0000 7f6709c00640 1 --2- 172.21.15.106:0/1079709909 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f670406e5f0 0x7f6704160650 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f66fc009e60 tx=0x7f66fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54cb332afded2901 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:17.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.819+0000 7f6703400640 1 -- 172.21.15.106:0/1079709909 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66fc007550 con 0x7f670406e5f0 2024-08-17T02:31:17.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.819+0000 7f6703400640 1 -- 172.21.15.106:0/1079709909 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66fc02d050 con 0x7f670406e5f0 2024-08-17T02:31:17.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.819+0000 7f6703400640 1 -- 172.21.15.106:0/1079709909 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66fc007920 con 0x7f670406e5f0 2024-08-17T02:31:17.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.820+0000 7f670bc00640 1 -- 172.21.15.106:0/1079709909 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f670406e5f0 msgr2=0x7f6704160650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.820+0000 7f670bc00640 1 --2- 172.21.15.106:0/1079709909 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f670406e5f0 0x7f6704160650 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f66fc009e60 tx=0x7f66fc009780 comp rx=0 tx=0).stop 2024-08-17T02:31:17.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.820+0000 7f670bc00640 1 -- 172.21.15.106:0/1079709909 shutdown_connections 2024-08-17T02:31:17.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.820+0000 7f670bc00640 1 --2- 172.21.15.106:0/1079709909 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f670406e5f0 0x7f6704160650 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.820+0000 7f670bc00640 1 -- 172.21.15.106:0/1079709909 >> 172.21.15.106:0/1079709909 conn(0x7f6704067750 msgr2=0x7f670406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:17.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.820+0000 7f670bc00640 1 -- 172.21.15.106:0/1079709909 shutdown_connections 2024-08-17T02:31:17.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.820+0000 7f670bc00640 1 -- 172.21.15.106:0/1079709909 wait complete. 2024-08-17T02:31:17.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.821+0000 7f670bc00640 1 Processor -- start 2024-08-17T02:31:17.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.821+0000 7f670bc00640 1 -- start start 2024-08-17T02:31:17.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.822+0000 7f670bc00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f670406e5f0 0x7f6704158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.822+0000 7f670bc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6704150130 0x7f670416c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.822+0000 7f670bc00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6704156d40 0x7f670416cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.822+0000 7f670bc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6704158270 con 0x7f6704150130 2024-08-17T02:31:17.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.822+0000 7f670bc00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6704157660 con 0x7f670406e5f0 2024-08-17T02:31:17.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.822+0000 7f670bc00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6704157940 con 0x7f6704156d40 2024-08-17T02:31:17.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.823+0000 7f6703e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6704150130 0x7f670416c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.823+0000 7f6703e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6704150130 0x7f670416c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34794/0 (socket says 172.21.15.106:34794) 2024-08-17T02:31:17.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.823+0000 7f6703e00640 1 -- 172.21.15.106:0/4008637097 learned_addr learned my addr 172.21.15.106:0/4008637097 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:17.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.823+0000 7f6709200640 1 --2- 172.21.15.106:0/4008637097 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f670406e5f0 0x7f6704158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.823+0000 7f6709c00640 1 --2- 172.21.15.106:0/4008637097 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6704156d40 0x7f670416cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.823+0000 7f6703e00640 1 -- 172.21.15.106:0/4008637097 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6704156d40 msgr2=0x7f670416cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.823+0000 7f6703e00640 1 --2- 172.21.15.106:0/4008637097 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6704156d40 0x7f670416cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.823+0000 7f6703e00640 1 -- 172.21.15.106:0/4008637097 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f670406e5f0 msgr2=0x7f6704158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.823+0000 7f6703e00640 1 --2- 172.21.15.106:0/4008637097 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f670406e5f0 0x7f6704158700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.823+0000 7f6703e00640 1 -- 172.21.15.106:0/4008637097 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66fc009a20 con 0x7f6704150130 2024-08-17T02:31:17.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.823+0000 7f6703e00640 1 --2- 172.21.15.106:0/4008637097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6704150130 0x7f670416c7d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f66f000c490 tx=0x7f66f0007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:17.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.823+0000 7f66f7e00640 1 -- 172.21.15.106:0/4008637097 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f0011590 con 0x7f6704150130 2024-08-17T02:31:17.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.824+0000 7f66f7e00640 1 -- 172.21.15.106:0/4008637097 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f0011710 con 0x7f6704150130 2024-08-17T02:31:17.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.824+0000 7f66f7e00640 1 -- 172.21.15.106:0/4008637097 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f0011ad0 con 0x7f6704150130 2024-08-17T02:31:17.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.824+0000 7f670bc00640 1 -- 172.21.15.106:0/4008637097 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6704157c20 con 0x7f6704150130 2024-08-17T02:31:17.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.824+0000 7f670bc00640 1 -- 172.21.15.106:0/4008637097 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6704157160 con 0x7f6704150130 2024-08-17T02:31:17.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.825+0000 7f670bc00640 1 -- 172.21.15.106:0/4008637097 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f67040710c0 con 0x7f6704150130 2024-08-17T02:31:17.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.825+0000 7f66f7e00640 1 -- 172.21.15.106:0/4008637097 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f66f001b3b0 con 0x7f6704150130 2024-08-17T02:31:17.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.826+0000 7f66f7e00640 1 --2- 172.21.15.106:0/4008637097 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f66e4065150 0x7f66e4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.826+0000 7f66f7e00640 1 -- 172.21.15.106:0/4008637097 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f66f0081610 con 0x7f6704150130 2024-08-17T02:31:17.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.826+0000 7f66f7e00640 1 --2- 172.21.15.106:0/4008637097 >> [v2:172.21.15.106:6801/37124,v1:172.21.15.106:6803/37124] conn(0x7f66e406b040 0x7f66e406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:17.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.826+0000 7f6709200640 1 --2- 172.21.15.106:0/4008637097 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f66e4065150 0x7f66e4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.826+0000 7f66f7e00640 1 -- 172.21.15.106:0/4008637097 --> [v2:172.21.15.106:6801/37124,v1:172.21.15.106:6803/37124] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66e406db00 con 0x7f66e406b040 2024-08-17T02:31:17.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.826+0000 7f66f7e00640 1 -- 172.21.15.106:0/4008637097 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66f0083b70 con 0x7f6704150130 2024-08-17T02:31:17.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.827+0000 7f6709c00640 1 --2- 172.21.15.106:0/4008637097 >> [v2:172.21.15.106:6801/37124,v1:172.21.15.106:6803/37124] conn(0x7f66e406b040 0x7f66e406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:17.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.827+0000 7f6709200640 1 --2- 172.21.15.106:0/4008637097 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f66e4065150 0x7f66e4067600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f66f8007880 tx=0x7f66f8007e20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:17.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.827+0000 7f6709c00640 1 --2- 172.21.15.106:0/4008637097 >> [v2:172.21.15.106:6801/37124,v1:172.21.15.106:6803/37124] conn(0x7f66e406b040 0x7f66e406d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:17.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.828+0000 7f66f7e00640 1 -- 172.21.15.106:0/4008637097 <== osd.3 v2:172.21.15.106:6801/37124 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f66e406db00 con 0x7f66e406b040 2024-08-17T02:31:17.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.840+0000 7f670bc00640 1 -- 172.21.15.106:0/4008637097 --> [v2:172.21.15.106:6801/37124,v1:172.21.15.106:6803/37124] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f67040b0430 con 0x7f66e406b040 2024-08-17T02:31:17.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.841+0000 7f66f7e00640 1 -- 172.21.15.106:0/4008637097 <== osd.3 v2:172.21.15.106:6801/37124 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f67040b0430 con 0x7f66e406b040 2024-08-17T02:31:17.841 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-08-17T02:31:17.841 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:31:17.842 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-08-17T02:31:17.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.841+0000 7f670bc00640 1 -- 172.21.15.106:0/4008637097 >> [v2:172.21.15.106:6801/37124,v1:172.21.15.106:6803/37124] conn(0x7f66e406b040 msgr2=0x7f66e406d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.841+0000 7f670bc00640 1 --2- 172.21.15.106:0/4008637097 >> [v2:172.21.15.106:6801/37124,v1:172.21.15.106:6803/37124] conn(0x7f66e406b040 0x7f66e406d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.841+0000 7f670bc00640 1 -- 172.21.15.106:0/4008637097 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f66e4065150 msgr2=0x7f66e4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.841+0000 7f670bc00640 1 --2- 172.21.15.106:0/4008637097 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f66e4065150 0x7f66e4067600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f66f8007880 tx=0x7f66f8007e20 comp rx=0 tx=0).stop 2024-08-17T02:31:17.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.841+0000 7f670bc00640 1 -- 172.21.15.106:0/4008637097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6704150130 msgr2=0x7f670416c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:17.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.841+0000 7f670bc00640 1 --2- 172.21.15.106:0/4008637097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6704150130 0x7f670416c7d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f66f000c490 tx=0x7f66f0007ec0 comp rx=0 tx=0).stop 2024-08-17T02:31:17.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.841+0000 7f6709c00640 1 -- 172.21.15.106:0/4008637097 reap_dead start 2024-08-17T02:31:17.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.841+0000 7f670bc00640 1 -- 172.21.15.106:0/4008637097 shutdown_connections 2024-08-17T02:31:17.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.841+0000 7f670bc00640 1 -- 172.21.15.106:0/4008637097 >> 172.21.15.106:0/4008637097 conn(0x7f6704067750 msgr2=0x7f67041558a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:17.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.841+0000 7f670bc00640 1 -- 172.21.15.106:0/4008637097 shutdown_connections 2024-08-17T02:31:17.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:17.841+0000 7f670bc00640 1 -- 172.21.15.106:0/4008637097 wait complete. 2024-08-17T02:31:17.855 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-17T02:31:18.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.003+0000 7fcaa0000640 1 Processor -- start 2024-08-17T02:31:18.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.003+0000 7fcaa0000640 1 -- start start 2024-08-17T02:31:18.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.005+0000 7fcaa0000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fca98155180 0x7fca980aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:18.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.005+0000 7fcaa0000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fca98155550 0x7fca980ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:18.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.005+0000 7fcaa0000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca980afc10 con 0x7fca9806e080 2024-08-17T02:31:18.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.005+0000 7fcaa0000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca980ae5b0 con 0x7fca98155550 2024-08-17T02:31:18.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.005+0000 7fcaa0000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca980af000 con 0x7fca98155180 2024-08-17T02:31:18.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.005+0000 7fca9cc00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fca98155550 0x7fca980ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:18.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.005+0000 7fca9cc00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fca98155550 0x7fca980ae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34798/0 (socket says 172.21.15.106:34798) 2024-08-17T02:31:18.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.005+0000 7fca9cc00640 1 -- 172.21.15.106:0/691667870 learned_addr learned my addr 172.21.15.106:0/691667870 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:18.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.005+0000 7fca9d600640 1 --2- 172.21.15.106:0/691667870 >> v2:172.21.15.171:3300/0 conn(0x7fca98155180 0x7fca980aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:18.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.005+0000 7fca9cc00640 1 -- 172.21.15.106:0/691667870 >> v2:172.21.15.171:3300/0 conn(0x7fca98155180 msgr2=0x7fca980aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:18.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.005+0000 7fca9cc00640 1 --2- 172.21.15.106:0/691667870 >> v2:172.21.15.171:3300/0 conn(0x7fca98155180 0x7fca980aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.005+0000 7fca9cc00640 1 -- 172.21.15.106:0/691667870 >> v1:172.21.15.171:6789/0 conn(0x7fca9806e080 legacy=0x7fca9806e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:18.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.005+0000 7fca9cc00640 1 -- 172.21.15.106:0/691667870 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca980af2e0 con 0x7fca98155550 2024-08-17T02:31:18.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.005+0000 7fca9d600640 1 --2- 172.21.15.106:0/691667870 >> v2:172.21.15.171:3300/0 conn(0x7fca98155180 0x7fca980aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:31:18.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.006+0000 7fca9cc00640 1 --2- 172.21.15.106:0/691667870 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca98155550 0x7fca980ae070 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fca9806bc00 tx=0x7fca840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2ceff641cc58a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:18.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.007+0000 7fca97e00640 1 -- 172.21.15.106:0/691667870 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8402ae80 con 0x7fca98155550 2024-08-17T02:31:18.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.007+0000 7fca97e00640 1 -- 172.21.15.106:0/691667870 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca84032440 con 0x7fca98155550 2024-08-17T02:31:18.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.007+0000 7fca97e00640 1 -- 172.21.15.106:0/691667870 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca84032800 con 0x7fca98155550 2024-08-17T02:31:18.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.007+0000 7fcaa0000640 1 -- 172.21.15.106:0/691667870 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca98155550 msgr2=0x7fca980ae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:18.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.007+0000 7fcaa0000640 1 --2- 172.21.15.106:0/691667870 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca98155550 0x7fca980ae070 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fca9806bc00 tx=0x7fca840091d0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.007+0000 7fcaa0000640 1 -- 172.21.15.106:0/691667870 shutdown_connections 2024-08-17T02:31:18.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.007+0000 7fcaa0000640 1 --2- 172.21.15.106:0/691667870 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca98155550 0x7fca980ae070 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.007+0000 7fcaa0000640 1 --2- 172.21.15.106:0/691667870 >> v2:172.21.15.171:3300/0 conn(0x7fca98155180 0x7fca980aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.007+0000 7fcaa0000640 1 -- 172.21.15.106:0/691667870 >> 172.21.15.106:0/691667870 conn(0x7fca980cb9b0 msgr2=0x7fca980cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:18.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.007+0000 7fcaa0000640 1 -- 172.21.15.106:0/691667870 shutdown_connections 2024-08-17T02:31:18.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.007+0000 7fcaa0000640 1 -- 172.21.15.106:0/691667870 wait complete. 2024-08-17T02:31:18.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.009+0000 7fcaa0000640 1 Processor -- start 2024-08-17T02:31:18.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.009+0000 7fcaa0000640 1 -- start start 2024-08-17T02:31:18.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.009+0000 7fcaa0000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca9806e080 0x7fca981450f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:18.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.009+0000 7fcaa0000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca98155180 0x7fca98147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:18.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.010+0000 7fcaa0000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca98155550 0x7fca98146300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:18.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.010+0000 7fcaa0000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca98144c60 con 0x7fca98155180 2024-08-17T02:31:18.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.010+0000 7fcaa0000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca98158ac0 con 0x7fca98155550 2024-08-17T02:31:18.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.010+0000 7fcaa0000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca980c9180 con 0x7fca9806e080 2024-08-17T02:31:18.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.010+0000 7fca9cc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca98155180 0x7fca98147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:18.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.010+0000 7fca9cc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca98155180 0x7fca98147810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34804/0 (socket says 172.21.15.106:34804) 2024-08-17T02:31:18.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.010+0000 7fca9cc00640 1 -- 172.21.15.106:0/396914783 learned_addr learned my addr 172.21.15.106:0/396914783 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:18.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.010+0000 7fca9e000640 1 --2- 172.21.15.106:0/396914783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca98155550 0x7fca98146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:18.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.010+0000 7fca9d600640 1 --2- 172.21.15.106:0/396914783 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca9806e080 0x7fca981450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:18.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.010+0000 7fca9cc00640 1 -- 172.21.15.106:0/396914783 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca9806e080 msgr2=0x7fca981450f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:18.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.010+0000 7fca9cc00640 1 --2- 172.21.15.106:0/396914783 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca9806e080 0x7fca981450f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.010+0000 7fca9cc00640 1 -- 172.21.15.106:0/396914783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca98155550 msgr2=0x7fca98146300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:18.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.010+0000 7fca9cc00640 1 --2- 172.21.15.106:0/396914783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca98155550 0x7fca98146300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.010+0000 7fca9cc00640 1 -- 172.21.15.106:0/396914783 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca84009450 con 0x7fca98155180 2024-08-17T02:31:18.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.010+0000 7fca9e000640 1 --2- 172.21.15.106:0/396914783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca98155550 0x7fca98146300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:31:18.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.010+0000 7fca9d600640 1 --2- 172.21.15.106:0/396914783 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca9806e080 0x7fca981450f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:31:18.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.011+0000 7fca9cc00640 1 --2- 172.21.15.106:0/396914783 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca98155180 0x7fca98147810 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fca84009210 tx=0x7fca84032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:18.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.011+0000 7fca94c00640 1 -- 172.21.15.106:0/396914783 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca84031a60 con 0x7fca98155180 2024-08-17T02:31:18.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.011+0000 7fca94c00640 1 -- 172.21.15.106:0/396914783 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca84031be0 con 0x7fca98155180 2024-08-17T02:31:18.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.011+0000 7fca94c00640 1 -- 172.21.15.106:0/396914783 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8403d420 con 0x7fca98155180 2024-08-17T02:31:18.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.011+0000 7fcaa0000640 1 -- 172.21.15.106:0/396914783 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca980c9460 con 0x7fca98155180 2024-08-17T02:31:18.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.011+0000 7fcaa0000640 1 -- 172.21.15.106:0/396914783 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca98147d50 con 0x7fca98155180 2024-08-17T02:31:18.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.012+0000 7fcaa0000640 1 -- 172.21.15.106:0/396914783 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca98144e10 con 0x7fca98155180 2024-08-17T02:31:18.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.013+0000 7fca94c00640 1 -- 172.21.15.106:0/396914783 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fca84039040 con 0x7fca98155180 2024-08-17T02:31:18.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.013+0000 7fca94c00640 1 --2- 172.21.15.106:0/396914783 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fca78065150 0x7fca78067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:18.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.013+0000 7fca94c00640 1 -- 172.21.15.106:0/396914783 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fca840a1ea0 con 0x7fca98155180 2024-08-17T02:31:18.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.014+0000 7fca9d600640 1 --2- 172.21.15.106:0/396914783 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fca78065150 0x7fca78067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:18.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.014+0000 7fca9d600640 1 --2- 172.21.15.106:0/396914783 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fca78065150 0x7fca78067600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fca8c006e70 tx=0x7fca8c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:18.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.018+0000 7fca94c00640 1 -- 172.21.15.106:0/396914783 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fca98144e10 con 0x7fca98155180 2024-08-17T02:31:18.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.188+0000 7fcaa0000640 1 -- 172.21.15.106:0/396914783 --> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fca980c98e0 con 0x7fca78065150 2024-08-17T02:31:18.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.188+0000 7fca94c00640 1 -- 172.21.15.106:0/396914783 <== mgr.4107 v2:172.21.15.106:6832/36860 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fca8c00e760 con 0x7fca78065150 2024-08-17T02:31:18.189 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 3 to deep-scrub 2024-08-17T02:31:18.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.190+0000 7fcaa0000640 1 -- 172.21.15.106:0/396914783 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fca78065150 msgr2=0x7fca78067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:18.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.190+0000 7fcaa0000640 1 --2- 172.21.15.106:0/396914783 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fca78065150 0x7fca78067600 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fca8c006e70 tx=0x7fca8c008040 comp rx=0 tx=0).stop 2024-08-17T02:31:18.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.190+0000 7fcaa0000640 1 -- 172.21.15.106:0/396914783 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca98155180 msgr2=0x7fca98147810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:18.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.190+0000 7fcaa0000640 1 --2- 172.21.15.106:0/396914783 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca98155180 0x7fca98147810 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fca84009210 tx=0x7fca84032000 comp rx=0 tx=0).stop 2024-08-17T02:31:18.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.190+0000 7fcaa0000640 1 -- 172.21.15.106:0/396914783 shutdown_connections 2024-08-17T02:31:18.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.190+0000 7fcaa0000640 1 --2- 172.21.15.106:0/396914783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fca98155550 0x7fca98146300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.190+0000 7fcaa0000640 1 --2- 172.21.15.106:0/396914783 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fca78065150 0x7fca78067600 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.190+0000 7fcaa0000640 1 --2- 172.21.15.106:0/396914783 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca98155180 0x7fca98147810 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.190+0000 7fcaa0000640 1 --2- 172.21.15.106:0/396914783 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fca9806e080 0x7fca981450f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.190+0000 7fcaa0000640 1 -- 172.21.15.106:0/396914783 >> 172.21.15.106:0/396914783 conn(0x7fca980cb9b0 msgr2=0x7fca980b10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:18.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.191+0000 7fcaa0000640 1 -- 172.21.15.106:0/396914783 shutdown_connections 2024-08-17T02:31:18.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.191+0000 7fcaa0000640 1 -- 172.21.15.106:0/396914783 wait complete. 2024-08-17T02:31:18.206 INFO:tasks.ceph:Scrubbing osd.4 2024-08-17T02:31:18.206 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:31:18.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.357+0000 7f1092c00640 1 Processor -- start 2024-08-17T02:31:18.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.358+0000 7f1092c00640 1 -- start start 2024-08-17T02:31:18.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.359+0000 7f1092c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f108c156890 0x7f108c06dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:18.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.359+0000 7f1092c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f108c156c60 0x7f108c06e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:18.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.359+0000 7f1092c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f108c0c8130 0x7f108c0c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:18.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.359+0000 7f1092c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f108c0ae9b0 con 0x7f108c0c8130 2024-08-17T02:31:18.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.359+0000 7f1092c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f108c0ab320 con 0x7f108c156890 2024-08-17T02:31:18.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.359+0000 7f1092c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108c0aa730 con 0x7f108c156c60 2024-08-17T02:31:18.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.359+0000 7f1090c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f108c0c8130 0x7f108c0c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:18.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.359+0000 7f1090c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f108c0c8130 0x7f108c0c85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34812/0 (socket says 172.21.15.106:34812) 2024-08-17T02:31:18.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.359+0000 7f1090c00640 1 -- 172.21.15.106:0/1676130650 learned_addr learned my addr 172.21.15.106:0/1676130650 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:18.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.359+0000 7f1083400640 1 --2- 172.21.15.106:0/1676130650 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f108c156c60 0x7f108c06e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:18.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.359+0000 7f108be00640 1 --2- 172.21.15.106:0/1676130650 >> v2:172.21.15.171:3300/0 conn(0x7f108c156890 0x7f108c06dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:18.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.359+0000 7f1090c00640 1 -- 172.21.15.106:0/1676130650 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f108c156c60 msgr2=0x7f108c06e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:18.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.360+0000 7f1090c00640 1 --2- 172.21.15.106:0/1676130650 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f108c156c60 0x7f108c06e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.360+0000 7f1090c00640 1 -- 172.21.15.106:0/1676130650 >> v2:172.21.15.171:3300/0 conn(0x7f108c156890 msgr2=0x7f108c06dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:18.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.360+0000 7f1090c00640 1 --2- 172.21.15.106:0/1676130650 >> v2:172.21.15.171:3300/0 conn(0x7f108c156890 0x7f108c06dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.360+0000 7f1090c00640 1 -- 172.21.15.106:0/1676130650 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108c0aa9f0 con 0x7f108c0c8130 2024-08-17T02:31:18.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.360+0000 7f108be00640 1 --2- 172.21.15.106:0/1676130650 >> v2:172.21.15.171:3300/0 conn(0x7f108c156890 0x7f108c06dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:31:18.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.360+0000 7f1090c00640 1 --2- 172.21.15.106:0/1676130650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f108c0c8130 0x7f108c0c85b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f108c06c5c0 tx=0x7f1084009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99bedeb91d27b75f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:18.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.361+0000 7f108b400640 1 -- 172.21.15.106:0/1676130650 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1084031400 con 0x7f108c0c8130 2024-08-17T02:31:18.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.361+0000 7f108b400640 1 -- 172.21.15.106:0/1676130650 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108402d050 con 0x7f108c0c8130 2024-08-17T02:31:18.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.361+0000 7f108b400640 1 -- 172.21.15.106:0/1676130650 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10840317d0 con 0x7f108c0c8130 2024-08-17T02:31:18.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.361+0000 7f1092c00640 1 -- 172.21.15.106:0/1676130650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f108c0c8130 msgr2=0x7f108c0c85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:18.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.361+0000 7f1092c00640 1 --2- 172.21.15.106:0/1676130650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f108c0c8130 0x7f108c0c85b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f108c06c5c0 tx=0x7f1084009840 comp rx=0 tx=0).stop 2024-08-17T02:31:18.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.361+0000 7f1092c00640 1 -- 172.21.15.106:0/1676130650 shutdown_connections 2024-08-17T02:31:18.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.361+0000 7f1092c00640 1 --2- 172.21.15.106:0/1676130650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f108c0c8130 0x7f108c0c85b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.361+0000 7f1092c00640 1 --2- 172.21.15.106:0/1676130650 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f108c156c60 0x7f108c06e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.361+0000 7f1092c00640 1 --2- 172.21.15.106:0/1676130650 >> v2:172.21.15.171:3300/0 conn(0x7f108c156890 0x7f108c06dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.361+0000 7f1092c00640 1 -- 172.21.15.106:0/1676130650 >> 172.21.15.106:0/1676130650 conn(0x7f108c067750 msgr2=0x7f108c06c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:18.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.362+0000 7f1092c00640 1 -- 172.21.15.106:0/1676130650 shutdown_connections 2024-08-17T02:31:18.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.362+0000 7f1092c00640 1 -- 172.21.15.106:0/1676130650 wait complete. 2024-08-17T02:31:18.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.363+0000 7f1092c00640 1 Processor -- start 2024-08-17T02:31:18.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.363+0000 7f1092c00640 1 -- start start 2024-08-17T02:31:18.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.364+0000 7f1092c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f108c0c8130 0x7f108c1581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:18.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.364+0000 7f1092c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f108c156890 0x7f108c1422f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:18.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.364+0000 7f1092c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f108c156c60 0x7f108c153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:18.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.364+0000 7f1092c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c157d60 con 0x7f108c0c8130 2024-08-17T02:31:18.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.364+0000 7f1092c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c157150 con 0x7f108c156890 2024-08-17T02:31:18.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.364+0000 7f1092c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108c157430 con 0x7f108c156c60 2024-08-17T02:31:18.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.364+0000 7f108be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f108c0c8130 0x7f108c1581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:18.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.364+0000 7f108be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f108c0c8130 0x7f108c1581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34822/0 (socket says 172.21.15.106:34822) 2024-08-17T02:31:18.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.364+0000 7f108be00640 1 -- 172.21.15.106:0/3748991246 learned_addr learned my addr 172.21.15.106:0/3748991246 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:18.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.364+0000 7f1090c00640 1 --2- 172.21.15.106:0/3748991246 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f108c156c60 0x7f108c153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:18.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.364+0000 7f1083400640 1 --2- 172.21.15.106:0/3748991246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f108c156890 0x7f108c1422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:18.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.365+0000 7f108be00640 1 -- 172.21.15.106:0/3748991246 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f108c156c60 msgr2=0x7f108c153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:18.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.365+0000 7f108be00640 1 --2- 172.21.15.106:0/3748991246 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f108c156c60 0x7f108c153420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.365+0000 7f108be00640 1 -- 172.21.15.106:0/3748991246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f108c156890 msgr2=0x7f108c1422f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:18.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.365+0000 7f108be00640 1 --2- 172.21.15.106:0/3748991246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f108c156890 0x7f108c1422f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.365+0000 7f108be00640 1 -- 172.21.15.106:0/3748991246 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1084009ae0 con 0x7f108c0c8130 2024-08-17T02:31:18.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.365+0000 7f108be00640 1 --2- 172.21.15.106:0/3748991246 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f108c0c8130 0x7f108c1581f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f107c00d890 tx=0x7f107c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:18.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.365+0000 7f1083e00640 1 -- 172.21.15.106:0/3748991246 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c00de80 con 0x7f108c0c8130 2024-08-17T02:31:18.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.365+0000 7f1083e00640 1 -- 172.21.15.106:0/3748991246 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107c00b8d0 con 0x7f108c0c8130 2024-08-17T02:31:18.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.365+0000 7f1083e00640 1 -- 172.21.15.106:0/3748991246 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c00bc90 con 0x7f108c0c8130 2024-08-17T02:31:18.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.365+0000 7f1092c00640 1 -- 172.21.15.106:0/3748991246 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f108c157710 con 0x7f108c0c8130 2024-08-17T02:31:18.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.365+0000 7f1092c00640 1 -- 172.21.15.106:0/3748991246 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f108c142830 con 0x7f108c0c8130 2024-08-17T02:31:18.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.366+0000 7f1092c00640 1 -- 172.21.15.106:0/3748991246 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f108c0710c0 con 0x7f108c0c8130 2024-08-17T02:31:18.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.367+0000 7f1083e00640 1 -- 172.21.15.106:0/3748991246 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f107c01e460 con 0x7f108c0c8130 2024-08-17T02:31:18.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.368+0000 7f1083e00640 1 --2- 172.21.15.106:0/3748991246 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1068065150 0x7f1068067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:18.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.368+0000 7f1083e00640 1 -- 172.21.15.106:0/3748991246 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f107c0827d0 con 0x7f108c0c8130 2024-08-17T02:31:18.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.368+0000 7f1083400640 1 --2- 172.21.15.106:0/3748991246 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1068065150 0x7f1068067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:18.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.368+0000 7f1083e00640 1 --2- 172.21.15.106:0/3748991246 >> [v2:172.21.15.171:6816/37336,v1:172.21.15.171:6817/37336] conn(0x7f106806b040 0x7f106806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:18.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.368+0000 7f1083e00640 1 -- 172.21.15.106:0/3748991246 --> [v2:172.21.15.171:6816/37336,v1:172.21.15.171:6817/37336] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f106806db00 con 0x7f106806b040 2024-08-17T02:31:18.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.368+0000 7f1083e00640 1 -- 172.21.15.106:0/3748991246 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f107c084d30 con 0x7f108c0c8130 2024-08-17T02:31:18.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.369+0000 7f1083400640 1 --2- 172.21.15.106:0/3748991246 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1068065150 0x7f1068067600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f108c153190 tx=0x7f10740090f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:18.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.369+0000 7f1090c00640 1 --2- 172.21.15.106:0/3748991246 >> [v2:172.21.15.171:6816/37336,v1:172.21.15.171:6817/37336] conn(0x7f106806b040 0x7f106806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:18.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.369+0000 7f1090c00640 1 --2- 172.21.15.106:0/3748991246 >> [v2:172.21.15.171:6816/37336,v1:172.21.15.171:6817/37336] conn(0x7f106806b040 0x7f106806d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:18.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.370+0000 7f1083e00640 1 -- 172.21.15.106:0/3748991246 <== osd.4 v2:172.21.15.171:6816/37336 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f106806db00 con 0x7f106806b040 2024-08-17T02:31:18.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.383+0000 7f1092c00640 1 -- 172.21.15.106:0/3748991246 --> [v2:172.21.15.171:6816/37336,v1:172.21.15.171:6817/37336] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f108c157b90 con 0x7f106806b040 2024-08-17T02:31:18.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.383+0000 7f1083e00640 1 -- 172.21.15.106:0/3748991246 <== osd.4 v2:172.21.15.171:6816/37336 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f108c157b90 con 0x7f106806b040 2024-08-17T02:31:18.384 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-08-17T02:31:18.384 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:31:18.384 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-08-17T02:31:18.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.384+0000 7f1092c00640 1 -- 172.21.15.106:0/3748991246 >> [v2:172.21.15.171:6816/37336,v1:172.21.15.171:6817/37336] conn(0x7f106806b040 msgr2=0x7f106806d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:18.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.384+0000 7f1092c00640 1 --2- 172.21.15.106:0/3748991246 >> [v2:172.21.15.171:6816/37336,v1:172.21.15.171:6817/37336] conn(0x7f106806b040 0x7f106806d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.384+0000 7f1092c00640 1 -- 172.21.15.106:0/3748991246 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1068065150 msgr2=0x7f1068067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:18.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.384+0000 7f1092c00640 1 --2- 172.21.15.106:0/3748991246 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f1068065150 0x7f1068067600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f108c153190 tx=0x7f10740090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.384+0000 7f1092c00640 1 -- 172.21.15.106:0/3748991246 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f108c0c8130 msgr2=0x7f108c1581f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:18.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.384+0000 7f1092c00640 1 --2- 172.21.15.106:0/3748991246 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f108c0c8130 0x7f108c1581f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f107c00d890 tx=0x7f107c008040 comp rx=0 tx=0).stop 2024-08-17T02:31:18.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.384+0000 7f1090c00640 1 -- 172.21.15.106:0/3748991246 reap_dead start 2024-08-17T02:31:18.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.384+0000 7f1092c00640 1 -- 172.21.15.106:0/3748991246 shutdown_connections 2024-08-17T02:31:18.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.384+0000 7f1092c00640 1 -- 172.21.15.106:0/3748991246 >> 172.21.15.106:0/3748991246 conn(0x7f108c067750 msgr2=0x7f108c069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:18.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.384+0000 7f1092c00640 1 -- 172.21.15.106:0/3748991246 shutdown_connections 2024-08-17T02:31:18.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.384+0000 7f1092c00640 1 -- 172.21.15.106:0/3748991246 wait complete. 2024-08-17T02:31:18.398 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-17T02:31:18.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.547+0000 7f0850a00640 1 Processor -- start 2024-08-17T02:31:18.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.547+0000 7f0850a00640 1 -- start start 2024-08-17T02:31:18.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.548+0000 7f0850a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f084c1401b0 0x7f084c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:18.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.548+0000 7f0850a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f084c0b1440 0x7f084c0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:18.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.548+0000 7f0850a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f084c0caa80 con 0x7f084c140580 2024-08-17T02:31:18.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.548+0000 7f0850a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f084c0cb450 con 0x7f084c0b1440 2024-08-17T02:31:18.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.548+0000 7f0850a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084c0c9e70 con 0x7f084c1401b0 2024-08-17T02:31:18.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.548+0000 7f084a800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f084c0b1440 0x7f084c0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:18.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.548+0000 7f0849400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f084c140580 0x7f084c0b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50528/0 (socket says 172.21.15.106:50528) 2024-08-17T02:31:18.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.549+0000 7f0849400640 1 -- 172.21.15.106:0/4026055 learned_addr learned my addr 172.21.15.106:0/4026055 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:31:18.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.549+0000 7f0849e00640 1 --2- 172.21.15.106:0/4026055 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f084c1401b0 0x7f084c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:18.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.549+0000 7f0848a00640 1 -- 172.21.15.106:0/4026055 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834097855 0 0) 0x7f084c0caa80 con 0x7f084c140580 2024-08-17T02:31:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.549+0000 7f0848a00640 1 -- 172.21.15.106:0/4026055 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08300034e0 con 0x7f084c140580 2024-08-17T02:31:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.549+0000 7f084a800640 1 -- 172.21.15.106:0/4026055 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f084c1401b0 msgr2=0x7f084c0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.549+0000 7f084a800640 1 --2- 172.21.15.106:0/4026055 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f084c1401b0 0x7f084c0caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.549+0000 7f084a800640 1 -- 172.21.15.106:0/4026055 >> v1:172.21.15.106:6789/0 conn(0x7f084c140580 legacy=0x7f084c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.549+0000 7f084a800640 1 -- 172.21.15.106:0/4026055 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f084c0ca150 con 0x7f084c0b1440 2024-08-17T02:31:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.550+0000 7f084a800640 1 --2- 172.21.15.106:0/4026055 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f084c0b1440 0x7f084c0c9040 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0844009e60 tx=0x7f0844009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2221a39a1471bed3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.550+0000 7f0848a00640 1 -- 172.21.15.106:0/4026055 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0844007550 con 0x7f084c0b1440 2024-08-17T02:31:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.550+0000 7f0848a00640 1 -- 172.21.15.106:0/4026055 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084402d050 con 0x7f084c0b1440 2024-08-17T02:31:18.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.550+0000 7f0848a00640 1 -- 172.21.15.106:0/4026055 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0844007900 con 0x7f084c0b1440 2024-08-17T02:31:18.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.551+0000 7f0850a00640 1 -- 172.21.15.106:0/4026055 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f084c0b1440 msgr2=0x7f084c0c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:18.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.551+0000 7f0850a00640 1 --2- 172.21.15.106:0/4026055 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f084c0b1440 0x7f084c0c9040 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0844009e60 tx=0x7f0844009780 comp rx=0 tx=0).stop 2024-08-17T02:31:18.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.551+0000 7f0850a00640 1 -- 172.21.15.106:0/4026055 shutdown_connections 2024-08-17T02:31:18.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.551+0000 7f0850a00640 1 --2- 172.21.15.106:0/4026055 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f084c0b1440 0x7f084c0c9040 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.551+0000 7f0850a00640 1 --2- 172.21.15.106:0/4026055 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f084c1401b0 0x7f084c0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.551+0000 7f0850a00640 1 -- 172.21.15.106:0/4026055 >> 172.21.15.106:0/4026055 conn(0x7f084c0cb9b0 msgr2=0x7f084c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:18.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.551+0000 7f0850a00640 1 -- 172.21.15.106:0/4026055 shutdown_connections 2024-08-17T02:31:18.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.551+0000 7f0850a00640 1 -- 172.21.15.106:0/4026055 wait complete. 2024-08-17T02:31:18.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.552+0000 7f0850a00640 1 Processor -- start 2024-08-17T02:31:18.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.553+0000 7f0850a00640 1 -- start start 2024-08-17T02:31:18.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.553+0000 7f0850a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f084c0b1440 0x7f084c0c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:18.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.553+0000 7f0850a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f084c1401b0 0x7f084c0c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:18.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.553+0000 7f0850a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f084c140580 0x7f084c13f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:18.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.553+0000 7f0850a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084c166790 con 0x7f084c1401b0 2024-08-17T02:31:18.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.553+0000 7f0850a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084c0c7940 con 0x7f084c140580 2024-08-17T02:31:18.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.553+0000 7f0850a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084c0c5630 con 0x7f084c0b1440 2024-08-17T02:31:18.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.554+0000 7f0849400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f084c1401b0 0x7f084c0c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:18.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.554+0000 7f0849e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f084c0b1440 0x7f084c0c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:18.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.554+0000 7f0849400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f084c1401b0 0x7f084c0c7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34848/0 (socket says 172.21.15.106:34848) 2024-08-17T02:31:18.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.554+0000 7f0849400640 1 -- 172.21.15.106:0/2173047543 learned_addr learned my addr 172.21.15.106:0/2173047543 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:18.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.554+0000 7f084a800640 1 --2- 172.21.15.106:0/2173047543 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f084c140580 0x7f084c13f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:18.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.554+0000 7f0849400640 1 -- 172.21.15.106:0/2173047543 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f084c0b1440 msgr2=0x7f084c0c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:18.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.554+0000 7f0849400640 1 --2- 172.21.15.106:0/2173047543 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f084c0b1440 0x7f084c0c5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.554+0000 7f0849400640 1 -- 172.21.15.106:0/2173047543 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f084c140580 msgr2=0x7f084c13f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:18.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.554+0000 7f0849400640 1 --2- 172.21.15.106:0/2173047543 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f084c140580 0x7f084c13f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.554+0000 7f0849400640 1 -- 172.21.15.106:0/2173047543 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0844009a20 con 0x7f084c1401b0 2024-08-17T02:31:18.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.554+0000 7f0849400640 1 --2- 172.21.15.106:0/2173047543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f084c1401b0 0x7f084c0c7400 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f083800c560 tx=0x7f0838007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:18.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.555+0000 7f0841600640 1 -- 172.21.15.106:0/2173047543 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0838005aa0 con 0x7f084c1401b0 2024-08-17T02:31:18.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.555+0000 7f0841600640 1 -- 172.21.15.106:0/2173047543 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0838005c00 con 0x7f084c1401b0 2024-08-17T02:31:18.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.555+0000 7f0841600640 1 -- 172.21.15.106:0/2173047543 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08380070d0 con 0x7f084c1401b0 2024-08-17T02:31:18.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.555+0000 7f0850a00640 1 -- 172.21.15.106:0/2173047543 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f084c0c5910 con 0x7f084c1401b0 2024-08-17T02:31:18.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.555+0000 7f0850a00640 1 -- 172.21.15.106:0/2173047543 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f084c0c5ed0 con 0x7f084c1401b0 2024-08-17T02:31:18.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.556+0000 7f0850a00640 1 -- 172.21.15.106:0/2173047543 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f084c064db0 con 0x7f084c1401b0 2024-08-17T02:31:18.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.556+0000 7f0841600640 1 -- 172.21.15.106:0/2173047543 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f08380074c0 con 0x7f084c1401b0 2024-08-17T02:31:18.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.557+0000 7f0841600640 1 --2- 172.21.15.106:0/2173047543 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f082c065150 0x7f082c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:18.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.557+0000 7f0841600640 1 -- 172.21.15.106:0/2173047543 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f0838081690 con 0x7f084c1401b0 2024-08-17T02:31:18.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.558+0000 7f0849e00640 1 --2- 172.21.15.106:0/2173047543 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f082c065150 0x7f082c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:18.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.558+0000 7f0849e00640 1 --2- 172.21.15.106:0/2173047543 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f082c065150 0x7f082c067600 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f083c009d20 tx=0x7f083c0090f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:18.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.561+0000 7f0841600640 1 -- 172.21.15.106:0/2173047543 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f083804fa00 con 0x7f084c1401b0 2024-08-17T02:31:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.731+0000 7f0850a00640 1 -- 172.21.15.106:0/2173047543 --> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f084c0cbf20 con 0x7f082c065150 2024-08-17T02:31:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.731+0000 7f0841600640 1 -- 172.21.15.106:0/2173047543 <== mgr.4107 v2:172.21.15.106:6832/36860 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f084c0cbf20 con 0x7f082c065150 2024-08-17T02:31:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 4 to deep-scrub 2024-08-17T02:31:18.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.734+0000 7f0850a00640 1 -- 172.21.15.106:0/2173047543 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f082c065150 msgr2=0x7f082c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:18.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.734+0000 7f0850a00640 1 --2- 172.21.15.106:0/2173047543 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f082c065150 0x7f082c067600 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f083c009d20 tx=0x7f083c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.734+0000 7f0850a00640 1 -- 172.21.15.106:0/2173047543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f084c1401b0 msgr2=0x7f084c0c7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:18.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.734+0000 7f0850a00640 1 --2- 172.21.15.106:0/2173047543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f084c1401b0 0x7f084c0c7400 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f083800c560 tx=0x7f0838007d60 comp rx=0 tx=0).stop 2024-08-17T02:31:18.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.734+0000 7f0850a00640 1 -- 172.21.15.106:0/2173047543 shutdown_connections 2024-08-17T02:31:18.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.734+0000 7f0850a00640 1 --2- 172.21.15.106:0/2173047543 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f084c140580 0x7f084c13f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.734+0000 7f0850a00640 1 --2- 172.21.15.106:0/2173047543 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f082c065150 0x7f082c067600 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.734+0000 7f0850a00640 1 --2- 172.21.15.106:0/2173047543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f084c1401b0 0x7f084c0c7400 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.734+0000 7f0850a00640 1 --2- 172.21.15.106:0/2173047543 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f084c0b1440 0x7f084c0c5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.734+0000 7f0850a00640 1 -- 172.21.15.106:0/2173047543 >> 172.21.15.106:0/2173047543 conn(0x7f084c0cb9b0 msgr2=0x7f084c069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:18.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.734+0000 7f0850a00640 1 -- 172.21.15.106:0/2173047543 shutdown_connections 2024-08-17T02:31:18.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.734+0000 7f0850a00640 1 -- 172.21.15.106:0/2173047543 wait complete. 2024-08-17T02:31:18.750 INFO:tasks.ceph:Scrubbing osd.5 2024-08-17T02:31:18.750 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:31:18.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.901+0000 7f2adbe00640 1 Processor -- start 2024-08-17T02:31:18.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.901+0000 7f2adbe00640 1 -- start start 2024-08-17T02:31:18.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.903+0000 7f2adbe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2adc153070 0x7f2adc0c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:18.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.903+0000 7f2adbe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2adc0c5630 0x7f2adc06d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:18.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.903+0000 7f2adbe00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2adc06cdb0 con 0x7f2adc153440 2024-08-17T02:31:18.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.903+0000 7f2adbe00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2adc0c5e20 con 0x7f2adc0c5630 2024-08-17T02:31:18.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.903+0000 7f2adbe00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2adc159690 con 0x7f2adc153070 2024-08-17T02:31:18.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.903+0000 7f2adb400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2adc0c5630 0x7f2adc06d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:18.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.903+0000 7f2adb400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2adc0c5630 0x7f2adc06d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34856/0 (socket says 172.21.15.106:34856) 2024-08-17T02:31:18.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.903+0000 7f2adb400640 1 -- 172.21.15.106:0/4110439080 learned_addr learned my addr 172.21.15.106:0/4110439080 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:18.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.903+0000 7f2adaa00640 1 --2- 172.21.15.106:0/4110439080 >> v2:172.21.15.171:3300/0 conn(0x7f2adc153070 0x7f2adc0c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:18.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.903+0000 7f2adb400640 1 -- 172.21.15.106:0/4110439080 >> v2:172.21.15.171:3300/0 conn(0x7f2adc153070 msgr2=0x7f2adc0c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:18.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.903+0000 7f2adb400640 1 --2- 172.21.15.106:0/4110439080 >> v2:172.21.15.171:3300/0 conn(0x7f2adc153070 0x7f2adc0c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.903+0000 7f2adb400640 1 -- 172.21.15.106:0/4110439080 >> v1:172.21.15.171:6789/0 conn(0x7f2adc153440 legacy=0x7f2adc0c4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:18.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.903+0000 7f2adb400640 1 -- 172.21.15.106:0/4110439080 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2adc159970 con 0x7f2adc0c5630 2024-08-17T02:31:18.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.905+0000 7f2adb400640 1 --2- 172.21.15.106:0/4110439080 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2adc0c5630 0x7f2adc06d290 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2adc0ae8d0 tx=0x7f2ad4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8872dff339d06cbf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:18.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.905+0000 7f2ada000640 1 -- 172.21.15.106:0/4110439080 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad402e050 con 0x7f2adc0c5630 2024-08-17T02:31:18.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.905+0000 7f2ada000640 1 -- 172.21.15.106:0/4110439080 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad4007400 con 0x7f2adc0c5630 2024-08-17T02:31:18.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.905+0000 7f2ada000640 1 -- 172.21.15.106:0/4110439080 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad40077e0 con 0x7f2adc0c5630 2024-08-17T02:31:18.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.905+0000 7f2adbe00640 1 -- 172.21.15.106:0/4110439080 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2adc0c5630 msgr2=0x7f2adc06d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:18.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.905+0000 7f2adbe00640 1 --2- 172.21.15.106:0/4110439080 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2adc0c5630 0x7f2adc06d290 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2adc0ae8d0 tx=0x7f2ad4009840 comp rx=0 tx=0).stop 2024-08-17T02:31:18.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.906+0000 7f2adbe00640 1 -- 172.21.15.106:0/4110439080 shutdown_connections 2024-08-17T02:31:18.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.906+0000 7f2adbe00640 1 --2- 172.21.15.106:0/4110439080 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2adc0c5630 0x7f2adc06d290 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.906+0000 7f2adbe00640 1 --2- 172.21.15.106:0/4110439080 >> v2:172.21.15.171:3300/0 conn(0x7f2adc153070 0x7f2adc0c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.906+0000 7f2adbe00640 1 -- 172.21.15.106:0/4110439080 >> 172.21.15.106:0/4110439080 conn(0x7f2adc0cbc00 msgr2=0x7f2adc0cc000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:18.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.906+0000 7f2adbe00640 1 -- 172.21.15.106:0/4110439080 shutdown_connections 2024-08-17T02:31:18.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.906+0000 7f2adbe00640 1 -- 172.21.15.106:0/4110439080 wait complete. 2024-08-17T02:31:18.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.907+0000 7f2adbe00640 1 Processor -- start 2024-08-17T02:31:18.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.907+0000 7f2adbe00640 1 -- start start 2024-08-17T02:31:18.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.908+0000 7f2adbe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2adc0c5630 0x7f2adc14a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:18.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.908+0000 7f2adbe00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2adc153070 0x7f2adc1549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:18.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.908+0000 7f2adbe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2adc153440 0x7f2adc0afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:18.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.908+0000 7f2adbe00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc1491c0 con 0x7f2adc153440 2024-08-17T02:31:18.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.908+0000 7f2adbe00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc1494a0 con 0x7f2adc153070 2024-08-17T02:31:18.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.908+0000 7f2adbe00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc149780 con 0x7f2adc0c5630 2024-08-17T02:31:18.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.908+0000 7f2adb400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2adc153440 0x7f2adc0afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:18.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.908+0000 7f2adb400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2adc153440 0x7f2adc0afb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34868/0 (socket says 172.21.15.106:34868) 2024-08-17T02:31:18.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.908+0000 7f2adb400640 1 -- 172.21.15.106:0/776558833 learned_addr learned my addr 172.21.15.106:0/776558833 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:18.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.908+0000 7f2adaa00640 1 --2- 172.21.15.106:0/776558833 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2adc0c5630 0x7f2adc14a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:18.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.908+0000 7f2ad2000640 1 --2- 172.21.15.106:0/776558833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2adc153070 0x7f2adc1549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:18.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.909+0000 7f2adb400640 1 -- 172.21.15.106:0/776558833 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2adc0c5630 msgr2=0x7f2adc14a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:18.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.909+0000 7f2adb400640 1 --2- 172.21.15.106:0/776558833 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2adc0c5630 0x7f2adc14a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.909+0000 7f2adb400640 1 -- 172.21.15.106:0/776558833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2adc153070 msgr2=0x7f2adc1549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:18.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.909+0000 7f2adb400640 1 --2- 172.21.15.106:0/776558833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2adc153070 0x7f2adc1549b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.909+0000 7f2adb400640 1 -- 172.21.15.106:0/776558833 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad4009ae0 con 0x7f2adc153440 2024-08-17T02:31:18.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.909+0000 7f2adb400640 1 --2- 172.21.15.106:0/776558833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2adc153440 0x7f2adc0afb60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009f50 tx=0x7f2ad4037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:18.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.909+0000 7f2ad2a00640 1 -- 172.21.15.106:0/776558833 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4033e40 con 0x7f2adc153440 2024-08-17T02:31:18.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.909+0000 7f2ad2a00640 1 -- 172.21.15.106:0/776558833 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad403c410 con 0x7f2adc153440 2024-08-17T02:31:18.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.909+0000 7f2ad2a00640 1 -- 172.21.15.106:0/776558833 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad403c7d0 con 0x7f2adc153440 2024-08-17T02:31:18.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.909+0000 7f2adbe00640 1 -- 172.21.15.106:0/776558833 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2adc149a60 con 0x7f2adc153440 2024-08-17T02:31:18.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.910+0000 7f2adbe00640 1 -- 172.21.15.106:0/776558833 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2adc0b1420 con 0x7f2adc153440 2024-08-17T02:31:18.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.910+0000 7f2adbe00640 1 -- 172.21.15.106:0/776558833 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2adc071050 con 0x7f2adc153440 2024-08-17T02:31:18.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.911+0000 7f2ad2a00640 1 -- 172.21.15.106:0/776558833 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2ad4039050 con 0x7f2adc153440 2024-08-17T02:31:18.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.912+0000 7f2ad2a00640 1 --2- 172.21.15.106:0/776558833 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2ab8065150 0x7f2ab8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:18.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.912+0000 7f2ad2a00640 1 -- 172.21.15.106:0/776558833 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f2ad40a2c30 con 0x7f2adc153440 2024-08-17T02:31:18.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.912+0000 7f2adaa00640 1 --2- 172.21.15.106:0/776558833 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2ab8065150 0x7f2ab8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:18.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.912+0000 7f2ad2a00640 1 --2- 172.21.15.106:0/776558833 >> [v2:172.21.15.171:6800/37334,v1:172.21.15.171:6801/37334] conn(0x7f2ab806b040 0x7f2ab806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:18.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.912+0000 7f2ad2a00640 1 -- 172.21.15.106:0/776558833 --> [v2:172.21.15.171:6800/37334,v1:172.21.15.171:6801/37334] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2ab806db00 con 0x7f2ab806b040 2024-08-17T02:31:18.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.912+0000 7f2ad2a00640 1 -- 172.21.15.106:0/776558833 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ad402e020 con 0x7f2adc153440 2024-08-17T02:31:18.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.913+0000 7f2ad2000640 1 --2- 172.21.15.106:0/776558833 >> [v2:172.21.15.171:6800/37334,v1:172.21.15.171:6801/37334] conn(0x7f2ab806b040 0x7f2ab806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:18.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.913+0000 7f2adaa00640 1 --2- 172.21.15.106:0/776558833 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2ab8065150 0x7f2ab8067600 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2acc009d20 tx=0x7f2acc0090f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:18.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.913+0000 7f2ad2000640 1 --2- 172.21.15.106:0/776558833 >> [v2:172.21.15.171:6800/37334,v1:172.21.15.171:6801/37334] conn(0x7f2ab806b040 0x7f2ab806d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:18.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.914+0000 7f2ad2a00640 1 -- 172.21.15.106:0/776558833 <== osd.5 v2:172.21.15.171:6800/37334 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f2ab806db00 con 0x7f2ab806b040 2024-08-17T02:31:18.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.927+0000 7f2adbe00640 1 -- 172.21.15.106:0/776558833 --> [v2:172.21.15.171:6800/37334,v1:172.21.15.171:6801/37334] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2adc0cc7a0 con 0x7f2ab806b040 2024-08-17T02:31:18.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.927+0000 7f2ad2a00640 1 -- 172.21.15.106:0/776558833 <== osd.5 v2:172.21.15.171:6800/37334 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2adc0cc7a0 con 0x7f2ab806b040 2024-08-17T02:31:18.928 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-08-17T02:31:18.928 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:31:18.928 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-08-17T02:31:18.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.928+0000 7f2adbe00640 1 -- 172.21.15.106:0/776558833 >> [v2:172.21.15.171:6800/37334,v1:172.21.15.171:6801/37334] conn(0x7f2ab806b040 msgr2=0x7f2ab806d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:18.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.928+0000 7f2adbe00640 1 --2- 172.21.15.106:0/776558833 >> [v2:172.21.15.171:6800/37334,v1:172.21.15.171:6801/37334] conn(0x7f2ab806b040 0x7f2ab806d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.928+0000 7f2adbe00640 1 -- 172.21.15.106:0/776558833 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2ab8065150 msgr2=0x7f2ab8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:18.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.928+0000 7f2adbe00640 1 --2- 172.21.15.106:0/776558833 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f2ab8065150 0x7f2ab8067600 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2acc009d20 tx=0x7f2acc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:18.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.928+0000 7f2adbe00640 1 -- 172.21.15.106:0/776558833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2adc153440 msgr2=0x7f2adc0afb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:18.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.928+0000 7f2adbe00640 1 --2- 172.21.15.106:0/776558833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2adc153440 0x7f2adc0afb60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009f50 tx=0x7f2ad4037000 comp rx=0 tx=0).stop 2024-08-17T02:31:18.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.928+0000 7f2adb400640 1 -- 172.21.15.106:0/776558833 reap_dead start 2024-08-17T02:31:18.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.928+0000 7f2adbe00640 1 -- 172.21.15.106:0/776558833 shutdown_connections 2024-08-17T02:31:18.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.928+0000 7f2adbe00640 1 -- 172.21.15.106:0/776558833 >> 172.21.15.106:0/776558833 conn(0x7f2adc0cbc00 msgr2=0x7f2adc0c6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:18.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.928+0000 7f2adbe00640 1 -- 172.21.15.106:0/776558833 shutdown_connections 2024-08-17T02:31:18.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:18.928+0000 7f2adbe00640 1 -- 172.21.15.106:0/776558833 wait complete. 2024-08-17T02:31:18.942 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-17T02:31:19.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.090+0000 7fa4a5c00640 1 Processor -- start 2024-08-17T02:31:19.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.090+0000 7fa4a5c00640 1 -- start start 2024-08-17T02:31:19.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.091+0000 7fa4a5c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa4a0155a20 0x7fa4a00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:19.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.092+0000 7fa4a5c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a0156670 con 0x7fa4a006df00 2024-08-17T02:31:19.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.092+0000 7fa4a5c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a006e5e0 con 0x7fa4a0155df0 2024-08-17T02:31:19.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.092+0000 7fa4a5c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a00b0350 con 0x7fa4a0155a20 2024-08-17T02:31:19.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.092+0000 7fa49f400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa4a006df00 0x7fa4a0156b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50538/0 (socket says 172.21.15.106:50538) 2024-08-17T02:31:19.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.092+0000 7fa49f400640 1 -- 172.21.15.106:0/1884756983 learned_addr learned my addr 172.21.15.106:0/1884756983 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:31:19.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.092+0000 7fa49ea00640 1 --2- 172.21.15.106:0/1884756983 >> v2:172.21.15.171:3300/0 conn(0x7fa4a0155a20 0x7fa4a00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:19.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.092+0000 7fa49e000640 1 -- 172.21.15.106:0/1884756983 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2199318739 0 0) 0x7fa4a0156670 con 0x7fa4a006df00 2024-08-17T02:31:19.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.092+0000 7fa49e000640 1 -- 172.21.15.106:0/1884756983 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4840034e0 con 0x7fa4a006df00 2024-08-17T02:31:19.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.093+0000 7fa49e000640 1 -- 172.21.15.106:0/1884756983 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 835561428 0 0) 0x7fa4840034e0 con 0x7fa4a006df00 2024-08-17T02:31:19.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.093+0000 7fa49e000640 1 -- 172.21.15.106:0/1884756983 >> v2:172.21.15.171:3300/0 conn(0x7fa4a0155a20 msgr2=0x7fa4a00adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:19.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.093+0000 7fa49e000640 1 --2- 172.21.15.106:0/1884756983 >> v2:172.21.15.171:3300/0 conn(0x7fa4a0155a20 0x7fa4a00adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.093+0000 7fa49e000640 1 -- 172.21.15.106:0/1884756983 >> v1:172.21.15.171:6789/0 conn(0x7fa4a0155df0 legacy=0x7fa4a006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:19.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.093+0000 7fa49e000640 1 -- 172.21.15.106:0/1884756983 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a006e8c0 con 0x7fa4a006df00 2024-08-17T02:31:19.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.093+0000 7fa49e000640 1 -- 172.21.15.106:0/1884756983 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7fa4980017f0 con 0x7fa4a006df00 2024-08-17T02:31:19.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.093+0000 7fa49e000640 1 -- 172.21.15.106:0/1884756983 >> v1:172.21.15.106:6789/0 conn(0x7fa4a006df00 legacy=0x7fa4a0156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:19.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.093+0000 7fa49e000640 1 --2- 172.21.15.106:0/1884756983 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4840039d0 0x7fa484003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:19.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.093+0000 7fa49e000640 1 --2- 172.21.15.106:0/1884756983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa484004780 0x7fa484004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:19.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.093+0000 7fa49e000640 1 --2- 172.21.15.106:0/1884756983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa484005130 0x7fa48400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:19.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.093+0000 7fa49e000640 1 -- 172.21.15.106:0/1884756983 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48400c020 con 0x7fa484005130 2024-08-17T02:31:19.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.093+0000 7fa49e000640 1 -- 172.21.15.106:0/1884756983 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48400c190 con 0x7fa484004780 2024-08-17T02:31:19.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.093+0000 7fa49e000640 1 -- 172.21.15.106:0/1884756983 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48400e560 con 0x7fa4840039d0 2024-08-17T02:31:19.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.093+0000 7fa49ea00640 1 --2- 172.21.15.106:0/1884756983 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4840039d0 0x7fa484003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:19.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.093+0000 7fa49f400640 1 --2- 172.21.15.106:0/1884756983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa484005130 0x7fa48400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:19.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.093+0000 7fa496000640 1 --2- 172.21.15.106:0/1884756983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa484004780 0x7fa484004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:19.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.094+0000 7fa49f400640 1 -- 172.21.15.106:0/1884756983 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4840039d0 msgr2=0x7fa484003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:19.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.094+0000 7fa49f400640 1 --2- 172.21.15.106:0/1884756983 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4840039d0 0x7fa484003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.094+0000 7fa49f400640 1 -- 172.21.15.106:0/1884756983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa484004780 msgr2=0x7fa484004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:19.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.094+0000 7fa49f400640 1 --2- 172.21.15.106:0/1884756983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa484004780 0x7fa484004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.094+0000 7fa49f400640 1 -- 172.21.15.106:0/1884756983 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4840034e0 con 0x7fa484005130 2024-08-17T02:31:19.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.094+0000 7fa49ea00640 1 --2- 172.21.15.106:0/1884756983 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4840039d0 0x7fa484003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:31:19.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.095+0000 7fa49f400640 1 -- 172.21.15.106:0/1884756983 reap_dead start 2024-08-17T02:31:19.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.095+0000 7fa49f400640 1 --2- 172.21.15.106:0/1884756983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa484005130 0x7fa48400b9d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa49800a8a0 tx=0x7fa498002170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3a968e4dfccd1a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:19.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.095+0000 7fa49e000640 1 -- 172.21.15.106:0/1884756983 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4980071c0 con 0x7fa484005130 2024-08-17T02:31:19.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.095+0000 7fa49e000640 1 -- 172.21.15.106:0/1884756983 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa498007340 con 0x7fa484005130 2024-08-17T02:31:19.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.095+0000 7fa49e000640 1 -- 172.21.15.106:0/1884756983 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa498007700 con 0x7fa484005130 2024-08-17T02:31:19.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.095+0000 7fa4a5c00640 1 -- 172.21.15.106:0/1884756983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa484005130 msgr2=0x7fa48400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:19.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.095+0000 7fa4a5c00640 1 --2- 172.21.15.106:0/1884756983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa484005130 0x7fa48400b9d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa49800a8a0 tx=0x7fa498002170 comp rx=0 tx=0).stop 2024-08-17T02:31:19.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.096+0000 7fa4a5c00640 1 -- 172.21.15.106:0/1884756983 shutdown_connections 2024-08-17T02:31:19.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.096+0000 7fa4a5c00640 1 --2- 172.21.15.106:0/1884756983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa484005130 0x7fa48400b9d0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.096+0000 7fa4a5c00640 1 -- 172.21.15.106:0/1884756983 >> 172.21.15.106:0/1884756983 conn(0x7fa4a00cb9b0 msgr2=0x7fa4a00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:19.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.096+0000 7fa4a5c00640 1 -- 172.21.15.106:0/1884756983 shutdown_connections 2024-08-17T02:31:19.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.096+0000 7fa4a5c00640 1 -- 172.21.15.106:0/1884756983 wait complete. 2024-08-17T02:31:19.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.097+0000 7fa4a5c00640 1 Processor -- start 2024-08-17T02:31:19.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.097+0000 7fa4a5c00640 1 -- start start 2024-08-17T02:31:19.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.098+0000 7fa4a5c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa484005130 0x7fa4a0149370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:19.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.098+0000 7fa4a5c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4a00ac9d0 0x7fa4a0069cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:19.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.098+0000 7fa4a5c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4a00ace40 0x7fa4a006a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:19.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.098+0000 7fa4a5c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a016c130 con 0x7fa484005130 2024-08-17T02:31:19.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.098+0000 7fa4a5c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a016c380 con 0x7fa4a00ac9d0 2024-08-17T02:31:19.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.098+0000 7fa4a5c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a016c660 con 0x7fa4a00ace40 2024-08-17T02:31:19.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.098+0000 7fa49ea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa484005130 0x7fa4a0149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:19.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.098+0000 7fa49ea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa484005130 0x7fa4a0149370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34890/0 (socket says 172.21.15.106:34890) 2024-08-17T02:31:19.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.098+0000 7fa49ea00640 1 -- 172.21.15.106:0/3647570597 learned_addr learned my addr 172.21.15.106:0/3647570597 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:19.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.098+0000 7fa49f400640 1 --2- 172.21.15.106:0/3647570597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4a00ace40 0x7fa4a006a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:19.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.098+0000 7fa49ea00640 1 -- 172.21.15.106:0/3647570597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4a00ace40 msgr2=0x7fa4a006a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:19.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.099+0000 7fa496000640 1 --2- 172.21.15.106:0/3647570597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4a00ac9d0 0x7fa4a0069cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:19.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.099+0000 7fa49ea00640 1 --2- 172.21.15.106:0/3647570597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4a00ace40 0x7fa4a006a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.099+0000 7fa49ea00640 1 -- 172.21.15.106:0/3647570597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4a00ac9d0 msgr2=0x7fa4a0069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:19.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.099+0000 7fa49ea00640 1 --2- 172.21.15.106:0/3647570597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4a00ac9d0 0x7fa4a0069cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.099+0000 7fa49ea00640 1 -- 172.21.15.106:0/3647570597 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a016c940 con 0x7fa484005130 2024-08-17T02:31:19.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.099+0000 7fa496000640 1 --2- 172.21.15.106:0/3647570597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4a00ac9d0 0x7fa4a0069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:31:19.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.099+0000 7fa49ea00640 1 --2- 172.21.15.106:0/3647570597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa484005130 0x7fa4a0149370 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa490011d40 tx=0x7fa4900090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:19.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.099+0000 7fa496a00640 1 -- 172.21.15.106:0/3647570597 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49000fec0 con 0x7fa484005130 2024-08-17T02:31:19.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.099+0000 7fa496a00640 1 -- 172.21.15.106:0/3647570597 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa490011e40 con 0x7fa484005130 2024-08-17T02:31:19.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.099+0000 7fa496a00640 1 -- 172.21.15.106:0/3647570597 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa490014670 con 0x7fa484005130 2024-08-17T02:31:19.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.099+0000 7fa4a5c00640 1 -- 172.21.15.106:0/3647570597 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a016cc20 con 0x7fa484005130 2024-08-17T02:31:19.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.099+0000 7fa4a5c00640 1 -- 172.21.15.106:0/3647570597 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a01498b0 con 0x7fa484005130 2024-08-17T02:31:19.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.100+0000 7fa4a5c00640 1 -- 172.21.15.106:0/3647570597 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a0064db0 con 0x7fa484005130 2024-08-17T02:31:19.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.101+0000 7fa496a00640 1 -- 172.21.15.106:0/3647570597 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa490014a60 con 0x7fa484005130 2024-08-17T02:31:19.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.102+0000 7fa496a00640 1 --2- 172.21.15.106:0/3647570597 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa47c065180 0x7fa47c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:19.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.102+0000 7fa496a00640 1 -- 172.21.15.106:0/3647570597 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fa490018070 con 0x7fa484005130 2024-08-17T02:31:19.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.102+0000 7fa496000640 1 --2- 172.21.15.106:0/3647570597 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa47c065180 0x7fa47c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:19.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.103+0000 7fa496000640 1 --2- 172.21.15.106:0/3647570597 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa47c065180 0x7fa47c067630 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa488007b30 tx=0x7fa488009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:19.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.106+0000 7fa496a00640 1 -- 172.21.15.106:0/3647570597 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa490051350 con 0x7fa484005130 2024-08-17T02:31:19.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.275+0000 7fa4a5c00640 1 -- 172.21.15.106:0/3647570597 --> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4a0157d50 con 0x7fa47c065180 2024-08-17T02:31:19.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.276+0000 7fa496a00640 1 -- 172.21.15.106:0/3647570597 <== mgr.4107 v2:172.21.15.106:6832/36860 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa4a0157d50 con 0x7fa47c065180 2024-08-17T02:31:19.277 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 5 to deep-scrub 2024-08-17T02:31:19.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.278+0000 7fa4a5c00640 1 -- 172.21.15.106:0/3647570597 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa47c065180 msgr2=0x7fa47c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:19.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.278+0000 7fa4a5c00640 1 --2- 172.21.15.106:0/3647570597 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa47c065180 0x7fa47c067630 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa488007b30 tx=0x7fa488009040 comp rx=0 tx=0).stop 2024-08-17T02:31:19.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.278+0000 7fa4a5c00640 1 -- 172.21.15.106:0/3647570597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa484005130 msgr2=0x7fa4a0149370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:19.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.278+0000 7fa4a5c00640 1 --2- 172.21.15.106:0/3647570597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa484005130 0x7fa4a0149370 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa490011d40 tx=0x7fa4900090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.278+0000 7fa4a5c00640 1 -- 172.21.15.106:0/3647570597 shutdown_connections 2024-08-17T02:31:19.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.278+0000 7fa4a5c00640 1 --2- 172.21.15.106:0/3647570597 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa4a00ace40 0x7fa4a006a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.278+0000 7fa4a5c00640 1 --2- 172.21.15.106:0/3647570597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4a00ac9d0 0x7fa4a0069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.278+0000 7fa4a5c00640 1 --2- 172.21.15.106:0/3647570597 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa47c065180 0x7fa47c067630 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.278+0000 7fa4a5c00640 1 --2- 172.21.15.106:0/3647570597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa484005130 0x7fa4a0149370 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.278+0000 7fa4a5c00640 1 -- 172.21.15.106:0/3647570597 >> 172.21.15.106:0/3647570597 conn(0x7fa4a00cb9b0 msgr2=0x7fa4a01544a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:19.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.278+0000 7fa4a5c00640 1 -- 172.21.15.106:0/3647570597 shutdown_connections 2024-08-17T02:31:19.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.278+0000 7fa4a5c00640 1 -- 172.21.15.106:0/3647570597 wait complete. 2024-08-17T02:31:19.293 INFO:tasks.ceph:Scrubbing osd.6 2024-08-17T02:31:19.293 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:31:19.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.444+0000 7f8181e00640 1 Processor -- start 2024-08-17T02:31:19.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.445+0000 7f8181e00640 1 -- start start 2024-08-17T02:31:19.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.446+0000 7f8181e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f817c155c50 0x7f817c0af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:19.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.446+0000 7f8181e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f817c0af630 0x7f817c157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:19.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.446+0000 7f8181e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f817c157840 con 0x7f817c155880 2024-08-17T02:31:19.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.446+0000 7f8181e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f817c0afa70 con 0x7f817c0af630 2024-08-17T02:31:19.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.446+0000 7f8181e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f817c0aed40 con 0x7f817c155c50 2024-08-17T02:31:19.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.446+0000 7f8181400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f817c0af630 0x7f817c157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:19.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.446+0000 7f8180a00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f817c155880 0x7f817c0ae630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:50550/0 (socket says 172.21.15.106:50550) 2024-08-17T02:31:19.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.446+0000 7f8180a00640 1 -- 172.21.15.106:0/1585775294 learned_addr learned my addr 172.21.15.106:0/1585775294 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:31:19.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.446+0000 7f817b400640 1 -- 172.21.15.106:0/1585775294 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 841864799 0 0) 0x7f817c157840 con 0x7f817c155880 2024-08-17T02:31:19.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.446+0000 7f817b400640 1 -- 172.21.15.106:0/1585775294 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81600034e0 con 0x7f817c155880 2024-08-17T02:31:19.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.446+0000 7f817be00640 1 --2- 172.21.15.106:0/1585775294 >> v2:172.21.15.171:3300/0 conn(0x7f817c155c50 0x7f817c0af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:19.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.447+0000 7f8181400640 1 -- 172.21.15.106:0/1585775294 >> v2:172.21.15.171:3300/0 conn(0x7f817c155c50 msgr2=0x7f817c0af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:19.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.447+0000 7f8181400640 1 --2- 172.21.15.106:0/1585775294 >> v2:172.21.15.171:3300/0 conn(0x7f817c155c50 0x7f817c0af0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.447+0000 7f8181400640 1 -- 172.21.15.106:0/1585775294 >> v1:172.21.15.106:6789/0 conn(0x7f817c155880 legacy=0x7f817c0ae630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:19.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.447+0000 7f8181400640 1 -- 172.21.15.106:0/1585775294 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817c156c30 con 0x7f817c0af630 2024-08-17T02:31:19.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.447+0000 7f817be00640 1 --2- 172.21.15.106:0/1585775294 >> v2:172.21.15.171:3300/0 conn(0x7f817c155c50 0x7f817c0af0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:31:19.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.448+0000 7f8181400640 1 --2- 172.21.15.106:0/1585775294 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f817c0af630 0x7f817c157cd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f817c156b40 tx=0x7f8174009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c5aaea379957aae server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:19.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.448+0000 7f817b400640 1 -- 172.21.15.106:0/1585775294 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8174007550 con 0x7f817c0af630 2024-08-17T02:31:19.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.448+0000 7f817b400640 1 -- 172.21.15.106:0/1585775294 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817402d050 con 0x7f817c0af630 2024-08-17T02:31:19.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.448+0000 7f817b400640 1 -- 172.21.15.106:0/1585775294 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8174007900 con 0x7f817c0af630 2024-08-17T02:31:19.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.448+0000 7f8181e00640 1 -- 172.21.15.106:0/1585775294 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f817c0af630 msgr2=0x7f817c157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:19.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.448+0000 7f8181e00640 1 --2- 172.21.15.106:0/1585775294 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f817c0af630 0x7f817c157cd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f817c156b40 tx=0x7f8174009780 comp rx=0 tx=0).stop 2024-08-17T02:31:19.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.448+0000 7f8181e00640 1 -- 172.21.15.106:0/1585775294 shutdown_connections 2024-08-17T02:31:19.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.448+0000 7f8181e00640 1 --2- 172.21.15.106:0/1585775294 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f817c0af630 0x7f817c157cd0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.448+0000 7f8181e00640 1 --2- 172.21.15.106:0/1585775294 >> v2:172.21.15.171:3300/0 conn(0x7f817c155c50 0x7f817c0af0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.448+0000 7f8181e00640 1 -- 172.21.15.106:0/1585775294 >> 172.21.15.106:0/1585775294 conn(0x7f817c067750 msgr2=0x7f817c0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:19.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.449+0000 7f8181e00640 1 -- 172.21.15.106:0/1585775294 shutdown_connections 2024-08-17T02:31:19.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.449+0000 7f8181e00640 1 -- 172.21.15.106:0/1585775294 wait complete. 2024-08-17T02:31:19.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.450+0000 7f8181e00640 1 Processor -- start 2024-08-17T02:31:19.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.450+0000 7f8181e00640 1 -- start start 2024-08-17T02:31:19.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.451+0000 7f8181e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f817c0af630 0x7f817c0a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:19.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.451+0000 7f8181e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f817c155880 0x7f817c0a5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:19.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.451+0000 7f8181e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f817c155c50 0x7f817c0a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:19.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.451+0000 7f8181e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c0c4f90 con 0x7f817c155880 2024-08-17T02:31:19.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.451+0000 7f8181e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c152c60 con 0x7f817c0af630 2024-08-17T02:31:19.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.451+0000 7f8181e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817c0c4410 con 0x7f817c155c50 2024-08-17T02:31:19.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.451+0000 7f817be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f817c155880 0x7f817c0a5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:19.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.451+0000 7f817be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f817c155880 0x7f817c0a5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34916/0 (socket says 172.21.15.106:34916) 2024-08-17T02:31:19.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.451+0000 7f817be00640 1 -- 172.21.15.106:0/1374679444 learned_addr learned my addr 172.21.15.106:0/1374679444 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:19.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.451+0000 7f8180a00640 1 --2- 172.21.15.106:0/1374679444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f817c0af630 0x7f817c0a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:19.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.451+0000 7f8181400640 1 --2- 172.21.15.106:0/1374679444 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f817c155c50 0x7f817c0a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:19.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.452+0000 7f817be00640 1 -- 172.21.15.106:0/1374679444 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f817c155c50 msgr2=0x7f817c0a6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:19.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.452+0000 7f817be00640 1 --2- 172.21.15.106:0/1374679444 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f817c155c50 0x7f817c0a6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.452+0000 7f817be00640 1 -- 172.21.15.106:0/1374679444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f817c0af630 msgr2=0x7f817c0a58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:19.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.452+0000 7f817be00640 1 --2- 172.21.15.106:0/1374679444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f817c0af630 0x7f817c0a58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.452+0000 7f817be00640 1 -- 172.21.15.106:0/1374679444 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8174009a20 con 0x7f817c155880 2024-08-17T02:31:19.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.452+0000 7f817be00640 1 --2- 172.21.15.106:0/1374679444 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f817c155880 0x7f817c0a5df0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f816800c880 tx=0x7f8168008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:19.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.452+0000 7f8173e00640 1 -- 172.21.15.106:0/1374679444 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816800ce10 con 0x7f817c155880 2024-08-17T02:31:19.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.452+0000 7f8173e00640 1 -- 172.21.15.106:0/1374679444 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8168007830 con 0x7f817c155880 2024-08-17T02:31:19.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.452+0000 7f8181e00640 1 -- 172.21.15.106:0/1374679444 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817c0c46f0 con 0x7f817c155880 2024-08-17T02:31:19.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.452+0000 7f8173e00640 1 -- 172.21.15.106:0/1374679444 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8168007c10 con 0x7f817c155880 2024-08-17T02:31:19.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.452+0000 7f8181e00640 1 -- 172.21.15.106:0/1374679444 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f817c0c4d30 con 0x7f817c155880 2024-08-17T02:31:19.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.453+0000 7f8181e00640 1 -- 172.21.15.106:0/1374679444 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f817c071050 con 0x7f817c155880 2024-08-17T02:31:19.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.454+0000 7f8173e00640 1 -- 172.21.15.106:0/1374679444 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8168011600 con 0x7f817c155880 2024-08-17T02:31:19.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.455+0000 7f8173e00640 1 --2- 172.21.15.106:0/1374679444 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f815c065150 0x7f815c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:19.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.455+0000 7f8173e00640 1 -- 172.21.15.106:0/1374679444 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f8168082510 con 0x7f817c155880 2024-08-17T02:31:19.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.455+0000 7f8180a00640 1 --2- 172.21.15.106:0/1374679444 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f815c065150 0x7f815c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:19.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.455+0000 7f8173e00640 1 --2- 172.21.15.106:0/1374679444 >> [v2:172.21.15.171:6824/37356,v1:172.21.15.171:6825/37356] conn(0x7f815c06b040 0x7f815c06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:19.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.455+0000 7f8173e00640 1 -- 172.21.15.106:0/1374679444 --> [v2:172.21.15.171:6824/37356,v1:172.21.15.171:6825/37356] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f815c06db00 con 0x7f815c06b040 2024-08-17T02:31:19.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.455+0000 7f8173e00640 1 -- 172.21.15.106:0/1374679444 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8168084a70 con 0x7f817c155880 2024-08-17T02:31:19.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.456+0000 7f8180a00640 1 --2- 172.21.15.106:0/1374679444 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f815c065150 0x7f815c067600 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f816c005840 tx=0x7f816c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:19.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.456+0000 7f8181400640 1 --2- 172.21.15.106:0/1374679444 >> [v2:172.21.15.171:6824/37356,v1:172.21.15.171:6825/37356] conn(0x7f815c06b040 0x7f815c06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:19.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.456+0000 7f8181400640 1 --2- 172.21.15.106:0/1374679444 >> [v2:172.21.15.171:6824/37356,v1:172.21.15.171:6825/37356] conn(0x7f815c06b040 0x7f815c06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:19.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.457+0000 7f8173e00640 1 -- 172.21.15.106:0/1374679444 <== osd.6 v2:172.21.15.171:6824/37356 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f815c06db00 con 0x7f815c06b040 2024-08-17T02:31:19.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.470+0000 7f8181e00640 1 -- 172.21.15.106:0/1374679444 --> [v2:172.21.15.171:6824/37356,v1:172.21.15.171:6825/37356] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f817c0a54d0 con 0x7f815c06b040 2024-08-17T02:31:19.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.471+0000 7f8173e00640 1 -- 172.21.15.106:0/1374679444 <== osd.6 v2:172.21.15.171:6824/37356 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f817c0a54d0 con 0x7f815c06b040 2024-08-17T02:31:19.471 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-08-17T02:31:19.472 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:31:19.472 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-08-17T02:31:19.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.471+0000 7f8181e00640 1 -- 172.21.15.106:0/1374679444 >> [v2:172.21.15.171:6824/37356,v1:172.21.15.171:6825/37356] conn(0x7f815c06b040 msgr2=0x7f815c06d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:19.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.471+0000 7f8181e00640 1 --2- 172.21.15.106:0/1374679444 >> [v2:172.21.15.171:6824/37356,v1:172.21.15.171:6825/37356] conn(0x7f815c06b040 0x7f815c06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.471+0000 7f8181e00640 1 -- 172.21.15.106:0/1374679444 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f815c065150 msgr2=0x7f815c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:19.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.471+0000 7f8181e00640 1 --2- 172.21.15.106:0/1374679444 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f815c065150 0x7f815c067600 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f816c005840 tx=0x7f816c009040 comp rx=0 tx=0).stop 2024-08-17T02:31:19.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.471+0000 7f8181e00640 1 -- 172.21.15.106:0/1374679444 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f817c155880 msgr2=0x7f817c0a5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:19.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.471+0000 7f8181e00640 1 --2- 172.21.15.106:0/1374679444 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f817c155880 0x7f817c0a5df0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f816800c880 tx=0x7f8168008040 comp rx=0 tx=0).stop 2024-08-17T02:31:19.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.471+0000 7f8181400640 1 -- 172.21.15.106:0/1374679444 reap_dead start 2024-08-17T02:31:19.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.471+0000 7f8181e00640 1 -- 172.21.15.106:0/1374679444 shutdown_connections 2024-08-17T02:31:19.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.471+0000 7f8181e00640 1 -- 172.21.15.106:0/1374679444 >> 172.21.15.106:0/1374679444 conn(0x7f817c067750 msgr2=0x7f817c1547e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:19.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.472+0000 7f8181e00640 1 -- 172.21.15.106:0/1374679444 shutdown_connections 2024-08-17T02:31:19.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.472+0000 7f8181e00640 1 -- 172.21.15.106:0/1374679444 wait complete. 2024-08-17T02:31:19.485 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-17T02:31:19.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.633+0000 7fa8d5600640 1 Processor -- start 2024-08-17T02:31:19.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.634+0000 7fa8d5600640 1 -- start start 2024-08-17T02:31:19.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.635+0000 7fa8d5600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa8d00ada20 0x7fa8d00c8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:19.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.635+0000 7fa8d5600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa8d0159c40 0x7fa8d00addf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:19.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.635+0000 7fa8d5600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8d00cae60 0x7fa8d00cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:19.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.635+0000 7fa8d5600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d00ae6b0 con 0x7fa8d0159c40 2024-08-17T02:31:19.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.635+0000 7fa8d5600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d00af230 con 0x7fa8d00ada20 2024-08-17T02:31:19.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.635+0000 7fa8d5600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d00ae900 con 0x7fa8d00cae60 2024-08-17T02:31:19.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.635+0000 7fa8c7400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa8d0159c40 0x7fa8d00addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:19.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.635+0000 7fa8c7400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa8d0159c40 0x7fa8d00addf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34924/0 (socket says 172.21.15.106:34924) 2024-08-17T02:31:19.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.635+0000 7fa8c7400640 1 -- 172.21.15.106:0/3134187227 learned_addr learned my addr 172.21.15.106:0/3134187227 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:19.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.635+0000 7fa8d4c00640 1 --2- 172.21.15.106:0/3134187227 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8d00cae60 0x7fa8d00cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:19.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.635+0000 7fa8cfe00640 1 --2- 172.21.15.106:0/3134187227 >> v2:172.21.15.171:3300/0 conn(0x7fa8d00ada20 0x7fa8d00c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:19.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.635+0000 7fa8c7400640 1 -- 172.21.15.106:0/3134187227 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8d00cae60 msgr2=0x7fa8d00cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:19.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.635+0000 7fa8c7400640 1 --2- 172.21.15.106:0/3134187227 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8d00cae60 0x7fa8d00cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.635+0000 7fa8c7400640 1 -- 172.21.15.106:0/3134187227 >> v2:172.21.15.171:3300/0 conn(0x7fa8d00ada20 msgr2=0x7fa8d00c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:19.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.635+0000 7fa8c7400640 1 --2- 172.21.15.106:0/3134187227 >> v2:172.21.15.171:3300/0 conn(0x7fa8d00ada20 0x7fa8d00c8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.636+0000 7fa8c7400640 1 -- 172.21.15.106:0/3134187227 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d00aebe0 con 0x7fa8d0159c40 2024-08-17T02:31:19.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.636+0000 7fa8c7400640 1 --2- 172.21.15.106:0/3134187227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d0159c40 0x7fa8d00addf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0065fd0 tx=0x7fa8b80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b70c390faabe7794 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:19.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.637+0000 7fa8cf400640 1 -- 172.21.15.106:0/3134187227 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b802add0 con 0x7fa8d0159c40 2024-08-17T02:31:19.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.637+0000 7fa8cf400640 1 -- 172.21.15.106:0/3134187227 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b8032440 con 0x7fa8d0159c40 2024-08-17T02:31:19.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.637+0000 7fa8cf400640 1 -- 172.21.15.106:0/3134187227 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8032820 con 0x7fa8d0159c40 2024-08-17T02:31:19.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.637+0000 7fa8d5600640 1 -- 172.21.15.106:0/3134187227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d0159c40 msgr2=0x7fa8d00addf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:19.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.637+0000 7fa8d5600640 1 --2- 172.21.15.106:0/3134187227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d0159c40 0x7fa8d00addf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0065fd0 tx=0x7fa8b80091d0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.637+0000 7fa8d5600640 1 -- 172.21.15.106:0/3134187227 shutdown_connections 2024-08-17T02:31:19.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.637+0000 7fa8d5600640 1 --2- 172.21.15.106:0/3134187227 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8d00cae60 0x7fa8d00cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.637+0000 7fa8d5600640 1 --2- 172.21.15.106:0/3134187227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d0159c40 0x7fa8d00addf0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.637+0000 7fa8d5600640 1 --2- 172.21.15.106:0/3134187227 >> v2:172.21.15.171:3300/0 conn(0x7fa8d00ada20 0x7fa8d00c8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.637+0000 7fa8d5600640 1 -- 172.21.15.106:0/3134187227 >> 172.21.15.106:0/3134187227 conn(0x7fa8d0067750 msgr2=0x7fa8d00cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:19.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.638+0000 7fa8d5600640 1 -- 172.21.15.106:0/3134187227 shutdown_connections 2024-08-17T02:31:19.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.638+0000 7fa8d5600640 1 -- 172.21.15.106:0/3134187227 wait complete. 2024-08-17T02:31:19.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.639+0000 7fa8d5600640 1 Processor -- start 2024-08-17T02:31:19.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.639+0000 7fa8d5600640 1 -- start start 2024-08-17T02:31:19.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.640+0000 7fa8d5600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8d00ada20 0x7fa8d014d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:19.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.640+0000 7fa8d5600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d00cae60 0x7fa8d00a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:19.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.640+0000 7fa8d5600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8d0159c40 0x7fa8d0153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:19.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.640+0000 7fa8d5600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d00a6b70 con 0x7fa8d00cae60 2024-08-17T02:31:19.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.640+0000 7fa8d5600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d00a6e50 con 0x7fa8d00ada20 2024-08-17T02:31:19.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.640+0000 7fa8d5600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d00a7130 con 0x7fa8d0159c40 2024-08-17T02:31:19.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.640+0000 7fa8c7400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d00cae60 0x7fa8d00a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:19.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.640+0000 7fa8c7400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d00cae60 0x7fa8d00a5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34934/0 (socket says 172.21.15.106:34934) 2024-08-17T02:31:19.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.640+0000 7fa8c7400640 1 -- 172.21.15.106:0/2502321390 learned_addr learned my addr 172.21.15.106:0/2502321390 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:19.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.640+0000 7fa8cfe00640 1 --2- 172.21.15.106:0/2502321390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8d00ada20 0x7fa8d014d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:19.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.640+0000 7fa8d4c00640 1 --2- 172.21.15.106:0/2502321390 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8d0159c40 0x7fa8d0153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:19.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.641+0000 7fa8c7400640 1 -- 172.21.15.106:0/2502321390 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8d0159c40 msgr2=0x7fa8d0153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:19.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.641+0000 7fa8c7400640 1 --2- 172.21.15.106:0/2502321390 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8d0159c40 0x7fa8d0153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.641+0000 7fa8c7400640 1 -- 172.21.15.106:0/2502321390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8d00ada20 msgr2=0x7fa8d014d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:19.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.641+0000 7fa8c7400640 1 --2- 172.21.15.106:0/2502321390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8d00ada20 0x7fa8d014d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.641+0000 7fa8c7400640 1 -- 172.21.15.106:0/2502321390 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b8009450 con 0x7fa8d00cae60 2024-08-17T02:31:19.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.641+0000 7fa8cfe00640 1 --2- 172.21.15.106:0/2502321390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8d00ada20 0x7fa8d014d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:31:19.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.641+0000 7fa8c7400640 1 --2- 172.21.15.106:0/2502321390 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d00cae60 0x7fa8d00a5e90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009210 tx=0x7fa8b8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:19.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.641+0000 7fa8c7e00640 1 -- 172.21.15.106:0/2502321390 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8000d10 con 0x7fa8d00cae60 2024-08-17T02:31:19.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.641+0000 7fa8c7e00640 1 -- 172.21.15.106:0/2502321390 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b8031de0 con 0x7fa8d00cae60 2024-08-17T02:31:19.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.641+0000 7fa8d5600640 1 -- 172.21.15.106:0/2502321390 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d00a7410 con 0x7fa8d00cae60 2024-08-17T02:31:19.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.641+0000 7fa8c7e00640 1 -- 172.21.15.106:0/2502321390 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b803d650 con 0x7fa8d00cae60 2024-08-17T02:31:19.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.641+0000 7fa8d5600640 1 -- 172.21.15.106:0/2502321390 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d014daa0 con 0x7fa8d00cae60 2024-08-17T02:31:19.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.642+0000 7fa8d5600640 1 -- 172.21.15.106:0/2502321390 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d00a8c50 con 0x7fa8d00cae60 2024-08-17T02:31:19.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.643+0000 7fa8c7e00640 1 -- 172.21.15.106:0/2502321390 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa8b8039040 con 0x7fa8d00cae60 2024-08-17T02:31:19.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.644+0000 7fa8c7e00640 1 --2- 172.21.15.106:0/2502321390 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa8ac065150 0x7fa8ac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:19.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.644+0000 7fa8c7e00640 1 -- 172.21.15.106:0/2502321390 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fa8b80a2300 con 0x7fa8d00cae60 2024-08-17T02:31:19.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.644+0000 7fa8cfe00640 1 --2- 172.21.15.106:0/2502321390 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa8ac065150 0x7fa8ac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:19.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.645+0000 7fa8cfe00640 1 --2- 172.21.15.106:0/2502321390 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa8ac065150 0x7fa8ac067600 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000bb80 tx=0x7fa8c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:19.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.648+0000 7fa8c7e00640 1 -- 172.21.15.106:0/2502321390 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa8d00a8c50 con 0x7fa8d00cae60 2024-08-17T02:31:19.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.820+0000 7fa8d5600640 1 -- 172.21.15.106:0/2502321390 --> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8d00a8c50 con 0x7fa8ac065150 2024-08-17T02:31:19.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.821+0000 7fa8c7e00640 1 -- 172.21.15.106:0/2502321390 <== mgr.4107 v2:172.21.15.106:6832/36860 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa8d00a8c50 con 0x7fa8ac065150 2024-08-17T02:31:19.821 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 6 to deep-scrub 2024-08-17T02:31:19.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.823+0000 7fa8d5600640 1 -- 172.21.15.106:0/2502321390 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa8ac065150 msgr2=0x7fa8ac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:19.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.823+0000 7fa8d5600640 1 --2- 172.21.15.106:0/2502321390 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa8ac065150 0x7fa8ac067600 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000bb80 tx=0x7fa8c0008040 comp rx=0 tx=0).stop 2024-08-17T02:31:19.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.823+0000 7fa8d5600640 1 -- 172.21.15.106:0/2502321390 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d00cae60 msgr2=0x7fa8d00a5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:19.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.823+0000 7fa8d5600640 1 --2- 172.21.15.106:0/2502321390 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d00cae60 0x7fa8d00a5e90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009210 tx=0x7fa8b8032000 comp rx=0 tx=0).stop 2024-08-17T02:31:19.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.823+0000 7fa8d5600640 1 -- 172.21.15.106:0/2502321390 shutdown_connections 2024-08-17T02:31:19.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.823+0000 7fa8d5600640 1 --2- 172.21.15.106:0/2502321390 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa8d0159c40 0x7fa8d0153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.823+0000 7fa8d5600640 1 --2- 172.21.15.106:0/2502321390 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fa8ac065150 0x7fa8ac067600 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.823+0000 7fa8d5600640 1 --2- 172.21.15.106:0/2502321390 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d00cae60 0x7fa8d00a5e90 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.823+0000 7fa8d5600640 1 --2- 172.21.15.106:0/2502321390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa8d00ada20 0x7fa8d014d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.823+0000 7fa8d5600640 1 -- 172.21.15.106:0/2502321390 >> 172.21.15.106:0/2502321390 conn(0x7fa8d0067750 msgr2=0x7fa8d0069880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:19.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.823+0000 7fa8d5600640 1 -- 172.21.15.106:0/2502321390 shutdown_connections 2024-08-17T02:31:19.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.823+0000 7fa8d5600640 1 -- 172.21.15.106:0/2502321390 wait complete. 2024-08-17T02:31:19.839 INFO:tasks.ceph:Scrubbing osd.7 2024-08-17T02:31:19.839 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:31:19.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.990+0000 7f86ee200640 1 Processor -- start 2024-08-17T02:31:19.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.991+0000 7f86ee200640 1 -- start start 2024-08-17T02:31:19.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.992+0000 7f86ee200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f86e8153510 0x7f86e8159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:19.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.992+0000 7f86ee200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f86e80673e0 0x7f86e80b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:19.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.992+0000 7f86ee200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e81538e0 con 0x7f86e80af760 2024-08-17T02:31:19.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.992+0000 7f86ee200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e80b0700 con 0x7f86e80673e0 2024-08-17T02:31:19.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.992+0000 7f86ee200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e8159940 con 0x7f86e8153510 2024-08-17T02:31:19.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.992+0000 7f86ed800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f86e80673e0 0x7f86e80b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:19.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.992+0000 7f86dfe00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f86e80af760 0x7f86e8066cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:54706/0 (socket says 172.21.15.106:54706) 2024-08-17T02:31:19.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.992+0000 7f86dfe00640 1 -- 172.21.15.106:0/4087969093 learned_addr learned my addr 172.21.15.106:0/4087969093 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:31:19.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.992+0000 7f86ece00640 1 --2- 172.21.15.106:0/4087969093 >> v2:172.21.15.171:3300/0 conn(0x7f86e8153510 0x7f86e8159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:19.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.993+0000 7f86ed800640 1 -- 172.21.15.106:0/4087969093 >> v2:172.21.15.171:3300/0 conn(0x7f86e8153510 msgr2=0x7f86e8159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:19.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.993+0000 7f86ed800640 1 --2- 172.21.15.106:0/4087969093 >> v2:172.21.15.171:3300/0 conn(0x7f86e8153510 0x7f86e8159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.993+0000 7f86ed800640 1 -- 172.21.15.106:0/4087969093 >> v1:172.21.15.106:6789/0 conn(0x7f86e80af760 legacy=0x7f86e8066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:19.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.993+0000 7f86ed800640 1 -- 172.21.15.106:0/4087969093 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e8159370 con 0x7f86e80673e0 2024-08-17T02:31:19.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.993+0000 7f86e7e00640 1 -- 172.21.15.106:0/4087969093 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 709462069 0 0) 0x7f86e81538e0 con 0x7f86e80af760 2024-08-17T02:31:19.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.994+0000 7f86ed800640 1 --2- 172.21.15.106:0/4087969093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86e80673e0 0x7f86e80b0a80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f86e80ac290 tx=0x7f86e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693cfdb021741911 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:19.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.994+0000 7f86e7e00640 1 -- 172.21.15.106:0/4087969093 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0007550 con 0x7f86e80673e0 2024-08-17T02:31:19.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.994+0000 7f86e7e00640 1 -- 172.21.15.106:0/4087969093 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e002d050 con 0x7f86e80673e0 2024-08-17T02:31:19.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.994+0000 7f86e7e00640 1 -- 172.21.15.106:0/4087969093 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e00078e0 con 0x7f86e80673e0 2024-08-17T02:31:19.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.994+0000 7f86ee200640 1 -- 172.21.15.106:0/4087969093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86e80673e0 msgr2=0x7f86e80b0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:19.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.994+0000 7f86ee200640 1 --2- 172.21.15.106:0/4087969093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86e80673e0 0x7f86e80b0a80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f86e80ac290 tx=0x7f86e0009780 comp rx=0 tx=0).stop 2024-08-17T02:31:19.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.995+0000 7f86ee200640 1 -- 172.21.15.106:0/4087969093 shutdown_connections 2024-08-17T02:31:19.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.995+0000 7f86ee200640 1 --2- 172.21.15.106:0/4087969093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86e80673e0 0x7f86e80b0a80 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.995+0000 7f86ee200640 1 --2- 172.21.15.106:0/4087969093 >> v2:172.21.15.171:3300/0 conn(0x7f86e8153510 0x7f86e8159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:19.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.995+0000 7f86ee200640 1 -- 172.21.15.106:0/4087969093 >> 172.21.15.106:0/4087969093 conn(0x7f86e8067de0 msgr2=0x7f86e80681b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:19.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.995+0000 7f86ee200640 1 -- 172.21.15.106:0/4087969093 shutdown_connections 2024-08-17T02:31:19.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.995+0000 7f86ee200640 1 -- 172.21.15.106:0/4087969093 wait complete. 2024-08-17T02:31:19.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.996+0000 7f86ee200640 1 Processor -- start 2024-08-17T02:31:19.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.996+0000 7f86ee200640 1 -- start start 2024-08-17T02:31:19.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.997+0000 7f86ee200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86e80673e0 0x7f86e8152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:19.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.997+0000 7f86ee200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f86e80af760 0x7f86e8154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:19.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.997+0000 7f86ee200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f86e8153510 0x7f86e8158550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:20.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.997+0000 7f86ee200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e8157040 con 0x7f86e80673e0 2024-08-17T02:31:20.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.997+0000 7f86ee200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e8155850 con 0x7f86e8153510 2024-08-17T02:31:20.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.997+0000 7f86ee200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e8154c40 con 0x7f86e80af760 2024-08-17T02:31:20.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.997+0000 7f86ece00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86e80673e0 0x7f86e8152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:20.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.997+0000 7f86ece00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86e80673e0 0x7f86e8152840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37372/0 (socket says 172.21.15.106:37372) 2024-08-17T02:31:20.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.997+0000 7f86ece00640 1 -- 172.21.15.106:0/3376572054 learned_addr learned my addr 172.21.15.106:0/3376572054 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:20.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.998+0000 7f86ece00640 1 -- 172.21.15.106:0/3376572054 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f86e80af760 msgr2=0x7f86e8154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:20.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.998+0000 7f86ece00640 1 --2- 172.21.15.106:0/3376572054 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f86e80af760 0x7f86e8154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:20.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.998+0000 7f86ece00640 1 -- 172.21.15.106:0/3376572054 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f86e8153510 msgr2=0x7f86e8158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:20.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.998+0000 7f86ece00640 1 --2- 172.21.15.106:0/3376572054 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f86e8153510 0x7f86e8158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:20.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.998+0000 7f86ece00640 1 -- 172.21.15.106:0/3376572054 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e0009a20 con 0x7f86e80673e0 2024-08-17T02:31:20.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.998+0000 7f86ece00640 1 --2- 172.21.15.106:0/3376572054 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86e80673e0 0x7f86e8152840 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f86d800e900 tx=0x7f86d80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:20.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.998+0000 7f86e4c00640 1 -- 172.21.15.106:0/3376572054 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d800c8e0 con 0x7f86e80673e0 2024-08-17T02:31:20.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.998+0000 7f86e4c00640 1 -- 172.21.15.106:0/3376572054 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d800ca40 con 0x7f86e80673e0 2024-08-17T02:31:20.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.998+0000 7f86e4c00640 1 -- 172.21.15.106:0/3376572054 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d800cde0 con 0x7f86e80673e0 2024-08-17T02:31:20.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.998+0000 7f86ee200640 1 -- 172.21.15.106:0/3376572054 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e8154f20 con 0x7f86e80673e0 2024-08-17T02:31:20.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.998+0000 7f86ee200640 1 -- 172.21.15.106:0/3376572054 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e81554e0 con 0x7f86e80673e0 2024-08-17T02:31:20.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:19.999+0000 7f86ee200640 1 -- 172.21.15.106:0/3376572054 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f86e8071050 con 0x7f86e80673e0 2024-08-17T02:31:20.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.000+0000 7f86e4c00640 1 -- 172.21.15.106:0/3376572054 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f86d8013680 con 0x7f86e80673e0 2024-08-17T02:31:20.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.001+0000 7f86e4c00640 1 --2- 172.21.15.106:0/3376572054 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f86c4065150 0x7f86c4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:20.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.001+0000 7f86e4c00640 1 -- 172.21.15.106:0/3376572054 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f86d8082350 con 0x7f86e80673e0 2024-08-17T02:31:20.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.001+0000 7f86dfe00640 1 --2- 172.21.15.106:0/3376572054 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f86c4065150 0x7f86c4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:20.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.001+0000 7f86e4c00640 1 --2- 172.21.15.106:0/3376572054 >> [v2:172.21.15.171:6808/37335,v1:172.21.15.171:6809/37335] conn(0x7f86c406b040 0x7f86c406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:20.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.001+0000 7f86e4c00640 1 -- 172.21.15.106:0/3376572054 --> [v2:172.21.15.171:6808/37335,v1:172.21.15.171:6809/37335] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f86c406db00 con 0x7f86c406b040 2024-08-17T02:31:20.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.001+0000 7f86e4c00640 1 -- 172.21.15.106:0/3376572054 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86d8084990 con 0x7f86e80673e0 2024-08-17T02:31:20.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.002+0000 7f86dfe00640 1 --2- 172.21.15.106:0/3376572054 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f86c4065150 0x7f86c4067600 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f86d00011e0 tx=0x7f86d0007940 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:20.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.002+0000 7f86ed800640 1 --2- 172.21.15.106:0/3376572054 >> [v2:172.21.15.171:6808/37335,v1:172.21.15.171:6809/37335] conn(0x7f86c406b040 0x7f86c406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:20.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.002+0000 7f86ed800640 1 --2- 172.21.15.106:0/3376572054 >> [v2:172.21.15.171:6808/37335,v1:172.21.15.171:6809/37335] conn(0x7f86c406b040 0x7f86c406d450 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:20.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.003+0000 7f86e4c00640 1 -- 172.21.15.106:0/3376572054 <== osd.7 v2:172.21.15.171:6808/37335 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f86c406db00 con 0x7f86c406b040 2024-08-17T02:31:20.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.016+0000 7f86ee200640 1 -- 172.21.15.106:0/3376572054 --> [v2:172.21.15.171:6808/37335,v1:172.21.15.171:6809/37335] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f86e80cc4a0 con 0x7f86c406b040 2024-08-17T02:31:20.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.016+0000 7f86e4c00640 1 -- 172.21.15.106:0/3376572054 <== osd.7 v2:172.21.15.171:6808/37335 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f86e80cc4a0 con 0x7f86c406b040 2024-08-17T02:31:20.017 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-08-17T02:31:20.017 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:31:20.017 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-08-17T02:31:20.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.017+0000 7f86ee200640 1 -- 172.21.15.106:0/3376572054 >> [v2:172.21.15.171:6808/37335,v1:172.21.15.171:6809/37335] conn(0x7f86c406b040 msgr2=0x7f86c406d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:20.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.017+0000 7f86ee200640 1 --2- 172.21.15.106:0/3376572054 >> [v2:172.21.15.171:6808/37335,v1:172.21.15.171:6809/37335] conn(0x7f86c406b040 0x7f86c406d450 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:20.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.017+0000 7f86ee200640 1 -- 172.21.15.106:0/3376572054 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f86c4065150 msgr2=0x7f86c4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:20.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.017+0000 7f86ee200640 1 --2- 172.21.15.106:0/3376572054 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f86c4065150 0x7f86c4067600 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f86d00011e0 tx=0x7f86d0007940 comp rx=0 tx=0).stop 2024-08-17T02:31:20.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.017+0000 7f86ee200640 1 -- 172.21.15.106:0/3376572054 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86e80673e0 msgr2=0x7f86e8152840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:20.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.017+0000 7f86ee200640 1 --2- 172.21.15.106:0/3376572054 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86e80673e0 0x7f86e8152840 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f86d800e900 tx=0x7f86d80090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:20.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.017+0000 7f86ed800640 1 -- 172.21.15.106:0/3376572054 reap_dead start 2024-08-17T02:31:20.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.017+0000 7f86ee200640 1 -- 172.21.15.106:0/3376572054 shutdown_connections 2024-08-17T02:31:20.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.017+0000 7f86ee200640 1 -- 172.21.15.106:0/3376572054 >> 172.21.15.106:0/3376572054 conn(0x7f86e8067de0 msgr2=0x7f86e806a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:20.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.017+0000 7f86ee200640 1 -- 172.21.15.106:0/3376572054 shutdown_connections 2024-08-17T02:31:20.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.017+0000 7f86ee200640 1 -- 172.21.15.106:0/3376572054 wait complete. 2024-08-17T02:31:20.031 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-17T02:31:20.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.179+0000 7fd425400640 1 Processor -- start 2024-08-17T02:31:20.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.179+0000 7fd425400640 1 -- start start 2024-08-17T02:31:20.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.180+0000 7fd425400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd4200ceb40 0x7fd4200cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:20.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.180+0000 7fd425400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4200ccf30 con 0x7fd420159ca0 2024-08-17T02:31:20.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.180+0000 7fd425400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4200cadc0 con 0x7fd4200ccad0 2024-08-17T02:31:20.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.180+0000 7fd425400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4200cd6e0 con 0x7fd4200ceb40 2024-08-17T02:31:20.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.180+0000 7fd41fe00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd420159ca0 0x7fd4200ca360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:54708/0 (socket says 172.21.15.106:54708) 2024-08-17T02:31:20.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.180+0000 7fd41fe00640 1 -- 172.21.15.106:0/1450815999 learned_addr learned my addr 172.21.15.106:0/1450815999 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:31:20.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.180+0000 7fd41f400640 1 --2- 172.21.15.106:0/1450815999 >> v2:172.21.15.171:3300/0 conn(0x7fd4200ceb40 0x7fd4200cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:20.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.181+0000 7fd41ea00640 1 -- 172.21.15.106:0/1450815999 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797140760 0 0) 0x7fd4200ccf30 con 0x7fd420159ca0 2024-08-17T02:31:20.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.181+0000 7fd41ea00640 1 -- 172.21.15.106:0/1450815999 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4040034e0 con 0x7fd420159ca0 2024-08-17T02:31:20.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.181+0000 7fd41f400640 1 -- 172.21.15.106:0/1450815999 >> v1:172.21.15.171:6789/0 conn(0x7fd4200ccad0 legacy=0x7fd420162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:20.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.181+0000 7fd41f400640 1 -- 172.21.15.106:0/1450815999 >> v1:172.21.15.106:6789/0 conn(0x7fd420159ca0 legacy=0x7fd4200ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:20.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.181+0000 7fd41f400640 1 -- 172.21.15.106:0/1450815999 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4200cb060 con 0x7fd4200ceb40 2024-08-17T02:31:20.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.182+0000 7fd41f400640 1 --2- 172.21.15.106:0/1450815999 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4200ceb40 0x7fd4200cc590 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd40c009850 tx=0x7fd40c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc40a4311eb7eb2a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:20.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.182+0000 7fd41ea00640 1 -- 172.21.15.106:0/1450815999 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c02ae20 con 0x7fd4200ceb40 2024-08-17T02:31:20.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.182+0000 7fd41ea00640 1 -- 172.21.15.106:0/1450815999 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40c032440 con 0x7fd4200ceb40 2024-08-17T02:31:20.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.182+0000 7fd41ea00640 1 -- 172.21.15.106:0/1450815999 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c0327e0 con 0x7fd4200ceb40 2024-08-17T02:31:20.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.183+0000 7fd425400640 1 -- 172.21.15.106:0/1450815999 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4200ceb40 msgr2=0x7fd4200cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:20.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.183+0000 7fd425400640 1 --2- 172.21.15.106:0/1450815999 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4200ceb40 0x7fd4200cc590 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd40c009850 tx=0x7fd40c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:20.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.183+0000 7fd425400640 1 -- 172.21.15.106:0/1450815999 shutdown_connections 2024-08-17T02:31:20.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.183+0000 7fd425400640 1 --2- 172.21.15.106:0/1450815999 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4200ceb40 0x7fd4200cc590 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:20.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.183+0000 7fd425400640 1 -- 172.21.15.106:0/1450815999 >> 172.21.15.106:0/1450815999 conn(0x7fd420098e00 msgr2=0x7fd42006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:20.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.183+0000 7fd425400640 1 -- 172.21.15.106:0/1450815999 shutdown_connections 2024-08-17T02:31:20.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.183+0000 7fd425400640 1 -- 172.21.15.106:0/1450815999 wait complete. 2024-08-17T02:31:20.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.184+0000 7fd425400640 1 Processor -- start 2024-08-17T02:31:20.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.184+0000 7fd425400640 1 -- start start 2024-08-17T02:31:20.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.185+0000 7fd425400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4200ccad0 0x7fd420154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:20.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.185+0000 7fd425400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4200ceb40 0x7fd4200c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:20.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.185+0000 7fd425400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd420159ca0 0x7fd4200ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:20.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.185+0000 7fd425400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd420154d40 con 0x7fd4200ceb40 2024-08-17T02:31:20.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.185+0000 7fd425400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4200c8760 con 0x7fd4200ccad0 2024-08-17T02:31:20.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.185+0000 7fd425400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4200c92e0 con 0x7fd420159ca0 2024-08-17T02:31:20.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.185+0000 7fd41f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4200ceb40 0x7fd4200c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:20.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.185+0000 7fd41f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4200ceb40 0x7fd4200c7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37388/0 (socket says 172.21.15.106:37388) 2024-08-17T02:31:20.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.185+0000 7fd41f400640 1 -- 172.21.15.106:0/3322661467 learned_addr learned my addr 172.21.15.106:0/3322661467 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:20.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.186+0000 7fd41fe00640 1 --2- 172.21.15.106:0/3322661467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4200ccad0 0x7fd420154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:20.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.186+0000 7fd424a00640 1 --2- 172.21.15.106:0/3322661467 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd420159ca0 0x7fd4200ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:20.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.186+0000 7fd41f400640 1 -- 172.21.15.106:0/3322661467 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd420159ca0 msgr2=0x7fd4200ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:20.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.186+0000 7fd41f400640 1 --2- 172.21.15.106:0/3322661467 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd420159ca0 0x7fd4200ca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:20.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.186+0000 7fd41f400640 1 -- 172.21.15.106:0/3322661467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4200ccad0 msgr2=0x7fd420154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:20.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.186+0000 7fd41f400640 1 --2- 172.21.15.106:0/3322661467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4200ccad0 0x7fd420154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:20.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.186+0000 7fd41f400640 1 -- 172.21.15.106:0/3322661467 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40c009390 con 0x7fd4200ceb40 2024-08-17T02:31:20.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.186+0000 7fd41f400640 1 --2- 172.21.15.106:0/3322661467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4200ceb40 0x7fd4200c7580 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd40c009850 tx=0x7fd40c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:20.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.186+0000 7fd417400640 1 -- 172.21.15.106:0/3322661467 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c000d10 con 0x7fd4200ceb40 2024-08-17T02:31:20.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.186+0000 7fd417400640 1 -- 172.21.15.106:0/3322661467 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40c031e00 con 0x7fd4200ceb40 2024-08-17T02:31:20.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.186+0000 7fd417400640 1 -- 172.21.15.106:0/3322661467 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c03d690 con 0x7fd4200ceb40 2024-08-17T02:31:20.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.186+0000 7fd425400640 1 -- 172.21.15.106:0/3322661467 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4200c7ac0 con 0x7fd4200ceb40 2024-08-17T02:31:20.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.187+0000 7fd425400640 1 -- 172.21.15.106:0/3322661467 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4200c8c90 con 0x7fd4200ceb40 2024-08-17T02:31:20.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.187+0000 7fd425400640 1 -- 172.21.15.106:0/3322661467 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd420071050 con 0x7fd4200ceb40 2024-08-17T02:31:20.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.188+0000 7fd417400640 1 -- 172.21.15.106:0/3322661467 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd40c039040 con 0x7fd4200ceb40 2024-08-17T02:31:20.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.189+0000 7fd417400640 1 --2- 172.21.15.106:0/3322661467 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd400065150 0x7fd400067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:20.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.189+0000 7fd417400640 1 -- 172.21.15.106:0/3322661467 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fd40c0a2120 con 0x7fd4200ceb40 2024-08-17T02:31:20.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.189+0000 7fd41fe00640 1 --2- 172.21.15.106:0/3322661467 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd400065150 0x7fd400067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:20.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.190+0000 7fd41fe00640 1 --2- 172.21.15.106:0/3322661467 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd400065150 0x7fd400067600 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd410001200 tx=0x7fd410009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:20.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.193+0000 7fd417400640 1 -- 172.21.15.106:0/3322661467 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd40c0703e0 con 0x7fd4200ceb40 2024-08-17T02:31:20.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.364+0000 7fd425400640 1 -- 172.21.15.106:0/3322661467 --> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4200c9420 con 0x7fd400065150 2024-08-17T02:31:20.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.365+0000 7fd417400640 1 -- 172.21.15.106:0/3322661467 <== mgr.4107 v2:172.21.15.106:6832/36860 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd4200c9420 con 0x7fd400065150 2024-08-17T02:31:20.365 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 7 to deep-scrub 2024-08-17T02:31:20.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.367+0000 7fd425400640 1 -- 172.21.15.106:0/3322661467 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd400065150 msgr2=0x7fd400067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:20.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.367+0000 7fd425400640 1 --2- 172.21.15.106:0/3322661467 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd400065150 0x7fd400067600 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd410001200 tx=0x7fd410009040 comp rx=0 tx=0).stop 2024-08-17T02:31:20.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.367+0000 7fd425400640 1 -- 172.21.15.106:0/3322661467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4200ceb40 msgr2=0x7fd4200c7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:20.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.367+0000 7fd425400640 1 --2- 172.21.15.106:0/3322661467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4200ceb40 0x7fd4200c7580 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd40c009850 tx=0x7fd40c032000 comp rx=0 tx=0).stop 2024-08-17T02:31:20.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.367+0000 7fd425400640 1 -- 172.21.15.106:0/3322661467 shutdown_connections 2024-08-17T02:31:20.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.367+0000 7fd425400640 1 --2- 172.21.15.106:0/3322661467 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd420159ca0 0x7fd4200ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:20.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.367+0000 7fd425400640 1 --2- 172.21.15.106:0/3322661467 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fd400065150 0x7fd400067600 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:20.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.367+0000 7fd425400640 1 --2- 172.21.15.106:0/3322661467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4200ceb40 0x7fd4200c7580 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:20.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.367+0000 7fd425400640 1 --2- 172.21.15.106:0/3322661467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4200ccad0 0x7fd420154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:20.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.367+0000 7fd425400640 1 -- 172.21.15.106:0/3322661467 >> 172.21.15.106:0/3322661467 conn(0x7fd420098e00 msgr2=0x7fd420156f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:20.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.367+0000 7fd425400640 1 -- 172.21.15.106:0/3322661467 shutdown_connections 2024-08-17T02:31:20.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.367+0000 7fd425400640 1 -- 172.21.15.106:0/3322661467 wait complete. 2024-08-17T02:31:20.383 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:31:20.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.529+0000 7f9ad7800640 1 Processor -- start 2024-08-17T02:31:20.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.529+0000 7f9ad7800640 1 -- start start 2024-08-17T02:31:20.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.531+0000 7f9ad7800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9ad00b1440 0x7f9ad00caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:20.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.531+0000 7f9ad7800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad00caa80 con 0x7f9ad01401b0 2024-08-17T02:31:20.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.531+0000 7f9ad7800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad00c9e70 con 0x7f9ad0140580 2024-08-17T02:31:20.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.531+0000 7f9ad7800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad00cb450 con 0x7f9ad00b1440 2024-08-17T02:31:20.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.531+0000 7f9ad4e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f9ad01401b0 0x7f9ad00b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:54724/0 (socket says 172.21.15.106:54724) 2024-08-17T02:31:20.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.531+0000 7f9ad4e00640 1 -- 172.21.15.106:0/1851996388 learned_addr learned my addr 172.21.15.106:0/1851996388 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:31:20.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.531+0000 7f9ac7e00640 1 --2- 172.21.15.106:0/1851996388 >> v2:172.21.15.171:3300/0 conn(0x7f9ad00b1440 0x7f9ad00caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:20.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.531+0000 7f9acfe00640 1 -- 172.21.15.106:0/1851996388 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3992369282 0 0) 0x7f9ad00caa80 con 0x7f9ad01401b0 2024-08-17T02:31:20.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.531+0000 7f9acfe00640 1 -- 172.21.15.106:0/1851996388 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ab40034e0 con 0x7f9ad01401b0 2024-08-17T02:31:20.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.532+0000 7f9acfe00640 1 -- 172.21.15.106:0/1851996388 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1130999733 0 0) 0x7f9ab40034e0 con 0x7f9ad01401b0 2024-08-17T02:31:20.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.532+0000 7f9acfe00640 1 -- 172.21.15.106:0/1851996388 >> v2:172.21.15.171:3300/0 conn(0x7f9ad00b1440 msgr2=0x7f9ad00caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:20.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.532+0000 7f9acfe00640 1 --2- 172.21.15.106:0/1851996388 >> v2:172.21.15.171:3300/0 conn(0x7f9ad00b1440 0x7f9ad00caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:20.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.532+0000 7f9acfe00640 1 -- 172.21.15.106:0/1851996388 >> v1:172.21.15.171:6789/0 conn(0x7f9ad0140580 legacy=0x7f9ad00c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:20.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.532+0000 7f9acfe00640 1 -- 172.21.15.106:0/1851996388 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad00ca150 con 0x7f9ad01401b0 2024-08-17T02:31:20.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.532+0000 7f9acfe00640 1 -- 172.21.15.106:0/1851996388 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2914473208 0 0) 0x7f9ac0001470 con 0x7f9ad01401b0 2024-08-17T02:31:20.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.532+0000 7f9acfe00640 1 -- 172.21.15.106:0/1851996388 >> v1:172.21.15.106:6789/0 conn(0x7f9ad01401b0 legacy=0x7f9ad00b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:20.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.532+0000 7f9acfe00640 1 --2- 172.21.15.106:0/1851996388 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ab40039d0 0x7f9ab4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:20.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.532+0000 7f9acfe00640 1 --2- 172.21.15.106:0/1851996388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ab4004780 0x7f9ab4004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:20.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.532+0000 7f9acfe00640 1 --2- 172.21.15.106:0/1851996388 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ab4005130 0x7f9ab400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:20.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.532+0000 7f9acfe00640 1 -- 172.21.15.106:0/1851996388 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad00cb450 con 0x7f9ab4004780 2024-08-17T02:31:20.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.532+0000 7f9acfe00640 1 -- 172.21.15.106:0/1851996388 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab400c040 con 0x7f9ab40039d0 2024-08-17T02:31:20.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.532+0000 7f9acfe00640 1 -- 172.21.15.106:0/1851996388 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab400c200 con 0x7f9ab4005130 2024-08-17T02:31:20.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.532+0000 7f9ac7e00640 1 --2- 172.21.15.106:0/1851996388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ab4004780 0x7f9ab4004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:20.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.532+0000 7f9ad4e00640 1 --2- 172.21.15.106:0/1851996388 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ab40039d0 0x7f9ab4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:20.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.532+0000 7f9ad5800640 1 --2- 172.21.15.106:0/1851996388 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ab4005130 0x7f9ab400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:20.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.532+0000 7f9ac7e00640 1 -- 172.21.15.106:0/1851996388 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ab4005130 msgr2=0x7f9ab400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:20.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.532+0000 7f9ac7e00640 1 --2- 172.21.15.106:0/1851996388 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ab4005130 0x7f9ab400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:20.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.532+0000 7f9ac7e00640 1 -- 172.21.15.106:0/1851996388 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ab40039d0 msgr2=0x7f9ab4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:20.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.532+0000 7f9ac7e00640 1 --2- 172.21.15.106:0/1851996388 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ab40039d0 0x7f9ab4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:20.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.532+0000 7f9ac7e00640 1 -- 172.21.15.106:0/1851996388 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab40034e0 con 0x7f9ab4004780 2024-08-17T02:31:20.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.533+0000 7f9ad5800640 1 -- 172.21.15.106:0/1851996388 reap_dead start 2024-08-17T02:31:20.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.533+0000 7f9ac7e00640 1 --2- 172.21.15.106:0/1851996388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ab4004780 0x7f9ab4004bf0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8009b70 tx=0x7f9ab80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e39c159b2a304b69 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:20.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.534+0000 7f9acfe00640 1 -- 172.21.15.106:0/1851996388 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8031400 con 0x7f9ab4004780 2024-08-17T02:31:20.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.534+0000 7f9acfe00640 1 -- 172.21.15.106:0/1851996388 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab802d050 con 0x7f9ab4004780 2024-08-17T02:31:20.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.534+0000 7f9acfe00640 1 -- 172.21.15.106:0/1851996388 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8031790 con 0x7f9ab4004780 2024-08-17T02:31:20.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.534+0000 7f9ad7800640 1 -- 172.21.15.106:0/1851996388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ab4004780 msgr2=0x7f9ab4004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:20.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.534+0000 7f9ad7800640 1 --2- 172.21.15.106:0/1851996388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ab4004780 0x7f9ab4004bf0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8009b70 tx=0x7f9ab80090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:20.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.534+0000 7f9ad7800640 1 -- 172.21.15.106:0/1851996388 shutdown_connections 2024-08-17T02:31:20.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.534+0000 7f9ad7800640 1 --2- 172.21.15.106:0/1851996388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ab4004780 0x7f9ab4004bf0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:20.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.534+0000 7f9ad7800640 1 -- 172.21.15.106:0/1851996388 >> 172.21.15.106:0/1851996388 conn(0x7f9ad00cb9b0 msgr2=0x7f9ad00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:20.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.534+0000 7f9ad7800640 1 -- 172.21.15.106:0/1851996388 shutdown_connections 2024-08-17T02:31:20.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.534+0000 7f9ad7800640 1 -- 172.21.15.106:0/1851996388 wait complete. 2024-08-17T02:31:20.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.536+0000 7f9ad7800640 1 Processor -- start 2024-08-17T02:31:20.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.536+0000 7f9ad7800640 1 -- start start 2024-08-17T02:31:20.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.537+0000 7f9ad7800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ab4004780 0x7f9ad013e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:20.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.537+0000 7f9ad7800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ad0169c00 0x7f9ad00aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:20.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.537+0000 7f9ad7800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ad00c7940 0x7f9ad00c5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:20.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.537+0000 7f9ad7800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad013eca0 con 0x7f9ab4004780 2024-08-17T02:31:20.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.537+0000 7f9ad7800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad00c8620 con 0x7f9ad00c7940 2024-08-17T02:31:20.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.537+0000 7f9ad7800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad00c8340 con 0x7f9ad0169c00 2024-08-17T02:31:20.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.537+0000 7f9ad4e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ab4004780 0x7f9ad013e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:20.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.537+0000 7f9ad4e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ab4004780 0x7f9ad013e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:37400/0 (socket says 172.21.15.106:37400) 2024-08-17T02:31:20.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.537+0000 7f9ad4e00640 1 -- 172.21.15.106:0/412234844 learned_addr learned my addr 172.21.15.106:0/412234844 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:20.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.537+0000 7f9ac7e00640 1 --2- 172.21.15.106:0/412234844 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ad0169c00 0x7f9ad00aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:20.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.537+0000 7f9ad5800640 1 --2- 172.21.15.106:0/412234844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ad00c7940 0x7f9ad00c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:20.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.537+0000 7f9ad4e00640 1 -- 172.21.15.106:0/412234844 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ad0169c00 msgr2=0x7f9ad00aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:20.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.537+0000 7f9ad4e00640 1 --2- 172.21.15.106:0/412234844 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ad0169c00 0x7f9ad00aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:20.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.537+0000 7f9ad4e00640 1 -- 172.21.15.106:0/412234844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ad00c7940 msgr2=0x7f9ad00c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:20.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.537+0000 7f9ad4e00640 1 --2- 172.21.15.106:0/412234844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ad00c7940 0x7f9ad00c5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:20.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.537+0000 7f9ad4e00640 1 -- 172.21.15.106:0/412234844 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad00ab1a0 con 0x7f9ab4004780 2024-08-17T02:31:20.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.538+0000 7f9ad4e00640 1 --2- 172.21.15.106:0/412234844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ab4004780 0x7f9ad013e760 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9ac00015a0 tx=0x7f9ac0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:20.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.538+0000 7f9accc00640 1 -- 172.21.15.106:0/412234844 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac0018030 con 0x7f9ab4004780 2024-08-17T02:31:20.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.538+0000 7f9accc00640 1 -- 172.21.15.106:0/412234844 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac000f9c0 con 0x7f9ab4004780 2024-08-17T02:31:20.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.538+0000 7f9accc00640 1 -- 172.21.15.106:0/412234844 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac000fd60 con 0x7f9ab4004780 2024-08-17T02:31:20.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.538+0000 7f9ad7800640 1 -- 172.21.15.106:0/412234844 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad00ab480 con 0x7f9ab4004780 2024-08-17T02:31:20.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.538+0000 7f9ad7800640 1 -- 172.21.15.106:0/412234844 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad00af060 con 0x7f9ab4004780 2024-08-17T02:31:20.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.539+0000 7f9ad7800640 1 -- 172.21.15.106:0/412234844 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad006e5b0 con 0x7f9ab4004780 2024-08-17T02:31:20.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.540+0000 7f9accc00640 1 -- 172.21.15.106:0/412234844 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9ac001b070 con 0x7f9ab4004780 2024-08-17T02:31:20.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.541+0000 7f9accc00640 1 --2- 172.21.15.106:0/412234844 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9aac065180 0x7f9aac067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:20.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.541+0000 7f9accc00640 1 -- 172.21.15.106:0/412234844 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f9ac0019070 con 0x7f9ab4004780 2024-08-17T02:31:20.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.541+0000 7f9ac7e00640 1 --2- 172.21.15.106:0/412234844 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9aac065180 0x7f9aac067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:20.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.542+0000 7f9ac7e00640 1 --2- 172.21.15.106:0/412234844 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9aac065180 0x7f9aac067630 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8034000 tx=0x7f9ab8035000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:20.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.545+0000 7f9accc00640 1 -- 172.21.15.106:0/412234844 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9ad006e5b0 con 0x7f9ab4004780 2024-08-17T02:31:20.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.714+0000 7f9ad7800640 1 -- 172.21.15.106:0/412234844 --> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ad0064db0 con 0x7f9aac065180 2024-08-17T02:31:20.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.716+0000 7f9accc00640 1 -- 172.21.15.106:0/412234844 <== mgr.4107 v2:172.21.15.106:6832/36860 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50529 (secure 0 0 0) 0x7f9ad0064db0 con 0x7f9aac065180 2024-08-17T02:31:20.717 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:31:20.718 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-08-17T02:31:20.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.719+0000 7f9ad7800640 1 -- 172.21.15.106:0/412234844 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9aac065180 msgr2=0x7f9aac067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:20.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.719+0000 7f9ad7800640 1 --2- 172.21.15.106:0/412234844 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9aac065180 0x7f9aac067630 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8034000 tx=0x7f9ab8035000 comp rx=0 tx=0).stop 2024-08-17T02:31:20.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.719+0000 7f9ad7800640 1 -- 172.21.15.106:0/412234844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ab4004780 msgr2=0x7f9ad013e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:20.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.719+0000 7f9ad7800640 1 --2- 172.21.15.106:0/412234844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ab4004780 0x7f9ad013e760 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9ac00015a0 tx=0x7f9ac0001e50 comp rx=0 tx=0).stop 2024-08-17T02:31:20.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.719+0000 7f9ad7800640 1 -- 172.21.15.106:0/412234844 shutdown_connections 2024-08-17T02:31:20.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.719+0000 7f9ad7800640 1 --2- 172.21.15.106:0/412234844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ad00c7940 0x7f9ad00c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:20.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.719+0000 7f9ad7800640 1 --2- 172.21.15.106:0/412234844 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9ad0169c00 0x7f9ad00aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:20.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.719+0000 7f9ad7800640 1 --2- 172.21.15.106:0/412234844 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f9aac065180 0x7f9aac067630 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:20.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.719+0000 7f9ad7800640 1 --2- 172.21.15.106:0/412234844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ab4004780 0x7f9ad013e760 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:20.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.719+0000 7f9ad7800640 1 -- 172.21.15.106:0/412234844 >> 172.21.15.106:0/412234844 conn(0x7f9ad00cb9b0 msgr2=0x7f9ad006d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:20.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.719+0000 7f9ad7800640 1 -- 172.21.15.106:0/412234844 shutdown_connections 2024-08-17T02:31:20.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:20.719+0000 7f9ad7800640 1 -- 172.21.15.106:0/412234844 wait complete. 2024-08-17T02:31:20.735 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-08-17T02:31:19.926352+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2388200,"kb_used_data":5160,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586520,"statfs":{"total":773094113280,"available":770648596480,"internally_reserved":0,"allocated":5283840,"data_stored":2894536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001469"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":183,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:31:09.705640+0000","last_change":"2024-08-17T02:27:39.552321+0000","last_active":"2024-08-17T02:31:09.705640+0000","last_peered":"2024-08-17T02:31:09.705640+0000","last_clean":"2024-08-17T02:31:09.705640+0000","last_became_active":"2024-08-17T02:27:39.551203+0000","last_became_peered":"2024-08-17T02:27:39.551203+0000","last_unstale":"2024-08-17T02:31:09.705640+0000","last_undegraded":"2024-08-17T02:31:09.705640+0000","last_fullsized":"2024-08-17T02:31:09.705640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:27:38.155679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:27:38.155679+0000","last_clean_scrub_stamp":"2024-08-17T02:27:38.155679+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:02.785032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1105920,"data_stored":804593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.71399999999999997,"15min":0.69399999999999995},"min":{"1min":0.55500000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93000000000000005,"5min":1.03,"15min":1.03},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.72299999999999998,"15min":0.70699999999999996},"min":{"1min":0.57099999999999995,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.877,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.77600000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69599999999999995,"15min":0.68799999999999994},"min":{"1min":0.53200000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89200000000000002,"5min":1.536,"15min":1.536},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.85499999999999998,"15min":0.91800000000000004},"min":{"1min":0.56399999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.878,"5min":6.819,"15min":6.819},"last":0.73699999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.67600000000000005,"15min":0.66300000000000003},"min":{"1min":0.52900000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71199999999999997,"15min":0.70599999999999996},"min":{"1min":0.58799999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91500000000000004,"5min":1.081,"15min":1.081},"last":0.81499999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.69599999999999995,"15min":0.68899999999999995},"min":{"1min":0.625,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.86299999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70499999999999996,"15min":0.69899999999999995},"min":{"1min":0.48899999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.59599999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.622,"15min":0.63800000000000001},"min":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91200000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.65000000000000002,"15min":0.66200000000000003},"min":{"1min":0.48999999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93100000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.53100000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.65700000000000003,"15min":0.67300000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.69799999999999995,"15min":0.72599999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.875,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.55700000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.77200000000000002,"15min":0.79400000000000004},"min":{"1min":0.52400000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96399999999999997,"5min":1.095,"15min":1.095},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.745,"15min":0.76800000000000002},"min":{"1min":0.54900000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89300000000000002,"5min":1.002,"15min":1.002},"last":0.57399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67600000000000005,"15min":0.67300000000000004},"min":{"1min":0.52000000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.94899999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66900000000000004,"15min":0.67700000000000005},"min":{"1min":0.439,"5min":0.435,"15min":0.435},"max":{"1min":0.81699999999999995,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.65800000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64300000000000002,"15min":0.63800000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83099999999999996,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71099999999999997,"15min":0.71599999999999997},"min":{"1min":0.54700000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.92000000000000004,"5min":1.032,"15min":1.032},"last":0.86499999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.57699999999999996,"5min":0.432,"15min":0.432},"max":{"1min":0.90900000000000003,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76400000000000001,"15min":0.78000000000000003},"min":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.88700000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.80100000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.55900000000000005,"5min":0.502,"15min":0.502},"max":{"1min":0.85499999999999998,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.754,"15min":0.76200000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.86799999999999999,"5min":1.123,"15min":1.123},"last":0.89500000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.65300000000000002,"15min":0.69099999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.67700000000000005,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.755},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.64900000000000002,"15min":0.67700000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.79400000000000004,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.77600000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.65900000000000003,"15min":0.68700000000000006},"min":{"1min":0.45900000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.81100000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.72999999999999998,"15min":0.76800000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91200000000000003,"5min":1.075,"15min":1.075},"last":0.92600000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.71599999999999997,"15min":0.74299999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84899999999999998,"5min":1.157,"15min":1.157},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.78300000000000003,"15min":0.80500000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.89700000000000002,"5min":1.038,"15min":1.038},"last":1.014}]}]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84299999999999997,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.67400000000000004,"15min":0.65600000000000003},"min":{"1min":0.41999999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85599999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.71599999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.67700000000000005,"15min":0.68500000000000005},"min":{"1min":0.48699999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.871,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.68600000000000005,"15min":0.67000000000000004},"min":{"1min":0.52800000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88400000000000001,"5min":1.327,"15min":1.327},"last":0.58999999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.65200000000000002,"15min":0.63300000000000001},"min":{"1min":0.502,"5min":0.433,"15min":0.433},"max":{"1min":0.89100000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86199999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.83199999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69699999999999995,"15min":0.70399999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.84299999999999997,"5min":1.048,"15min":1.048},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69099999999999995,"15min":0.67700000000000005},"min":{"1min":0.432,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84199999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.61199999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.59299999999999997,"15min":0.625},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.63,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.61099999999999999,"15min":0.629},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.61399999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.77500000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.63400000000000001,"15min":0.66200000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82799999999999996,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.75},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.72199999999999998,"15min":0.746},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.85599999999999998,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.73599999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.68400000000000005,"15min":0.69599999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.81999999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.70899999999999996,"15min":0.72999999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.80800000000000005,"5min":1.046,"15min":1.046},"last":0.85599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.63,"15min":0.60699999999999998},"min":{"1min":0.53800000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.628,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.88,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.47599999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.66800000000000004,"15min":0.64500000000000002},"min":{"1min":0.55500000000000005,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89300000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.65600000000000003,"15min":0.64200000000000002},"min":{"1min":0.49099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.65600000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.67800000000000005,"15min":0.65300000000000002},"min":{"1min":0.63,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.96099999999999997,"5min":1.034,"15min":1.034},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.71999999999999997,"15min":0.71099999999999997},"min":{"1min":0.63700000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.66700000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.69899999999999995,"15min":0.68300000000000005},"min":{"1min":0.65900000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85599999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.73299999999999998,"15min":0.72099999999999997},"min":{"1min":0.65800000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.94099999999999995,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.60699999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.60799999999999998,"15min":0.63400000000000001},"min":{"1min":0.41399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.65100000000000002,"15min":0.67400000000000004},"min":{"1min":0.48699999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.68300000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.61799999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.69899999999999995,"15min":0.71299999999999997},"min":{"1min":0.46200000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.82999999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.72699999999999998,"15min":0.751},"min":{"1min":0.49099999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.79400000000000004,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.68300000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.71199999999999997,"15min":0.72399999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.84899999999999998,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.76300000000000001,"15min":0.79300000000000004},"min":{"1min":0.51600000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.89800000000000002,"5min":1.018,"15min":1.018},"last":0.73399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41899999999999998,"15min":0.41799999999999998},"min":{"1min":0.29699999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.58099999999999996,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46200000000000002,"15min":0.46999999999999997},"min":{"1min":0.32600000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.70899999999999996,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.435}]},{"osd":1,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.45700000000000002,"15min":0.45500000000000002},"min":{"1min":0.40699999999999997,"5min":0.307,"15min":0.307},"max":{"1min":0.60599999999999998,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.34799999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70099999999999996,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.40000000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55700000000000005,"15min":0.56100000000000005},"min":{"1min":0.40000000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75600000000000001,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.375},{"interface":"front","average":{"1min":0.621,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.79400000000000004,"5min":1.974,"15min":1.974},"last":0.47899999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.745,"15min":0.72499999999999998},"min":{"1min":0.61199999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.77200000000000002,"15min":0.76200000000000001},"min":{"1min":0.626,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2270000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.59099999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.77700000000000002,"15min":0.76500000000000001},"min":{"1min":0.55100000000000005,"5min":0.434,"15min":0.434},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.75,"15min":0.72799999999999998},"min":{"1min":0.63700000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.80800000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.77000000000000002,"15min":0.748},"min":{"1min":0.61899999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.78500000000000003,"15min":0.77100000000000002},"min":{"1min":0.58899999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.67100000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.56599999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.78400000000000003,"15min":0.76600000000000001},"min":{"1min":0.64700000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.75900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.39700000000000002,"15min":0.39000000000000001},"min":{"1min":0.30099999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.60699999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.45200000000000001,"15min":0.44900000000000001},"min":{"1min":0.28499999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.66600000000000004,"5min":1.415,"15min":1.415},"last":0.33500000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55000000000000004,"15min":0.54100000000000004},"min":{"1min":0.441,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.74399999999999999,"5min":1.456,"15min":1.456},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.44400000000000001},"min":{"1min":0.34200000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.64100000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.47499999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.50600000000000001,"15min":0.51900000000000002},"min":{"1min":0.34999999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.65600000000000003,"5min":1.95,"15min":1.95},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56200000000000006,"15min":0.57199999999999995},"min":{"1min":0.436,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.748,"5min":1.946,"15min":1.946},"last":0.45600000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72199999999999998,"15min":0.73199999999999998},"min":{"1min":0.498,"5min":0.379,"15min":0.379},"max":{"1min":0.97999999999999998,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76800000000000002,"15min":0.79000000000000004},"min":{"1min":0.55600000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88400000000000001,"5min":1.859,"15min":1.859},"last":0.624}]},{"osd":5,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.53500000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93100000000000005,"5min":1.722,"15min":1.722},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.745,"15min":0.76800000000000002},"min":{"1min":0.53100000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91400000000000003,"5min":1.889,"15min":1.889},"last":0.63400000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.76300000000000001,"15min":0.77800000000000002},"min":{"1min":0.58999999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95699999999999996,"5min":1.788,"15min":1.788},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.77400000000000002,"15min":0.78600000000000003},"min":{"1min":0.61899999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0409999999999999,"5min":1.889,"15min":1.889},"last":0.66400000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.83799999999999997,"15min":0.85599999999999998},"min":{"1min":0.68100000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0049999999999999,"5min":1.919,"15min":1.919},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.82799999999999996,"15min":0.85499999999999998},"min":{"1min":0.56599999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.98199999999999998,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.58699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.44800000000000001,"15min":0.45600000000000002},"min":{"1min":0.307,"5min":0.249,"15min":0.249},"max":{"1min":0.67900000000000005,"5min":1.284,"15min":1.284},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.47399999999999998,"15min":0.48099999999999998},"min":{"1min":0.33900000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59699999999999998,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.495}]},{"osd":2,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.45400000000000001,"15min":0.44400000000000001},"min":{"1min":0.372,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.60399999999999998,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.499,"15min":0.495},"min":{"1min":0.40500000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.67000000000000004,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.40000000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55400000000000005,"15min":0.54700000000000004},"min":{"1min":0.45100000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.752,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.432},{"interface":"front","average":{"1min":0.504,"5min":0.54900000000000004,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63500000000000001,"5min":2.617,"15min":2.617},"last":0.40999999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72099999999999997,"15min":0.70399999999999996},"min":{"1min":0.55100000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97999999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.75},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.59099999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.99399999999999999,"5min":1.056,"15min":1.056},"last":0.65700000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79700000000000004,"15min":0.80700000000000005},"min":{"1min":0.60599999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.034,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.78700000000000003,"15min":0.79700000000000004},"min":{"1min":0.56799999999999995,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0569999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.82299999999999995,"15min":0.83899999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1100000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.625},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.77500000000000002,"15min":0.77300000000000002},"min":{"1min":0.628,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.02,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.68700000000000006}]},{"osd":7,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79100000000000004,"15min":0.79600000000000004},"min":{"1min":0.627,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96499999999999997,"5min":1.218,"15min":1.218},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.84699999999999998,"15min":0.86899999999999999},"min":{"1min":0.55900000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0820000000000001,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.73199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298440,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073400,"statfs":{"total":96636764160,"available":96331161600,"internally_reserved":0,"allocated":1105920,"data_stored":804593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.32800000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52800000000000002,"15min":0.52000000000000002},"min":{"1min":0.435,"5min":0.377,"15min":0.377},"max":{"1min":0.75600000000000001,"5min":1.03,"15min":1.03},"last":0.503}]},{"osd":2,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.48599999999999999},"min":{"1min":0.36899999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.64900000000000002,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.47599999999999998,"15min":0.45900000000000002},"min":{"1min":0.39400000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70299999999999996,"5min":0.755,"15min":0.755},"last":0.38300000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.47199999999999998,"15min":0.45700000000000002},"min":{"1min":0.38200000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.71199999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.45400000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.67000000000000004,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.40200000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.754,"15min":0.75},"min":{"1min":0.60899999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.004,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.76700000000000002,"15min":0.76000000000000001},"min":{"1min":0.61699999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0409999999999999,"5min":1.24,"15min":1.24},"last":0.56499999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.74199999999999999,"15min":0.71099999999999997},"min":{"1min":0.61499999999999999,"5min":0.501,"15min":0.501},"max":{"1min":0.99199999999999999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76600000000000001,"15min":0.76800000000000002},"min":{"1min":0.59499999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95899999999999996,"5min":1.212,"15min":1.212},"last":0.67300000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.77600000000000002,"15min":0.77100000000000002},"min":{"1min":0.627,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95099999999999996,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.78200000000000003,"15min":0.77900000000000003},"min":{"1min":0.625,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0900000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.62}]},{"osd":7,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.78600000000000003,"15min":0.78400000000000003},"min":{"1min":0.64700000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0189999999999999,"5min":1.286,"15min":1.286},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78500000000000003,"15min":0.77900000000000003},"min":{"1min":0.61899999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.93899999999999995,"5min":1.234,"15min":1.234},"last":0.59199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:31:20.738 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-17T02:27:38.155679+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=27, tm_sec=38, tm_wday=5, tm_yday=230, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=31, tm_sec=15, tm_wday=5, tm_yday=230, tm_isdst=0) 2024-08-17T02:31:20.738 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-17T02:31:40.739 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:31:40.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.897+0000 7f7ea0400640 1 Processor -- start 2024-08-17T02:31:40.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.897+0000 7f7ea0400640 1 -- start start 2024-08-17T02:31:40.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.898+0000 7f7ea0400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7e98155a20 0x7f7e980adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:40.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.898+0000 7f7ea0400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e98156670 con 0x7f7e98155df0 2024-08-17T02:31:40.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.898+0000 7f7ea0400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e9806e5e0 con 0x7f7e9806df00 2024-08-17T02:31:40.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.898+0000 7f7ea0400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e980b0350 con 0x7f7e98155a20 2024-08-17T02:31:40.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.898+0000 7f7e9d000640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7e98155df0 0x7f7e9806d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59468/0 (socket says 172.21.15.106:59468) 2024-08-17T02:31:40.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.898+0000 7f7e9d000640 1 -- 172.21.15.106:0/2051327855 learned_addr learned my addr 172.21.15.106:0/2051327855 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:31:40.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.898+0000 7f7e9da00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7e98155a20 0x7f7e980adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:40.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.899+0000 7f7e97e00640 1 -- 172.21.15.106:0/2051327855 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3167828367 0 0) 0x7f7e98156670 con 0x7f7e98155df0 2024-08-17T02:31:40.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.899+0000 7f7e97e00640 1 -- 172.21.15.106:0/2051327855 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e800034e0 con 0x7f7e98155df0 2024-08-17T02:31:40.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.899+0000 7f7e9da00640 1 -- 172.21.15.106:0/2051327855 >> v1:172.21.15.171:6789/0 conn(0x7f7e9806df00 legacy=0x7f7e98156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:40.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.899+0000 7f7e9da00640 1 -- 172.21.15.106:0/2051327855 >> v1:172.21.15.106:6789/0 conn(0x7f7e98155df0 legacy=0x7f7e9806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:40.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.899+0000 7f7e9da00640 1 -- 172.21.15.106:0/2051327855 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9806e8c0 con 0x7f7e98155a20 2024-08-17T02:31:40.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.900+0000 7f7e9da00640 1 --2- 172.21.15.106:0/2051327855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e98155a20 0x7f7e980adf10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c009850 tx=0x7f7e8c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd729c65093fc4c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:40.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.900+0000 7f7e97e00640 1 -- 172.21.15.106:0/2051327855 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c02ad90 con 0x7f7e98155a20 2024-08-17T02:31:40.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.900+0000 7f7e97e00640 1 -- 172.21.15.106:0/2051327855 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c032440 con 0x7f7e98155a20 2024-08-17T02:31:40.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.900+0000 7f7e97e00640 1 -- 172.21.15.106:0/2051327855 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0327e0 con 0x7f7e98155a20 2024-08-17T02:31:40.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.901+0000 7f7ea0400640 1 -- 172.21.15.106:0/2051327855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e98155a20 msgr2=0x7f7e980adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:40.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.901+0000 7f7ea0400640 1 --2- 172.21.15.106:0/2051327855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e98155a20 0x7f7e980adf10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c009850 tx=0x7f7e8c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:40.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.901+0000 7f7ea0400640 1 -- 172.21.15.106:0/2051327855 shutdown_connections 2024-08-17T02:31:40.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.901+0000 7f7ea0400640 1 --2- 172.21.15.106:0/2051327855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e98155a20 0x7f7e980adf10 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:40.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.901+0000 7f7ea0400640 1 -- 172.21.15.106:0/2051327855 >> 172.21.15.106:0/2051327855 conn(0x7f7e980cb9b0 msgr2=0x7f7e980cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:40.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.901+0000 7f7ea0400640 1 -- 172.21.15.106:0/2051327855 shutdown_connections 2024-08-17T02:31:40.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.901+0000 7f7ea0400640 1 -- 172.21.15.106:0/2051327855 wait complete. 2024-08-17T02:31:40.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.902+0000 7f7ea0400640 1 Processor -- start 2024-08-17T02:31:40.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.902+0000 7f7ea0400640 1 -- start start 2024-08-17T02:31:40.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.903+0000 7f7ea0400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e9806df00 0x7f7e981678b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:40.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.903+0000 7f7ea0400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e98155a20 0x7f7e980ac600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:40.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.903+0000 7f7ea0400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e98155df0 0x7f7e980acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:40.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.903+0000 7f7ea0400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e98167390 con 0x7f7e9806df00 2024-08-17T02:31:40.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.903+0000 7f7ea0400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980ab810 con 0x7f7e98155a20 2024-08-17T02:31:40.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.903+0000 7f7ea0400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980aac00 con 0x7f7e98155df0 2024-08-17T02:31:40.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.903+0000 7f7e9da00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e9806df00 0x7f7e981678b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:40.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.904+0000 7f7e9da00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e9806df00 0x7f7e981678b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60096/0 (socket says 172.21.15.106:60096) 2024-08-17T02:31:40.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.904+0000 7f7e9da00640 1 -- 172.21.15.106:0/3158608223 learned_addr learned my addr 172.21.15.106:0/3158608223 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:40.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.904+0000 7f7e9da00640 1 -- 172.21.15.106:0/3158608223 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e98155df0 msgr2=0x7f7e980acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:40.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.904+0000 7f7e9da00640 1 --2- 172.21.15.106:0/3158608223 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e98155df0 0x7f7e980acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:40.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.904+0000 7f7e9d000640 1 --2- 172.21.15.106:0/3158608223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e98155a20 0x7f7e980ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:40.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.904+0000 7f7e9da00640 1 -- 172.21.15.106:0/3158608223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e98155a20 msgr2=0x7f7e980ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:40.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.904+0000 7f7e9da00640 1 --2- 172.21.15.106:0/3158608223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e98155a20 0x7f7e980ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:40.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.904+0000 7f7e9da00640 1 -- 172.21.15.106:0/3158608223 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8c009390 con 0x7f7e9806df00 2024-08-17T02:31:40.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.904+0000 7f7e9d000640 1 --2- 172.21.15.106:0/3158608223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e98155a20 0x7f7e980ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:31:40.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.904+0000 7f7e9da00640 1 --2- 172.21.15.106:0/3158608223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e9806df00 0x7f7e981678b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c009360 tx=0x7f7e8c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:40.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.904+0000 7f7e94c00640 1 -- 172.21.15.106:0/3158608223 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c000d10 con 0x7f7e9806df00 2024-08-17T02:31:40.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.905+0000 7f7e94c00640 1 -- 172.21.15.106:0/3158608223 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c031e00 con 0x7f7e9806df00 2024-08-17T02:31:40.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.905+0000 7f7ea0400640 1 -- 172.21.15.106:0/3158608223 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e980aaee0 con 0x7f7e9806df00 2024-08-17T02:31:40.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.905+0000 7f7e94c00640 1 -- 172.21.15.106:0/3158608223 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c03d650 con 0x7f7e9806df00 2024-08-17T02:31:40.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.905+0000 7f7ea0400640 1 -- 172.21.15.106:0/3158608223 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e980ab4a0 con 0x7f7e9806df00 2024-08-17T02:31:40.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.906+0000 7f7ea0400640 1 -- 172.21.15.106:0/3158608223 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e98064db0 con 0x7f7e9806df00 2024-08-17T02:31:40.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.906+0000 7f7e94c00640 1 -- 172.21.15.106:0/3158608223 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7e8c039040 con 0x7f7e9806df00 2024-08-17T02:31:40.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.907+0000 7f7e94c00640 1 --2- 172.21.15.106:0/3158608223 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7e78065150 0x7f7e78067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:40.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.907+0000 7f7e94c00640 1 -- 172.21.15.106:0/3158608223 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f7e8c0a2180 con 0x7f7e9806df00 2024-08-17T02:31:40.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.907+0000 7f7e9d000640 1 --2- 172.21.15.106:0/3158608223 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7e78065150 0x7f7e78067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:40.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.908+0000 7f7e9d000640 1 --2- 172.21.15.106:0/3158608223 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7e78065150 0x7f7e78067600 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7e84007fd0 tx=0x7f7e84009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:40.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:40.911+0000 7f7e94c00640 1 -- 172.21.15.106:0/3158608223 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7e8c070440 con 0x7f7e9806df00 2024-08-17T02:31:41.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.080+0000 7f7ea0400640 1 -- 172.21.15.106:0/3158608223 --> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7e980ab950 con 0x7f7e78065150 2024-08-17T02:31:41.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.082+0000 7f7e94c00640 1 -- 172.21.15.106:0/3158608223 <== mgr.4107 v2:172.21.15.106:6832/36860 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50627 (secure 0 0 0) 0x7f7e840013e0 con 0x7f7e78065150 2024-08-17T02:31:41.083 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:31:41.083 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-08-17T02:31:41.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.084+0000 7f7ea0400640 1 -- 172.21.15.106:0/3158608223 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7e78065150 msgr2=0x7f7e78067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:41.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.084+0000 7f7ea0400640 1 --2- 172.21.15.106:0/3158608223 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7e78065150 0x7f7e78067600 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7e84007fd0 tx=0x7f7e84009040 comp rx=0 tx=0).stop 2024-08-17T02:31:41.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.084+0000 7f7ea0400640 1 -- 172.21.15.106:0/3158608223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e9806df00 msgr2=0x7f7e981678b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:41.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.084+0000 7f7ea0400640 1 --2- 172.21.15.106:0/3158608223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e9806df00 0x7f7e981678b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c009360 tx=0x7f7e8c032000 comp rx=0 tx=0).stop 2024-08-17T02:31:41.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.084+0000 7f7ea0400640 1 -- 172.21.15.106:0/3158608223 shutdown_connections 2024-08-17T02:31:41.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.084+0000 7f7ea0400640 1 --2- 172.21.15.106:0/3158608223 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e98155df0 0x7f7e980acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:41.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.084+0000 7f7ea0400640 1 --2- 172.21.15.106:0/3158608223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e98155a20 0x7f7e980ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:41.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.084+0000 7f7ea0400640 1 --2- 172.21.15.106:0/3158608223 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f7e78065150 0x7f7e78067600 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:41.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.084+0000 7f7ea0400640 1 --2- 172.21.15.106:0/3158608223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e9806df00 0x7f7e981678b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:41.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.084+0000 7f7ea0400640 1 -- 172.21.15.106:0/3158608223 >> 172.21.15.106:0/3158608223 conn(0x7f7e980cb9b0 msgr2=0x7f7e9806c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:41.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.084+0000 7f7ea0400640 1 -- 172.21.15.106:0/3158608223 shutdown_connections 2024-08-17T02:31:41.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.084+0000 7f7ea0400640 1 -- 172.21.15.106:0/3158608223 wait complete. 2024-08-17T02:31:41.100 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-08-17T02:31:39.930564+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2388184,"kb_used_data":5160,"kb_used_omap":13,"kb_used_meta":2382898,"kb_avail":752586536,"statfs":{"total":773094113280,"available":770648612864,"internally_reserved":0,"allocated":5283840,"data_stored":2894536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2440088256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002557"},"pg_stats":[{"pgid":"1.0","version":"43'119","reported_seq":196,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-17T02:31:21.945672+0000","last_change":"2024-08-17T02:31:21.945640+0000","last_active":"2024-08-17T02:31:21.945672+0000","last_peered":"2024-08-17T02:31:21.945672+0000","last_clean":"2024-08-17T02:31:21.945672+0000","last_became_active":"2024-08-17T02:27:39.551203+0000","last_became_peered":"2024-08-17T02:27:39.551203+0000","last_unstale":"2024-08-17T02:31:21.945672+0000","last_undegraded":"2024-08-17T02:31:21.945672+0000","last_fullsized":"2024-08-17T02:31:21.945672+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'119","last_scrub_stamp":"2024-08-17T02:31:21.945541+0000","last_deep_scrub":"43'119","last_deep_scrub_stamp":"2024-08-17T02:31:21.945541+0000","last_clean_scrub_stamp":"2024-08-17T02:31:21.945541+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:37:25.056364+0000","scrub_duration":0.0056087200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302592,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069248,"statfs":{"total":96636764160,"available":96326909952,"internally_reserved":0,"allocated":1105920,"data_stored":804593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.71399999999999997,"15min":0.69399999999999995},"min":{"1min":0.55500000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93000000000000005,"5min":1.03,"15min":1.03},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.72299999999999998,"15min":0.70699999999999996},"min":{"1min":0.57099999999999995,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.877,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.97299999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69599999999999995,"15min":0.68799999999999994},"min":{"1min":0.53200000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89200000000000002,"5min":1.536,"15min":1.536},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.85499999999999998,"15min":0.91800000000000004},"min":{"1min":0.56399999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.878,"5min":6.819,"15min":6.819},"last":0.94299999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.67600000000000005,"15min":0.66300000000000003},"min":{"1min":0.52900000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.71199999999999997,"15min":0.70599999999999996},"min":{"1min":0.58799999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91500000000000004,"5min":1.081,"15min":1.081},"last":0.92700000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.69599999999999995,"15min":0.68899999999999995},"min":{"1min":0.625,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.86299999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70499999999999996,"15min":0.69899999999999995},"min":{"1min":0.48899999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.86299999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.622,"15min":0.63800000000000001},"min":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91200000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.65000000000000002,"15min":0.66200000000000003},"min":{"1min":0.48999999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93100000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.71399999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.65700000000000003,"15min":0.67300000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.69799999999999995,"15min":0.72599999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.875,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.90200000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.77200000000000002,"15min":0.79400000000000004},"min":{"1min":0.52400000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96399999999999997,"5min":1.095,"15min":1.095},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.745,"15min":0.76800000000000002},"min":{"1min":0.54900000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89300000000000002,"5min":1.002,"15min":1.002},"last":0.84199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67600000000000005,"15min":0.67300000000000004},"min":{"1min":0.52000000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.94899999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66900000000000004,"15min":0.67700000000000005},"min":{"1min":0.439,"5min":0.435,"15min":0.435},"max":{"1min":0.81699999999999995,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.80600000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64300000000000002,"15min":0.63800000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83099999999999996,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71099999999999997,"15min":0.71599999999999997},"min":{"1min":0.54700000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.92000000000000004,"5min":1.032,"15min":1.032},"last":0.89600000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.57699999999999996,"5min":0.432,"15min":0.432},"max":{"1min":0.90900000000000003,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76400000000000001,"15min":0.78000000000000003},"min":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.88700000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.82699999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71899999999999997,"15min":0.71999999999999997},"min":{"1min":0.55900000000000005,"5min":0.502,"15min":0.502},"max":{"1min":0.85499999999999998,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.754,"15min":0.76200000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.86799999999999999,"5min":1.123,"15min":1.123},"last":1.048}]},{"osd":4,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.65300000000000002,"15min":0.69099999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.67700000000000005,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.64900000000000002,"15min":0.67700000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.79400000000000004,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.68799999999999994}]},{"osd":5,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.65900000000000003,"15min":0.68700000000000006},"min":{"1min":0.45900000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.81100000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.72999999999999998,"15min":0.76800000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91200000000000003,"5min":1.075,"15min":1.075},"last":0.92500000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.71599999999999997,"15min":0.74299999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84899999999999998,"5min":1.157,"15min":1.157},"last":0.876},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.78300000000000003,"15min":0.80500000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.89700000000000002,"5min":1.038,"15min":1.038},"last":0.90900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.39000000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84299999999999997,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.67400000000000004,"15min":0.65600000000000003},"min":{"1min":0.41999999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85599999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.78500000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.67700000000000005,"15min":0.68500000000000005},"min":{"1min":0.48699999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.871,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.68600000000000005,"15min":0.67000000000000004},"min":{"1min":0.52800000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88400000000000001,"5min":1.327,"15min":1.327},"last":0.77800000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.65200000000000002,"15min":0.63300000000000001},"min":{"1min":0.502,"5min":0.433,"15min":0.433},"max":{"1min":0.89100000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86199999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.66200000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69699999999999995,"15min":0.70399999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.84299999999999997,"5min":1.048,"15min":1.048},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69099999999999995,"15min":0.67700000000000005},"min":{"1min":0.432,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84199999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.72399999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.59299999999999997,"15min":0.625},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.63,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.61099999999999999,"15min":0.629},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.61399999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52100000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.63400000000000001,"15min":0.66200000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82799999999999996,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.72199999999999998,"15min":0.746},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.85599999999999998,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.74399999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:30:46 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.68400000000000005,"15min":0.69599999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.81999999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.70899999999999996,"15min":0.72999999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.80800000000000005,"5min":1.046,"15min":1.046},"last":0.80900000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.63,"15min":0.60699999999999998},"min":{"1min":0.53800000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.68400000000000005,"15min":0.66000000000000003},"min":{"1min":0.628,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.88,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.75700000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.66800000000000004,"15min":0.64500000000000002},"min":{"1min":0.55500000000000005,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89300000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.65600000000000003,"15min":0.64200000000000002},"min":{"1min":0.49099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.83899999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.67800000000000005,"15min":0.65300000000000002},"min":{"1min":0.63,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.96099999999999997,"5min":1.034,"15min":1.034},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.71999999999999997,"15min":0.71099999999999997},"min":{"1min":0.63700000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.78900000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.69899999999999995,"15min":0.68300000000000005},"min":{"1min":0.65900000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.85599999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.73299999999999998,"15min":0.72099999999999997},"min":{"1min":0.65800000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.94099999999999995,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.86899999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.60799999999999998,"15min":0.63400000000000001},"min":{"1min":0.41399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.65100000000000002,"15min":0.67400000000000004},"min":{"1min":0.48699999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.68300000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.58999999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.69899999999999995,"15min":0.71299999999999997},"min":{"1min":0.46200000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.82999999999999996,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.72699999999999998,"15min":0.751},"min":{"1min":0.49099999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.79400000000000004,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.77400000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:30:44 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.71199999999999997,"15min":0.72399999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.84899999999999998,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.76300000000000001,"15min":0.79300000000000004},"min":{"1min":0.51600000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.89800000000000002,"5min":1.018,"15min":1.018},"last":0.73699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41899999999999998,"15min":0.41799999999999998},"min":{"1min":0.29699999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.58099999999999996,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46200000000000002,"15min":0.46999999999999997},"min":{"1min":0.32600000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.70899999999999996,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.443}]},{"osd":1,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.45700000000000002,"15min":0.45500000000000002},"min":{"1min":0.40699999999999997,"5min":0.307,"15min":0.307},"max":{"1min":0.60599999999999998,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.376},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.34799999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70099999999999996,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.48999999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55700000000000005,"15min":0.56100000000000005},"min":{"1min":0.40000000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75600000000000001,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.79400000000000004,"5min":1.974,"15min":1.974},"last":0.60299999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.745,"15min":0.72499999999999998},"min":{"1min":0.61199999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.77200000000000002,"15min":0.76200000000000001},"min":{"1min":0.626,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2270000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.69499999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.77700000000000002,"15min":0.76500000000000001},"min":{"1min":0.55100000000000005,"5min":0.434,"15min":0.434},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.75,"15min":0.72799999999999998},"min":{"1min":0.63700000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.74099999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.77000000000000002,"15min":0.748},"min":{"1min":0.61899999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.78500000000000003,"15min":0.77100000000000002},"min":{"1min":0.58899999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.85099999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:30:48 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.56599999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.78400000000000003,"15min":0.76600000000000001},"min":{"1min":0.64700000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.72799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.39700000000000002,"15min":0.39000000000000001},"min":{"1min":0.30099999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.60699999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.45200000000000001,"15min":0.44900000000000001},"min":{"1min":0.28499999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.66600000000000004,"5min":1.415,"15min":1.415},"last":0.60599999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55000000000000004,"15min":0.54100000000000004},"min":{"1min":0.441,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.74399999999999999,"5min":1.456,"15min":1.456},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.44400000000000001},"min":{"1min":0.34200000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.64100000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.48099999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.50600000000000001,"15min":0.51900000000000002},"min":{"1min":0.34999999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.65600000000000003,"5min":1.95,"15min":1.95},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56200000000000006,"15min":0.57199999999999995},"min":{"1min":0.436,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.748,"5min":1.946,"15min":1.946},"last":0.44400000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.72199999999999998,"15min":0.73199999999999998},"min":{"1min":0.498,"5min":0.379,"15min":0.379},"max":{"1min":0.97999999999999998,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76800000000000002,"15min":0.79000000000000004},"min":{"1min":0.55600000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.88400000000000001,"5min":1.859,"15min":1.859},"last":0.76200000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.53500000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93100000000000005,"5min":1.722,"15min":1.722},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.745,"15min":0.76800000000000002},"min":{"1min":0.53100000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91400000000000003,"5min":1.889,"15min":1.889},"last":0.73999999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.76300000000000001,"15min":0.77800000000000002},"min":{"1min":0.58999999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95699999999999996,"5min":1.788,"15min":1.788},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.77400000000000002,"15min":0.78600000000000003},"min":{"1min":0.61899999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0409999999999999,"5min":1.889,"15min":1.889},"last":0.80600000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:30:42 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.83799999999999997,"15min":0.85599999999999998},"min":{"1min":0.68100000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0049999999999999,"5min":1.919,"15min":1.919},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.82799999999999996,"15min":0.85499999999999998},"min":{"1min":0.56599999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.98199999999999998,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.752}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.44800000000000001,"15min":0.45600000000000002},"min":{"1min":0.307,"5min":0.249,"15min":0.249},"max":{"1min":0.67900000000000005,"5min":1.284,"15min":1.284},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.47399999999999998,"15min":0.48099999999999998},"min":{"1min":0.33900000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59699999999999998,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.48899999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.45400000000000001,"15min":0.44400000000000001},"min":{"1min":0.372,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.60399999999999998,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.499,"15min":0.495},"min":{"1min":0.40500000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.67000000000000004,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.51900000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55400000000000005,"15min":0.54700000000000004},"min":{"1min":0.45100000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.752,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.54900000000000004,"15min":0.56699999999999995},"min":{"1min":0.36299999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63500000000000001,"5min":2.617,"15min":2.617},"last":0.54100000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72099999999999997,"15min":0.70399999999999996},"min":{"1min":0.55100000000000005,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97999999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.59099999999999997,"5min":0.504,"15min":0.504},"max":{"1min":0.99399999999999999,"5min":1.056,"15min":1.056},"last":0.75600000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79700000000000004,"15min":0.80700000000000005},"min":{"1min":0.60599999999999998,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.034,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.748},{"interface":"front","average":{"1min":0.751,"5min":0.78700000000000003,"15min":0.79700000000000004},"min":{"1min":0.56799999999999995,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0569999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.77000000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.82299999999999995,"15min":0.83899999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1100000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.77500000000000002,"15min":0.77300000000000002},"min":{"1min":0.628,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.02,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.73099999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79100000000000004,"15min":0.79600000000000004},"min":{"1min":0.627,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.96499999999999997,"5min":1.218,"15min":1.218},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.84699999999999998,"15min":0.86899999999999999},"min":{"1min":0.55900000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0820000000000001,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.78600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298432,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073408,"statfs":{"total":96636764160,"available":96331169792,"internally_reserved":0,"allocated":1105920,"data_stored":804593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46600000000000003,"15min":0.46200000000000002},"min":{"1min":0.32800000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52800000000000002,"15min":0.52000000000000002},"min":{"1min":0.435,"5min":0.377,"15min":0.377},"max":{"1min":0.75600000000000001,"5min":1.03,"15min":1.03},"last":0.52500000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.48599999999999999},"min":{"1min":0.36899999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.64900000000000002,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.47599999999999998,"15min":0.45900000000000002},"min":{"1min":0.39400000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70299999999999996,"5min":0.755,"15min":0.755},"last":0.46500000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.47199999999999998,"15min":0.45700000000000002},"min":{"1min":0.38200000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.71199999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.45400000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.67000000000000004,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.57699999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.754,"15min":0.75},"min":{"1min":0.60899999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.004,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.76700000000000002,"15min":0.76000000000000001},"min":{"1min":0.61699999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0409999999999999,"5min":1.24,"15min":1.24},"last":0.68400000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.74199999999999999,"15min":0.71099999999999997},"min":{"1min":0.61499999999999999,"5min":0.501,"15min":0.501},"max":{"1min":0.99199999999999999,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.76600000000000001,"15min":0.76800000000000002},"min":{"1min":0.59499999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.95899999999999996,"5min":1.212,"15min":1.212},"last":0.624}]},{"osd":6,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.77600000000000002,"15min":0.77100000000000002},"min":{"1min":0.627,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95099999999999996,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.78200000000000003,"15min":0.77900000000000003},"min":{"1min":0.625,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0900000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.70699999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:30:40 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.78600000000000003,"15min":0.78400000000000003},"min":{"1min":0.64700000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0189999999999999,"5min":1.286,"15min":1.286},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78500000000000003,"15min":0.77900000000000003},"min":{"1min":0.61899999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.93899999999999995,"5min":1.234,"15min":1.234},"last":0.72999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:31:41.102 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-17T02:31:41.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.244+0000 7fad9e400640 1 Processor -- start 2024-08-17T02:31:41.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.244+0000 7fad9e400640 1 -- start start 2024-08-17T02:31:41.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.245+0000 7fad9e400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad980c7db0 0x7fad980c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:41.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.245+0000 7fad9e400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad981598f0 con 0x7fad98155e50 2024-08-17T02:31:41.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.245+0000 7fad9e400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad98159bd0 con 0x7fad98155a80 2024-08-17T02:31:41.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.245+0000 7fad9e400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad98159eb0 con 0x7fad980c7db0 2024-08-17T02:31:41.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.245+0000 7fad97e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fad98155e50 0x7fad980aea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59484/0 (socket says 172.21.15.106:59484) 2024-08-17T02:31:41.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.245+0000 7fad97e00640 1 -- 172.21.15.106:0/2627540103 learned_addr learned my addr 172.21.15.106:0/2627540103 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:31:41.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.245+0000 7fad8ea00640 1 --2- 172.21.15.106:0/2627540103 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad980c7db0 0x7fad980c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:41.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.246+0000 7fad96a00640 1 -- 172.21.15.106:0/2627540103 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3684505639 0 0) 0x7fad981598f0 con 0x7fad98155e50 2024-08-17T02:31:41.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.246+0000 7fad96a00640 1 -- 172.21.15.106:0/2627540103 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad7c0034e0 con 0x7fad98155e50 2024-08-17T02:31:41.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.246+0000 7fad96a00640 1 -- 172.21.15.106:0/2627540103 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1066938318 0 0) 0x7fad98159bd0 con 0x7fad98155a80 2024-08-17T02:31:41.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.246+0000 7fad96a00640 1 -- 172.21.15.106:0/2627540103 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad981598f0 con 0x7fad98155a80 2024-08-17T02:31:41.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.246+0000 7fad8ea00640 1 -- 172.21.15.106:0/2627540103 >> v1:172.21.15.171:6789/0 conn(0x7fad98155a80 legacy=0x7fad9806dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:41.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.246+0000 7fad8ea00640 1 -- 172.21.15.106:0/2627540103 >> v1:172.21.15.106:6789/0 conn(0x7fad98155e50 legacy=0x7fad980aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:41.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.246+0000 7fad8ea00640 1 -- 172.21.15.106:0/2627540103 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9815a190 con 0x7fad980c7db0 2024-08-17T02:31:41.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.247+0000 7fad8ea00640 1 --2- 172.21.15.106:0/2627540103 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad980c7db0 0x7fad980c8bd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fad80009880 tx=0x7fad800090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18f9b45d7f7a56cc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:41.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.247+0000 7fad96a00640 1 -- 172.21.15.106:0/2627540103 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8002ae10 con 0x7fad980c7db0 2024-08-17T02:31:41.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.248+0000 7fad96a00640 1 -- 172.21.15.106:0/2627540103 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad80032440 con 0x7fad980c7db0 2024-08-17T02:31:41.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.248+0000 7fad96a00640 1 -- 172.21.15.106:0/2627540103 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad800327e0 con 0x7fad980c7db0 2024-08-17T02:31:41.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.248+0000 7fad9e400640 1 -- 172.21.15.106:0/2627540103 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad980c7db0 msgr2=0x7fad980c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:41.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.248+0000 7fad9e400640 1 --2- 172.21.15.106:0/2627540103 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad980c7db0 0x7fad980c8bd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fad80009880 tx=0x7fad800090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:41.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.248+0000 7fad9e400640 1 -- 172.21.15.106:0/2627540103 shutdown_connections 2024-08-17T02:31:41.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.248+0000 7fad9e400640 1 --2- 172.21.15.106:0/2627540103 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad980c7db0 0x7fad980c8bd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:41.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.248+0000 7fad9e400640 1 -- 172.21.15.106:0/2627540103 >> 172.21.15.106:0/2627540103 conn(0x7fad98067750 msgr2=0x7fad980c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:41.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.248+0000 7fad9e400640 1 -- 172.21.15.106:0/2627540103 shutdown_connections 2024-08-17T02:31:41.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.248+0000 7fad9e400640 1 -- 172.21.15.106:0/2627540103 wait complete. 2024-08-17T02:31:41.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.250+0000 7fad9e400640 1 Processor -- start 2024-08-17T02:31:41.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.250+0000 7fad9e400640 1 -- start start 2024-08-17T02:31:41.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.250+0000 7fad9e400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad980c7db0 0x7fad981490a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:41.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.250+0000 7fad9e400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad98155a80 0x7fad9814fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:41.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.251+0000 7fad9e400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad98155e50 0x7fad98150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:41.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.251+0000 7fad9e400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9816c660 con 0x7fad980c7db0 2024-08-17T02:31:41.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.251+0000 7fad9e400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9816c940 con 0x7fad98155e50 2024-08-17T02:31:41.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.251+0000 7fad9e400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9816cc20 con 0x7fad98155a80 2024-08-17T02:31:41.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.251+0000 7fad97400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad980c7db0 0x7fad981490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:41.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.251+0000 7fad97400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad980c7db0 0x7fad981490a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60104/0 (socket says 172.21.15.106:60104) 2024-08-17T02:31:41.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.251+0000 7fad97400640 1 -- 172.21.15.106:0/3864315429 learned_addr learned my addr 172.21.15.106:0/3864315429 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:41.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.251+0000 7fad97e00640 1 --2- 172.21.15.106:0/3864315429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad98155e50 0x7fad98150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:41.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.251+0000 7fad8ea00640 1 --2- 172.21.15.106:0/3864315429 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad98155a80 0x7fad9814fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:41.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.251+0000 7fad97400640 1 -- 172.21.15.106:0/3864315429 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad98155a80 msgr2=0x7fad9814fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:41.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.251+0000 7fad97400640 1 --2- 172.21.15.106:0/3864315429 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad98155a80 0x7fad9814fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:41.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.251+0000 7fad97400640 1 -- 172.21.15.106:0/3864315429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad98155e50 msgr2=0x7fad98150180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:41.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.251+0000 7fad97400640 1 --2- 172.21.15.106:0/3864315429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad98155e50 0x7fad98150180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:41.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.251+0000 7fad97400640 1 -- 172.21.15.106:0/3864315429 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad80009390 con 0x7fad980c7db0 2024-08-17T02:31:41.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.251+0000 7fad8ea00640 1 --2- 172.21.15.106:0/3864315429 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad98155a80 0x7fad9814fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:31:41.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.251+0000 7fad97e00640 1 --2- 172.21.15.106:0/3864315429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad98155e50 0x7fad98150180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:31:41.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.252+0000 7fad97400640 1 --2- 172.21.15.106:0/3864315429 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad980c7db0 0x7fad981490a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fad8800c590 tx=0x7fad88007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:41.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.252+0000 7fad8f400640 1 -- 172.21.15.106:0/3864315429 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88012630 con 0x7fad980c7db0 2024-08-17T02:31:41.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.252+0000 7fad8f400640 1 -- 172.21.15.106:0/3864315429 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad880127b0 con 0x7fad980c7db0 2024-08-17T02:31:41.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.252+0000 7fad8f400640 1 -- 172.21.15.106:0/3864315429 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88012bb0 con 0x7fad980c7db0 2024-08-17T02:31:41.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.252+0000 7fad9e400640 1 -- 172.21.15.106:0/3864315429 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9816cf00 con 0x7fad980c7db0 2024-08-17T02:31:41.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.252+0000 7fad9e400640 1 -- 172.21.15.106:0/3864315429 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad98153e40 con 0x7fad980c7db0 2024-08-17T02:31:41.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.253+0000 7fad9e400640 1 -- 172.21.15.106:0/3864315429 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad98071050 con 0x7fad980c7db0 2024-08-17T02:31:41.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.254+0000 7fad8f400640 1 -- 172.21.15.106:0/3864315429 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fad8801a3b0 con 0x7fad980c7db0 2024-08-17T02:31:41.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.254+0000 7fad8f400640 1 --2- 172.21.15.106:0/3864315429 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fad74065150 0x7fad74067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:41.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.254+0000 7fad8f400640 1 -- 172.21.15.106:0/3864315429 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fad880821a0 con 0x7fad980c7db0 2024-08-17T02:31:41.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.255+0000 7fad8ea00640 1 --2- 172.21.15.106:0/3864315429 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fad74065150 0x7fad74067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:41.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.255+0000 7fad8ea00640 1 --2- 172.21.15.106:0/3864315429 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fad74065150 0x7fad74067600 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fad80034000 tx=0x7fad80032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:41.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.258+0000 7fad8f400640 1 -- 172.21.15.106:0/3864315429 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fad88050460 con 0x7fad980c7db0 2024-08-17T02:31:41.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.431+0000 7fad9e400640 1 -- 172.21.15.106:0/3864315429 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fad9816c7a0 con 0x7fad980c7db0 2024-08-17T02:31:41.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.435+0000 7fad8f400640 1 -- 172.21.15.106:0/3864315429 <== mon.0 v2:172.21.15.106:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fad88050460 con 0x7fad980c7db0 2024-08-17T02:31:41.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.435+0000 7fad8f400640 1 -- 172.21.15.106:0/3864315429 <== mon.0 v2:172.21.15.106:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7fad9816c7a0 con 0x7fad980c7db0 2024-08-17T02:31:41.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.438+0000 7fad9e400640 1 -- 172.21.15.106:0/3864315429 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fad74065150 msgr2=0x7fad74067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:41.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.438+0000 7fad9e400640 1 --2- 172.21.15.106:0/3864315429 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fad74065150 0x7fad74067600 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fad80034000 tx=0x7fad80032000 comp rx=0 tx=0).stop 2024-08-17T02:31:41.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.438+0000 7fad9e400640 1 -- 172.21.15.106:0/3864315429 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad980c7db0 msgr2=0x7fad981490a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:41.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.438+0000 7fad9e400640 1 --2- 172.21.15.106:0/3864315429 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad980c7db0 0x7fad981490a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fad8800c590 tx=0x7fad88007d80 comp rx=0 tx=0).stop 2024-08-17T02:31:41.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.438+0000 7fad9e400640 1 -- 172.21.15.106:0/3864315429 shutdown_connections 2024-08-17T02:31:41.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.438+0000 7fad9e400640 1 --2- 172.21.15.106:0/3864315429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fad98155e50 0x7fad98150180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:41.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.438+0000 7fad9e400640 1 --2- 172.21.15.106:0/3864315429 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fad98155a80 0x7fad9814fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:41.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.438+0000 7fad9e400640 1 --2- 172.21.15.106:0/3864315429 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7fad74065150 0x7fad74067600 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:41.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.438+0000 7fad9e400640 1 --2- 172.21.15.106:0/3864315429 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad980c7db0 0x7fad981490a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:41.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.438+0000 7fad9e400640 1 -- 172.21.15.106:0/3864315429 >> 172.21.15.106:0/3864315429 conn(0x7fad98067750 msgr2=0x7fad98150ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:41.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.439+0000 7fad9e400640 1 -- 172.21.15.106:0/3864315429 shutdown_connections 2024-08-17T02:31:41.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.439+0000 7fad9e400640 1 -- 172.21.15.106:0/3864315429 wait complete. 2024-08-17T02:31:41.454 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:31:41.454 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:31:41.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.601+0000 7f841de00640 1 Processor -- start 2024-08-17T02:31:41.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.601+0000 7f841de00640 1 -- start start 2024-08-17T02:31:41.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.602+0000 7f841de00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8418155a20 0x7f84180adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:41.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.602+0000 7f841de00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f841806df00 0x7f84180ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:41.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.602+0000 7f841de00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8418156670 con 0x7f8418155df0 2024-08-17T02:31:41.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.602+0000 7f841de00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84180b0350 con 0x7f8418155a20 2024-08-17T02:31:41.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.602+0000 7f841de00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f841806e5e0 con 0x7f841806df00 2024-08-17T02:31:41.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.602+0000 7f8416a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8418155a20 0x7f84180adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:41.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.602+0000 7f8416000640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8418155df0 0x7f841806d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:59486/0 (socket says 172.21.15.106:59486) 2024-08-17T02:31:41.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.602+0000 7f8416000640 1 -- 172.21.15.106:0/3603791805 learned_addr learned my addr 172.21.15.106:0/3603791805 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-08-17T02:31:41.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.602+0000 7f8417400640 1 --2- 172.21.15.106:0/3603791805 >> v2:172.21.15.171:3300/0 conn(0x7f841806df00 0x7f84180ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:41.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.603+0000 7f8415600640 1 -- 172.21.15.106:0/3603791805 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 664217358 0 0) 0x7f8418156670 con 0x7f8418155df0 2024-08-17T02:31:41.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.603+0000 7f8416a00640 1 -- 172.21.15.106:0/3603791805 >> v2:172.21.15.171:3300/0 conn(0x7f841806df00 msgr2=0x7f84180ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:31:41.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.603+0000 7f8416a00640 1 --2- 172.21.15.106:0/3603791805 >> v2:172.21.15.171:3300/0 conn(0x7f841806df00 0x7f84180ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:41.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.603+0000 7f8416a00640 1 -- 172.21.15.106:0/3603791805 >> v1:172.21.15.106:6789/0 conn(0x7f8418155df0 legacy=0x7f841806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:41.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.603+0000 7f8416a00640 1 -- 172.21.15.106:0/3603791805 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841806e8c0 con 0x7f8418155a20 2024-08-17T02:31:41.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.604+0000 7f8416a00640 1 --2- 172.21.15.106:0/3603791805 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8418155a20 0x7f84180adf10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f84181565e0 tx=0x7f84080090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0e8c943a255f47 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:41.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.604+0000 7f8415600640 1 -- 172.21.15.106:0/3603791805 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840802ad20 con 0x7f8418155a20 2024-08-17T02:31:41.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.604+0000 7f8415600640 1 -- 172.21.15.106:0/3603791805 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f840802ae80 con 0x7f8418155a20 2024-08-17T02:31:41.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.604+0000 7f8415600640 1 -- 172.21.15.106:0/3603791805 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8408032690 con 0x7f8418155a20 2024-08-17T02:31:41.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.605+0000 7f841de00640 1 -- 172.21.15.106:0/3603791805 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8418155a20 msgr2=0x7f84180adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:41.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.605+0000 7f841de00640 1 --2- 172.21.15.106:0/3603791805 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8418155a20 0x7f84180adf10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f84181565e0 tx=0x7f84080090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:41.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.605+0000 7f841de00640 1 -- 172.21.15.106:0/3603791805 shutdown_connections 2024-08-17T02:31:41.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.605+0000 7f841de00640 1 --2- 172.21.15.106:0/3603791805 >> v2:172.21.15.171:3300/0 conn(0x7f841806df00 0x7f84180ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:41.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.605+0000 7f841de00640 1 --2- 172.21.15.106:0/3603791805 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8418155a20 0x7f84180adf10 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:41.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.605+0000 7f841de00640 1 -- 172.21.15.106:0/3603791805 >> 172.21.15.106:0/3603791805 conn(0x7f84180cb9b0 msgr2=0x7f84180cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:41.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.605+0000 7f841de00640 1 -- 172.21.15.106:0/3603791805 shutdown_connections 2024-08-17T02:31:41.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.605+0000 7f841de00640 1 -- 172.21.15.106:0/3603791805 wait complete. 2024-08-17T02:31:41.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.606+0000 7f841de00640 1 Processor -- start 2024-08-17T02:31:41.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.606+0000 7f841de00640 1 -- start start 2024-08-17T02:31:41.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.607+0000 7f841de00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f841806df00 0x7f841814d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:41.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.607+0000 7f841de00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8418155a20 0x7f8418150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:41.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.607+0000 7f841de00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8418155df0 0x7f84180687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:41.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.607+0000 7f841de00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841814ecc0 con 0x7f841806df00 2024-08-17T02:31:41.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.607+0000 7f841de00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841814e0b0 con 0x7f8418155a20 2024-08-17T02:31:41.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.607+0000 7f841de00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841814e390 con 0x7f8418155df0 2024-08-17T02:31:41.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.607+0000 7f8416a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f841806df00 0x7f841814d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:41.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.607+0000 7f8416a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f841806df00 0x7f841814d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60116/0 (socket says 172.21.15.106:60116) 2024-08-17T02:31:41.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.607+0000 7f8416a00640 1 -- 172.21.15.106:0/1827852618 learned_addr learned my addr 172.21.15.106:0/1827852618 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-17T02:31:41.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.608+0000 7f8416a00640 1 -- 172.21.15.106:0/1827852618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8418155df0 msgr2=0x7f84180687b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:41.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.608+0000 7f8416a00640 1 --2- 172.21.15.106:0/1827852618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8418155df0 0x7f84180687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:41.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.608+0000 7f8416000640 1 --2- 172.21.15.106:0/1827852618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8418155a20 0x7f8418150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:41.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.608+0000 7f8416a00640 1 -- 172.21.15.106:0/1827852618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8418155a20 msgr2=0x7f8418150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:41.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.608+0000 7f8416a00640 1 --2- 172.21.15.106:0/1827852618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8418155a20 0x7f8418150410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:41.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.608+0000 7f8416a00640 1 -- 172.21.15.106:0/1827852618 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8408009390 con 0x7f841806df00 2024-08-17T02:31:41.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.608+0000 7f8416000640 1 --2- 172.21.15.106:0/1827852618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8418155a20 0x7f8418150410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:31:41.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.608+0000 7f8416a00640 1 --2- 172.21.15.106:0/1827852618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f841806df00 0x7f841814d9b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8408009360 tx=0x7f84080090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:41.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.609+0000 7f840e000640 1 -- 172.21.15.106:0/1827852618 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840803b6e0 con 0x7f841806df00 2024-08-17T02:31:41.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.609+0000 7f840e000640 1 -- 172.21.15.106:0/1827852618 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f840803b840 con 0x7f841806df00 2024-08-17T02:31:41.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.609+0000 7f840e000640 1 -- 172.21.15.106:0/1827852618 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840803bc20 con 0x7f841806df00 2024-08-17T02:31:41.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.609+0000 7f841de00640 1 -- 172.21.15.106:0/1827852618 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f841814e670 con 0x7f841806df00 2024-08-17T02:31:41.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.609+0000 7f841de00640 1 -- 172.21.15.106:0/1827852618 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8418168fd0 con 0x7f841806df00 2024-08-17T02:31:41.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.610+0000 7f841de00640 1 -- 172.21.15.106:0/1827852618 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8418064db0 con 0x7f841806df00 2024-08-17T02:31:41.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.610+0000 7f840e000640 1 -- 172.21.15.106:0/1827852618 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8408039040 con 0x7f841806df00 2024-08-17T02:31:41.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.611+0000 7f840e000640 1 --2- 172.21.15.106:0/1827852618 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f83f8065150 0x7f83f8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:31:41.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.611+0000 7f840e000640 1 -- 172.21.15.106:0/1827852618 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f84080a23a0 con 0x7f841806df00 2024-08-17T02:31:41.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.612+0000 7f8416000640 1 --2- 172.21.15.106:0/1827852618 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f83f8065150 0x7f83f8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:31:41.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.612+0000 7f8416000640 1 --2- 172.21.15.106:0/1827852618 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f83f8065150 0x7f83f8067600 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f841814d7e0 tx=0x7f8404009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:31:41.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.615+0000 7f840e000640 1 -- 172.21.15.106:0/1827852618 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8408070660 con 0x7f841806df00 2024-08-17T02:31:41.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.823+0000 7f841de00640 1 -- 172.21.15.106:0/1827852618 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8418158dc0 con 0x7f841806df00 2024-08-17T02:31:41.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.823+0000 7f840e000640 1 -- 172.21.15.106:0/1827852618 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f8408037df0 con 0x7f841806df00 2024-08-17T02:31:41.825 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-17T02:31:41.825 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4900,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/1137148711","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1137148711},{"type":"v1","addr":"172.21.15.106:6836","nonce":1137148711}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4903,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3136131297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":3136131297},{"type":"v1","addr":"172.21.15.106:6837","nonce":3136131297}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4919,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6834/2012785463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":2012785463},{"type":"v1","addr":"172.21.15.171:6834","nonce":2012785463}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/1478041771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6833","nonce":1478041771},{"type":"v1","addr":"172.21.15.171:6835","nonce":1478041771}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[]} 2024-08-17T02:31:41.825 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 24 2024-08-17T02:31:41.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.825+0000 7f841de00640 1 -- 172.21.15.106:0/1827852618 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f83f8065150 msgr2=0x7f83f8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:41.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.825+0000 7f841de00640 1 --2- 172.21.15.106:0/1827852618 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f83f8065150 0x7f83f8067600 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f841814d7e0 tx=0x7f8404009040 comp rx=0 tx=0).stop 2024-08-17T02:31:41.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.825+0000 7f841de00640 1 -- 172.21.15.106:0/1827852618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f841806df00 msgr2=0x7f841814d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:31:41.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.825+0000 7f841de00640 1 --2- 172.21.15.106:0/1827852618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f841806df00 0x7f841814d9b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8408009360 tx=0x7f84080090f0 comp rx=0 tx=0).stop 2024-08-17T02:31:41.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.825+0000 7f841de00640 1 -- 172.21.15.106:0/1827852618 shutdown_connections 2024-08-17T02:31:41.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.825+0000 7f841de00640 1 --2- 172.21.15.106:0/1827852618 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8418155df0 0x7f84180687b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:41.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.825+0000 7f841de00640 1 --2- 172.21.15.106:0/1827852618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8418155a20 0x7f8418150410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:41.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.825+0000 7f841de00640 1 --2- 172.21.15.106:0/1827852618 >> [v2:172.21.15.106:6832/36860,v1:172.21.15.106:6833/36860] conn(0x7f83f8065150 0x7f83f8067600 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:41.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.825+0000 7f841de00640 1 --2- 172.21.15.106:0/1827852618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f841806df00 0x7f841814d9b0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:31:41.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.825+0000 7f841de00640 1 -- 172.21.15.106:0/1827852618 >> 172.21.15.106:0/1827852618 conn(0x7f84180cb9b0 msgr2=0x7f8418153cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:31:41.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.825+0000 7f841de00640 1 -- 172.21.15.106:0/1827852618 shutdown_connections 2024-08-17T02:31:41.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-17T02:31:41.825+0000 7f841de00640 1 -- 172.21.15.106:0/1827852618 wait complete. 2024-08-17T02:31:41.842 DEBUG:tasks.cephfs.filesystem:already dead... 2024-08-17T02:31:41.842 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-17T02:31:41.842 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:31:41.842 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:41.855 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:31:41.856 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:31:41.856 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:41.911 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:31:41.911 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:31:41.911 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:41.927 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:31:41.928 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:31:41.928 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:41.972 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:41.976 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:41.985 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:31:41.985 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-17T02:31:41.986 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-17T02:31:41.986 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:42.069 INFO:tasks.ceph.osd.0:Stopped 2024-08-17T02:31:42.069 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-17T02:31:42.069 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:42.159 INFO:tasks.ceph.osd.1:Stopped 2024-08-17T02:31:42.159 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-17T02:31:42.159 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:42.208 INFO:tasks.ceph.osd.2:Stopped 2024-08-17T02:31:42.208 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-17T02:31:42.208 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:42.254 INFO:tasks.ceph.osd.3:Stopped 2024-08-17T02:31:42.254 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-17T02:31:42.254 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:42.300 INFO:tasks.ceph.osd.4:Stopped 2024-08-17T02:31:42.300 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-17T02:31:42.301 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:42.353 INFO:tasks.ceph.osd.5:Stopped 2024-08-17T02:31:42.354 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-17T02:31:42.354 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:42.399 INFO:tasks.ceph.osd.6:Stopped 2024-08-17T02:31:42.400 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-17T02:31:42.400 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:42.457 INFO:tasks.ceph.osd.7:Stopped 2024-08-17T02:31:42.457 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-17T02:31:42.457 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-17T02:31:42.457 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:42.518 INFO:tasks.ceph.mgr.y:Stopped 2024-08-17T02:31:42.519 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-17T02:31:42.519 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:42.575 INFO:tasks.ceph.mgr.x:Stopped 2024-08-17T02:31:42.575 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-17T02:31:42.575 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-17T02:31:42.575 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:42.595 INFO:tasks.ceph.mon.a:Stopped 2024-08-17T02:31:42.595 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-17T02:31:42.595 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:42.613 INFO:tasks.ceph.mon.b:Stopped 2024-08-17T02:31:42.613 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-17T02:31:42.613 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:31:42.671 INFO:tasks.ceph.mon.c:Stopped 2024-08-17T02:31:42.671 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-17T02:31:42.672 DEBUG:teuthology.orchestra.run.smithi106:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-08-17T02:31:42.746 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi106.front.sepia.ceph.com 2024-08-17T02:31:42.746 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-17T02:31:42.974 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi106.front.sepia.ceph.com 2024-08-17T02:31:42.974 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-17T02:31:43.078 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi106.front.sepia.ceph.com 2024-08-17T02:31:43.079 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-17T02:31:43.211 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi106.front.sepia.ceph.com 2024-08-17T02:31:43.212 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-17T02:31:43.310 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi171.front.sepia.ceph.com 2024-08-17T02:31:43.310 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-17T02:31:43.515 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi171.front.sepia.ceph.com 2024-08-17T02:31:43.515 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-17T02:31:43.671 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi171.front.sepia.ceph.com 2024-08-17T02:31:43.672 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-17T02:31:43.798 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi171.front.sepia.ceph.com 2024-08-17T02:31:43.798 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-17T02:31:43.915 INFO:tasks.ceph:Archiving mon data... 2024-08-17T02:31:43.916 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858282/data/mon.a.tgz 2024-08-17T02:31:43.916 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2024-08-17T02:31:43.952 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.yNb6mlxojM 2024-08-17T02:31:43.953 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.yNb6mlxojM 2024-08-17T02:31:44.127 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.yNb6mlxojM 2024-08-17T02:31:44.221 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.yNb6mlxojM is 310KB 2024-08-17T02:31:44.310 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.yNb6mlxojM 2024-08-17T02:31:44.345 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858282/data/mon.b.tgz 2024-08-17T02:31:44.345 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-08-17T02:31:44.382 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.8MH2J0H0uN 2024-08-17T02:31:44.419 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.8MH2J0H0uN 2024-08-17T02:31:44.597 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.8MH2J0H0uN 2024-08-17T02:31:44.691 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.8MH2J0H0uN is 413KB 2024-08-17T02:31:44.783 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.8MH2J0H0uN 2024-08-17T02:31:44.817 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858282/data/mon.c.tgz 2024-08-17T02:31:44.818 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-08-17T02:31:44.892 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.1kcrh8qVUj 2024-08-17T02:31:44.892 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.1kcrh8qVUj 2024-08-17T02:31:45.074 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.1kcrh8qVUj 2024-08-17T02:31:45.168 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.1kcrh8qVUj is 413KB 2024-08-17T02:31:45.257 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.1kcrh8qVUj 2024-08-17T02:31:45.292 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-17T02:31:45.292 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:31:45.297 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:31:45.387 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-08-17T02:31:45.387 DEBUG:teuthology.orchestra.run.smithi106:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:31:45.392 DEBUG:teuthology.orchestra.run.smithi171:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:31:45.452 INFO:teuthology.orchestra.run.smithi106.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:31:45.453 INFO:teuthology.orchestra.run.smithi171.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:31:45.464 INFO:tasks.ceph:Archiving crash dumps... 2024-08-17T02:31:45.465 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858282/remote/smithi106/crash 2024-08-17T02:31:45.466 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:31:45.521 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858282/remote/smithi171/crash 2024-08-17T02:31:45.522 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:31:45.576 INFO:tasks.ceph:Shutting down logrotate 2024-08-17T02:31:45.576 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:45.580 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:45.690 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:45.745 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:45.799 INFO:tasks.ceph:Compressing logs... 2024-08-17T02:31:45.800 DEBUG:teuthology.orchestra.run.smithi106:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:31:45.804 DEBUG:teuthology.orchestra.run.smithi171:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:31:45.854 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48163.log 2024-08-17T02:31:45.855 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50076.log 2024-08-17T02:31:45.855 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47342.log 2024-08-17T02:31:45.856 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48163.log.gz 2024-08-17T02:31:45.856 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45818.log 2024-08-17T02:31:45.857 INFO:teuthology.orchestra.run.smithi106.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50076.log.gz 2024-08-17T02:31:45.857 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47553.log 2024-08-17T02:31:45.858 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:31:45.859 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47342.log.gz 2024-08-17T02:31:45.859 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.45818.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.45818.log.gz 2024-08-17T02:31:45.859 INFO:teuthology.orchestra.run.smithi106.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42488.log 2024-08-17T02:31:45.859 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37123.log 2024-08-17T02:31:45.859 INFO:teuthology.orchestra.run.smithi106.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47553.log.gz 2024-08-17T02:31:45.863 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:31:45.863 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-17T02:31:45.863 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-08-17T02:31:45.863 INFO:teuthology.orchestra.run.smithi171.stderr: 91.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:31:45.863 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37155.log 2024-08-17T02:31:45.863 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mds.b.log: 93.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:31:45.863 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-17T02:31:45.865 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.42488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48897.log 2024-08-17T02:31:45.865 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42488.log.gz 2024-08-17T02:31:45.865 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43422.log 2024-08-17T02:31:45.865 INFO:teuthology.orchestra.run.smithi106.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37123.log.gz 2024-08-17T02:31:45.865 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42402.log 2024-08-17T02:31:45.866 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48897.log.gz 2024-08-17T02:31:45.866 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49362.log 2024-08-17T02:31:45.866 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43422.log.gz 2024-08-17T02:31:45.866 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.42402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48205.log 2024-08-17T02:31:45.866 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42402.log.gz 2024-08-17T02:31:45.866 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47139.log 2024-08-17T02:31:45.866 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49362.log.gz 2024-08-17T02:31:45.866 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49236.log 2024-08-17T02:31:45.867 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48205.log.gz 2024-08-17T02:31:45.870 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37155.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-17T02:31:45.870 INFO:teuthology.orchestra.run.smithi171.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37155.log.gz 2024-08-17T02:31:45.870 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-17T02:31:45.871 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-17T02:31:45.871 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43223.log 2024-08-17T02:31:45.871 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36984.log 2024-08-17T02:31:45.871 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.3.43223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.43223.log.gz 2024-08-17T02:31:45.874 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.36984.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36984.log.gz 2024-08-17T02:31:45.875 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-17T02:31:45.875 INFO:teuthology.orchestra.run.smithi171.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-17T02:31:45.875 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37064.log 2024-08-17T02:31:45.875 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36944.log 2024-08-17T02:31:45.875 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48813.log 2024-08-17T02:31:45.875 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47139.log.gz 2024-08-17T02:31:45.875 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44462.log 2024-08-17T02:31:45.875 INFO:teuthology.orchestra.run.smithi106.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49236.log.gz 2024-08-17T02:31:45.876 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44084.log 2024-08-17T02:31:45.876 INFO:teuthology.orchestra.run.smithi106.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48813.log.gz 2024-08-17T02:31:45.876 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50630.log 2024-08-17T02:31:45.876 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44462.log.gz 2024-08-17T02:31:45.876 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49572.log 2024-08-17T02:31:45.876 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44084.log.gz 2024-08-17T02:31:45.876 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50630.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50630.log.gz 2024-08-17T02:31:45.876 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50714.log 2024-08-17T02:31:45.876 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48121.log 2024-08-17T02:31:45.877 INFO:teuthology.orchestra.run.smithi106.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.49572.log.gz 2024-08-17T02:31:45.877 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48355.log 2024-08-17T02:31:45.877 INFO:teuthology.orchestra.run.smithi106.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.50714.log.gz 2024-08-17T02:31:45.877 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48855.log 2024-08-17T02:31:45.877 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48121.log.gz 2024-08-17T02:31:45.877 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45910.log 2024-08-17T02:31:45.877 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48355.log.gz 2024-08-17T02:31:45.877 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49614.log 2024-08-17T02:31:45.878 INFO:teuthology.orchestra.run.smithi106.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.48855.log.gz 2024-08-17T02:31:45.881 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37064.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37064.log.gz 2024-08-17T02:31:45.881 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37024.log 2024-08-17T02:31:45.881 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.36944.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36944.log.gz 2024-08-17T02:31:45.882 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37024.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37024.log.gz 2024-08-17T02:31:45.882 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42902.log 2024-08-17T02:31:45.882 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37235.log 2024-08-17T02:31:45.882 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.42902.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42902.log.gz 2024-08-17T02:31:45.886 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37235.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37235.log.gz 2024-08-17T02:31:45.886 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37108.log 2024-08-17T02:31:45.886 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43629.log 2024-08-17T02:31:45.886 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37108.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37108.log.gz 2024-08-17T02:31:45.889 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.45910.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:31:45.889 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45910.log.gz 2024-08-17T02:31:45.889 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36858.log 2024-08-17T02:31:45.889 INFO:teuthology.orchestra.run.smithi106.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49614.log.gz 2024-08-17T02:31:45.889 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46635.log 2024-08-17T02:31:45.889 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36858.log: 84.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:31:45.889 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51050.log 2024-08-17T02:31:45.890 INFO:teuthology.orchestra.run.smithi106.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.36858.log.gz 2024-08-17T02:31:45.890 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44504.log 2024-08-17T02:31:45.890 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46635.log.gz 2024-08-17T02:31:45.890 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.51050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46375.log 2024-08-17T02:31:45.890 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51050.log.gz 2024-08-17T02:31:45.890 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46039.log 2024-08-17T02:31:45.890 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44504.log.gz 2024-08-17T02:31:45.891 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44168.log 2024-08-17T02:31:45.891 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46375.log.gz 2024-08-17T02:31:45.891 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51218.log 2024-08-17T02:31:45.891 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46039.log.gz 2024-08-17T02:31:45.891 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44168.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-17T02:31:45.891 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44168.log.gz 2024-08-17T02:31:45.891 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.51218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47637.log 2024-08-17T02:31:45.891 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51218.log.gz 2024-08-17T02:31:45.892 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44420.log 2024-08-17T02:31:45.892 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47055.log 2024-08-17T02:31:45.892 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47637.log.gz 2024-08-17T02:31:45.892 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42024.log 2024-08-17T02:31:45.892 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44420.log.gz 2024-08-17T02:31:45.892 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51386.log 2024-08-17T02:31:45.892 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47055.log.gz 2024-08-17T02:31:45.892 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.42024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45056.log 2024-08-17T02:31:45.892 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42024.log.gz 2024-08-17T02:31:45.893 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.51386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47469.log 2024-08-17T02:31:45.893 INFO:teuthology.orchestra.run.smithi106.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51386.log.gz 2024-08-17T02:31:45.893 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.0.45056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45056.log.gz 2024-08-17T02:31:45.896 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.1.43629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43629.log.gz 2024-08-17T02:31:45.896 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37195.log 2024-08-17T02:31:45.896 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-08-17T02:31:45.896 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37195.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37195.log.gz 2024-08-17T02:31:45.897 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-17T02:31:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42530.log 2024-08-17T02:31:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43762.log 2024-08-17T02:31:45.899 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47469.log.gz 2024-08-17T02:31:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.42530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47893.log 2024-08-17T02:31:45.900 INFO:teuthology.orchestra.run.smithi106.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42530.log.gz 2024-08-17T02:31:45.900 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44336.log 2024-08-17T02:31:45.900 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43762.log.gz 2024-08-17T02:31:45.900 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48247.log 2024-08-17T02:31:45.900 INFO:teuthology.orchestra.run.smithi106.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47893.log.gz 2024-08-17T02:31:45.900 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45733.log 2024-08-17T02:31:45.900 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44336.log.gz 2024-08-17T02:31:45.900 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49992.log 2024-08-17T02:31:45.901 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48247.log.gz 2024-08-17T02:31:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.45733.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:31:45.901 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45733.log.gz 2024-08-17T02:31:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49320.log 2024-08-17T02:31:45.901 INFO:teuthology.orchestra.run.smithi106.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49992.log.gz 2024-08-17T02:31:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48638.log 2024-08-17T02:31:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41818.log 2024-08-17T02:31:45.901 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49320.log.gz 2024-08-17T02:31:45.902 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:31:45.902 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50370.log 2024-08-17T02:31:45.902 INFO:teuthology.orchestra.run.smithi106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48638.log.gz 2024-08-17T02:31:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.41818.log: gzip -5 --verbose 87.7% -- /var/log/ceph/ceph-client.admin.42908.log -- replaced with /var/log/ceph/ceph-client.admin.41818.log.gz 2024-08-17T02:31:45.904 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-08-17T02:31:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47721.log 2024-08-17T02:31:45.904 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50370.log.gz 2024-08-17T02:31:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.42908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43641.log 2024-08-17T02:31:45.905 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42908.log.gz 2024-08-17T02:31:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44126.log 2024-08-17T02:31:45.905 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47721.log.gz 2024-08-17T02:31:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43641.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.43641.log.gz 2024-08-17T02:31:45.905 INFO:teuthology.orchestra.run.smithi106.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42232.log 2024-08-17T02:31:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46971.log 2024-08-17T02:31:45.905 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44126.log.gz 2024-08-17T02:31:45.906 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mon.b.log: 92.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-08-17T02:31:45.907 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.42232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46593.log 2024-08-17T02:31:45.908 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42232.log.gz 2024-08-17T02:31:45.908 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47809.log 2024-08-17T02:31:45.908 INFO:teuthology.orchestra.run.smithi106.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46971.log.gz 2024-08-17T02:31:45.908 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46593.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46593.log.gz 2024-08-17T02:31:45.908 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45997.log 2024-08-17T02:31:45.908 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45649.log 2024-08-17T02:31:45.908 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47809.log.gz 2024-08-17T02:31:45.910 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.45997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50882.log 2024-08-17T02:31:45.910 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45997.log.gz 2024-08-17T02:31:45.910 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.45649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47300.log 2024-08-17T02:31:45.910 INFO:teuthology.orchestra.run.smithi106.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45649.log.gz 2024-08-17T02:31:45.910 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50882.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50882.log.gz 2024-08-17T02:31:45.910 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-17T02:31:45.911 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43423.log 2024-08-17T02:31:45.911 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47300.log.gz 2024-08-17T02:31:45.911 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37242.log 2024-08-17T02:31:45.912 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45481.log 2024-08-17T02:31:45.913 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43423.log.gz 2024-08-17T02:31:45.913 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37242.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37242.log.gz 2024-08-17T02:31:45.914 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42614.log 2024-08-17T02:31:45.914 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.45481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47097.log 2024-08-17T02:31:45.915 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45481.log.gz 2024-08-17T02:31:45.915 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.42614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42274.log 2024-08-17T02:31:45.915 INFO:teuthology.orchestra.run.smithi106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42614.log.gz 2024-08-17T02:31:45.916 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44252.log 2024-08-17T02:31:45.916 INFO:teuthology.orchestra.run.smithi106.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47097.log.gz 2024-08-17T02:31:45.917 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.42274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50840.log 2024-08-17T02:31:45.917 INFO:teuthology.orchestra.run.smithi106.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42274.log.gz 2024-08-17T02:31:45.918 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46845.log 2024-08-17T02:31:45.918 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44252.log.gz 2024-08-17T02:31:45.919 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50840.log: gzip 88.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.50840.log.gz 2024-08-17T02:31:45.919 INFO:teuthology.orchestra.run.smithi106.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47765.log 2024-08-17T02:31:45.920 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46845.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46845.log.gz -5 2024-08-17T02:31:45.920 INFO:teuthology.orchestra.run.smithi106.stderr: --verbose -- /var/log/ceph/ceph-mds.c.log 2024-08-17T02:31:45.921 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43418.log 2024-08-17T02:31:45.921 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47765.log.gz 2024-08-17T02:31:45.922 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42698.log 2024-08-17T02:31:45.922 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43418.log: 92.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-08-17T02:31:45.923 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47995.log 2024-08-17T02:31:45.923 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43418.log.gz 2024-08-17T02:31:45.924 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.42698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43087.log 2024-08-17T02:31:45.924 INFO:teuthology.orchestra.run.smithi106.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42698.log.gz 2024-08-17T02:31:45.925 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42105.log 2024-08-17T02:31:45.925 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47995.log.gz 2024-08-17T02:31:45.926 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51176.log 2024-08-17T02:31:45.926 INFO:teuthology.orchestra.run.smithi106.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43087.log.gz 2024-08-17T02:31:45.927 INFO:teuthology.orchestra.run.smithi171.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-08-17T02:31:45.927 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.42105.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-17T02:31:45.928 INFO:teuthology.orchestra.run.smithi106.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42105.log.gz 2024-08-17T02:31:45.928 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.51176.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-17T02:31:45.928 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51176.log.gz 2024-08-17T02:31:45.929 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50202.log 2024-08-17T02:31:45.929 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49740.log 2024-08-17T02:31:45.931 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50160.log 2024-08-17T02:31:45.931 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50202.log.gz 2024-08-17T02:31:45.932 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47935.log 2024-08-17T02:31:45.932 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49740.log.gz 2024-08-17T02:31:45.933 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50160.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-17T02:31:45.933 INFO:teuthology.orchestra.run.smithi106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50160.log.gz 2024-08-17T02:31:45.934 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48079.log 2024-08-17T02:31:45.934 INFO:teuthology.orchestra.run.smithi106.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47935.log.gz 2024-08-17T02:31:45.936 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51428.log 2024-08-17T02:31:45.937 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48079.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48079.log.gz 2024-08-17T02:31:45.937 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51552.log 2024-08-17T02:31:45.938 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.51428.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51428.log.gz 2024-08-17T02:31:45.938 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46677.log 2024-08-17T02:31:45.940 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.51552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49866.log 2024-08-17T02:31:45.940 INFO:teuthology.orchestra.run.smithi106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51552.log.gz 2024-08-17T02:31:45.941 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44294.log 2024-08-17T02:31:45.941 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46677.log.gz 2024-08-17T02:31:45.942 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44378.log 2024-08-17T02:31:45.942 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49866.log.gz 2024-08-17T02:31:45.944 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44294.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44294.log.gz 2024-08-17T02:31:45.945 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44378.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44378.log.gz 2024-08-17T02:31:45.945 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45419.log 2024-08-17T02:31:45.946 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43413.log 2024-08-17T02:31:45.948 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.2.45419.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.43759.log -- replaced with /var/log/ceph/ceph-client.2.45419.log.gz 2024-08-17T02:31:45.948 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-08-17T02:31:45.949 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43755.log 2024-08-17T02:31:45.949 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43413.log.gz 2024-08-17T02:31:45.950 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51302.log 2024-08-17T02:31:45.950 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43759.log.gz 2024-08-17T02:31:45.952 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43755.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-17T02:31:45.952 INFO:teuthology.orchestra.run.smithi106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43755.log.gz 2024-08-17T02:31:45.953 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.51302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43090.log 2024-08-17T02:31:45.953 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51302.log.gz 2024-08-17T02:31:45.954 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47427.log 2024-08-17T02:31:45.956 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43090.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43090.log.gz 2024-08-17T02:31:45.956 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47679.log 2024-08-17T02:31:45.957 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47427.log.gz 2024-08-17T02:31:45.960 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43426.log 2024-08-17T02:31:45.961 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47679.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47679.log.gz 2024-08-17T02:31:45.962 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43426.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43426.log.gz 2024-08-17T02:31:45.963 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48683.log 2024-08-17T02:31:45.964 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43081.log 2024-08-17T02:31:45.965 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48683.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48683.log.gz 2024-08-17T02:31:45.966 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46929.log 2024-08-17T02:31:45.974 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43081.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43081.log.gz 2024-08-17T02:31:45.974 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43414.log 2024-08-17T02:31:45.974 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46929.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46929.log.gz 2024-08-17T02:31:45.974 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43425.log 2024-08-17T02:31:45.974 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43414.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43414.log.gz 2024-08-17T02:31:45.975 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46291.log/var/log/ceph/ceph-client.admin.43425.log: 2024-08-17T02:31:45.975 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43425.log.gz 2024-08-17T02:31:45.975 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49488.log 2024-08-17T02:31:45.977 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46291.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46291.log.gz 2024-08-17T02:31:45.977 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.49488.log: -- /var/log/ceph/ceph-client.admin.43071.log 2024-08-17T02:31:45.977 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49488.log.gz 2024-08-17T02:31:45.977 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43089.log 2024-08-17T02:31:45.978 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43071.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43071.log.gz 2024-08-17T02:31:45.979 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43758.log 2024-08-17T02:31:45.980 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43089.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43089.log.gz 2024-08-17T02:31:45.980 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48542.log 2024-08-17T02:31:45.981 INFO:teuthology.orchestra.run.smithi171.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-17T02:31:45.982 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43758.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43758.log.gz 2024-08-17T02:31:45.983 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49698.log 2024-08-17T02:31:45.983 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.0.48542.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48542.log.gz 2024-08-17T02:31:45.984 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46165.log 2024-08-17T02:31:45.986 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49698.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49698.log.gz 2024-08-17T02:31:45.986 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5/var/log/ceph/ceph-client.admin.46165.log: --verbose -- /var/log/ceph/ceph-client.admin.49782.log 2024-08-17T02:31:45.987 INFO:teuthology.orchestra.run.smithi106.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46165.log.gz 2024-08-17T02:31:45.987 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46123.log 2024-08-17T02:31:45.990 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49782.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49782.log.gz 2024-08-17T02:31:45.990 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5/var/log/ceph/ceph-client.admin.46123.log: --verbose -- /var/log/ceph/ceph-client.admin.43419.log 2024-08-17T02:31:45.990 INFO:teuthology.orchestra.run.smithi106.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46123.log.gz 2024-08-17T02:31:45.991 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46207.log 2024-08-17T02:31:45.992 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43419.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43419.log.gz 2024-08-17T02:31:45.993 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46719.log 2024-08-17T02:31:45.994 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46207.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46207.log.gz 2024-08-17T02:31:45.995 INFO:teuthology.orchestra.run.smithi106.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-08-17T02:31:45.996 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46719.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46719.log.gz 2024-08-17T02:31:45.996 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46887.log 2024-08-17T02:31:45.997 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51470.log 2024-08-17T02:31:45.999 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49824.log 2024-08-17T02:31:45.999 INFO:teuthology.orchestra.run.smithi106.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46887.log.gz 2024-08-17T02:31:46.000 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.51470.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30790.log 2024-08-17T02:31:46.000 INFO:teuthology.orchestra.run.smithi106.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51470.log.gz 2024-08-17T02:31:46.002 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49824.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49824.log.gz 2024-08-17T02:31:46.002 INFO:teuthology.orchestra.run.smithi106.stderr:gzip/var/log/ceph/ceph.tmp-client.admin.30790.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49278.log 2024-08-17T02:31:46.003 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30790.log.gz 2024-08-17T02:31:46.003 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50798.log 2024-08-17T02:31:46.005 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47013.log 2024-08-17T02:31:46.005 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49278.log.gz 2024-08-17T02:31:46.006 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50798.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50798.log.gz 2024-08-17T02:31:46.006 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45119.log 2024-08-17T02:31:46.007 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47013.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47013.log.gz 2024-08-17T02:31:46.007 INFO:teuthology.orchestra.run.smithi171.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-17T02:31:46.008 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49908.log 2024-08-17T02:31:46.009 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.45119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51510.log 2024-08-17T02:31:46.009 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45119.log.gz 2024-08-17T02:31:46.011 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49908.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49908.log.gz 2024-08-17T02:31:46.011 INFO:teuthology.orchestra.run.smithi106.stderr:gzip/var/log/ceph/ceph-client.admin.51510.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42824.log 2024-08-17T02:31:46.012 INFO:teuthology.orchestra.run.smithi106.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51510.log.gz 2024-08-17T02:31:46.012 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50966.log 2024-08-17T02:31:46.014 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.42824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49530.log 2024-08-17T02:31:46.014 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42824.log.gz 2024-08-17T02:31:46.015 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43958.log 2024-08-17T02:31:46.015 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50966.log.gz 2024-08-17T02:31:46.016 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49530.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49530.log.gz 2024-08-17T02:31:46.017 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43080.log 2024-08-17T02:31:46.017 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43958.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43958.log.gz 2024-08-17T02:31:46.018 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42656.log 2024-08-17T02:31:46.019 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48939.log 2024-08-17T02:31:46.019 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43080.log.gz 2024-08-17T02:31:46.021 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.42656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49656.log 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42656.log.gz 2024-08-17T02:31:46.021 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-08-17T02:31:46.021 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48939.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48939.log.gz 2024-08-17T02:31:46.022 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45607.log 2024-08-17T02:31:46.023 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50244.log 2024-08-17T02:31:46.023 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49656.log.gz 2024-08-17T02:31:46.025 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.45607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50328.log 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45607.log.gz 2024-08-17T02:31:46.025 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-08-17T02:31:46.025 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50244.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50244.log.gz 2024-08-17T02:31:46.026 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47595.log 2024-08-17T02:31:46.027 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44042.log 2024-08-17T02:31:46.028 INFO:teuthology.orchestra.run.smithi106.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50328.log.gz 2024-08-17T02:31:46.029 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47595.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47595.log.gz 2024-08-17T02:31:46.029 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50588.log 2024-08-17T02:31:46.030 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44042.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44042.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42782.log 2024-08-17T02:31:46.030 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-08-17T02:31:46.031 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51260.log 2024-08-17T02:31:46.032 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50588.log.gz 2024-08-17T02:31:46.032 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.42782.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42782.log.gz 2024-08-17T02:31:46.033 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41928.log 2024-08-17T02:31:46.034 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.51260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49950.log 2024-08-17T02:31:46.034 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51260.log.gz 2024-08-17T02:31:46.036 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.41928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42446.log 2024-08-17T02:31:46.036 INFO:teuthology.orchestra.run.smithi106.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.41928.log.gz 2024-08-17T02:31:46.038 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49950.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49950.log.gz 2024-08-17T02:31:46.038 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5/var/log/ceph/ceph-client.admin.42446.log: --verbose -- /var/log/ceph/ceph-client.admin.44588.log 2024-08-17T02:31:46.038 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42446.log.gz 2024-08-17T02:31:46.039 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49446.log 2024-08-17T02:31:46.040 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44588.log: 93.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46081.log 2024-08-17T02:31:46.042 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-17T02:31:46.042 INFO:teuthology.orchestra.run.smithi106.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.44588.log.gz 2024-08-17T02:31:46.042 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49446.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44000.log 2024-08-17T02:31:46.042 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49446.log.gz 2024-08-17T02:31:46.043 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48587.log 2024-08-17T02:31:46.043 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46081.log.gz 2024-08-17T02:31:46.044 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48037.log 2024-08-17T02:31:46.044 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44000.log.gz 2024-08-17T02:31:46.045 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45691.log 2024-08-17T02:31:46.046 INFO:teuthology.orchestra.run.smithi106.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48587.log.gz 2024-08-17T02:31:46.046 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48037.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48037.log.gz 2024-08-17T02:31:46.046 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46803.log 2024-08-17T02:31:46.047 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50546.log 2024-08-17T02:31:46.048 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.45691.log: 89.0%/var/log/ceph/ceph-client.admin.46803.log: -- replaced with /var/log/ceph/ceph-client.admin.45691.log.gz 2024-08-17T02:31:46.049 INFO:teuthology.orchestra.run.smithi106.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46803.log.gz 2024-08-17T02:31:46.049 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46459.log 2024-08-17T02:31:46.049 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42572.log 2024-08-17T02:31:46.050 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50546.log.gz 2024-08-17T02:31:46.050 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46459.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46459.log.gz 2024-08-17T02:31:46.051 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51092.log 2024-08-17T02:31:46.051 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.42572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48289.log 2024-08-17T02:31:46.052 INFO:teuthology.orchestra.run.smithi106.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42572.log.gz 2024-08-17T02:31:46.052 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.51092.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51092.log.gz 2024-08-17T02:31:46.053 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43761.log 2024-08-17T02:31:46.053 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5/var/log/ceph/ceph-client.admin.48289.log: --verbose -- /var/log/ceph/ceph-client.admin.46333.log 2024-08-17T02:31:46.054 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43761.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.48289.log.gz 2024-08-17T02:31:46.055 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47511.log 2024-08-17T02:31:46.055 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43761.log.gz 2024-08-17T02:31:46.056 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45523.log 2024-08-17T02:31:46.056 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46333.log.gz 2024-08-17T02:31:46.057 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44546.log 2024-08-17T02:31:46.057 INFO:teuthology.orchestra.run.smithi106.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47511.log.gz 2024-08-17T02:31:46.058 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.45523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44726.log 2024-08-17T02:31:46.059 INFO:teuthology.orchestra.run.smithi106.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45523.log.gz 2024-08-17T02:31:46.059 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44546.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44546.log.gz 2024-08-17T02:31:46.059 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46417.log 2024-08-17T02:31:46.060 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48767.log 2024-08-17T02:31:46.061 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44726.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44726.log.gz 2024-08-17T02:31:46.061 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46417.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46417.log.gz 2024-08-17T02:31:46.061 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49404.log 2024-08-17T02:31:46.062 INFO:teuthology.orchestra.run.smithi171.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-17T02:31:46.062 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50672.log 2024-08-17T02:31:46.063 INFO:teuthology.orchestra.run.smithi106.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48767.log.gz 2024-08-17T02:31:46.063 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49404.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49404.log.gz 2024-08-17T02:31:46.064 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43084.log 2024-08-17T02:31:46.064 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50924.log 2024-08-17T02:31:46.065 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50672.log: 88.0%/var/log/ceph/ceph-client.admin.43084.log: -- replaced with /var/log/ceph/ceph-client.admin.50672.log.gz 2024-08-17T02:31:46.066 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43084.log.gz 2024-08-17T02:31:46.066 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50286.log 2024-08-17T02:31:46.066 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42740.log 2024-08-17T02:31:46.067 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50924.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50924.log.gz 2024-08-17T02:31:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50286.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50286.log.gz 2024-08-17T02:31:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-08-17T02:31:46.069 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.42740.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42740.log.gz 2024-08-17T02:31:46.069 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46761.log 2024-08-17T02:31:46.070 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43750.log 2024-08-17T02:31:46.071 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.46761.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46761.log.gz 2024-08-17T02:31:46.072 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51008.log 2024-08-17T02:31:46.072 INFO:teuthology.orchestra.run.smithi106.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-08-17T02:31:46.073 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50118.log 2024-08-17T02:31:46.073 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43750.log.gz 2024-08-17T02:31:46.074 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.51008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49110.log 2024-08-17T02:31:46.074 INFO:teuthology.orchestra.run.smithi106.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51008.log.gz 2024-08-17T02:31:46.075 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50118.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50118.log.gz 2024-08-17T02:31:46.075 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42866.log 2024-08-17T02:31:46.076 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47384.log 2024-08-17T02:31:46.076 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49110.log: /var/log/ceph/ceph-client.admin.42866.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49110.log.gz 2024-08-17T02:31:46.077 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45954.log 2024-08-17T02:31:46.077 INFO:teuthology.orchestra.run.smithi106.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42866.log.gz 2024-08-17T02:31:46.078 INFO:teuthology.orchestra.run.smithi171.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-17T02:31:46.079 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45565.log 2024-08-17T02:31:46.079 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47384.log.gz 2024-08-17T02:31:46.079 INFO:teuthology.orchestra.run.smithi171.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-17T02:31:46.080 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.45954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44210.log 2024-08-17T02:31:46.080 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45954.log.gz 2024-08-17T02:31:46.081 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.45565.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45565.log.gz 2024-08-17T02:31:46.081 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49194.log 2024-08-17T02:31:46.081 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42147.log 2024-08-17T02:31:46.082 INFO:teuthology.orchestra.run.smithi171.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-17T02:31:46.083 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44210.log.gz 2024-08-17T02:31:46.083 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47219.log 2024-08-17T02:31:46.083 INFO:teuthology.orchestra.run.smithi106.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49194.log.gz 2024-08-17T02:31:46.084 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.42147.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42147.log.gz 2024-08-17T02:31:46.084 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48725.log 2024-08-17T02:31:46.085 INFO:teuthology.orchestra.run.smithi106.stderr:gzip/var/log/ceph/ceph-client.admin.47219.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51134.log 2024-08-17T02:31:46.086 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-08-17T02:31:46.086 INFO:teuthology.orchestra.run.smithi171.stderr:real 0m0.248s 2024-08-17T02:31:46.086 INFO:teuthology.orchestra.run.smithi171.stderr:user 0m1.059s 2024-08-17T02:31:46.086 INFO:teuthology.orchestra.run.smithi171.stderr:sys 0m0.192s 2024-08-17T02:31:46.087 INFO:teuthology.orchestra.run.smithi106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47219.log.gz/var/log/ceph/ceph-client.admin.48725.log: 2024-08-17T02:31:46.087 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42358.log 2024-08-17T02:31:46.088 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48725.log.gz 2024-08-17T02:31:46.088 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.51134.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51134.log.gz 2024-08-17T02:31:46.088 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45775.log 2024-08-17T02:31:46.088 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5/var/log/ceph/ceph-client.admin.42358.log: --verbose -- /var/log/ceph/ceph-client.admin.49152.log 2024-08-17T02:31:46.089 INFO:teuthology.orchestra.run.smithi106.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42358.log.gz 2024-08-17T02:31:46.089 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.45775.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45775.log.gz 2024-08-17T02:31:46.089 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42316.log 2024-08-17T02:31:46.090 INFO:teuthology.orchestra.run.smithi106.stderr:gzip/var/log/ceph/ceph-client.admin.49152.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47851.log 2024-08-17T02:31:46.091 INFO:teuthology.orchestra.run.smithi106.stderr: 89.5%/var/log/ceph/ceph-client.admin.42316.log: -- replaced with /var/log/ceph/ceph-client.admin.49152.log.gz 2024-08-17T02:31:46.091 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42316.log.gz 2024-08-17T02:31:46.092 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45861.log 2024-08-17T02:31:46.092 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46249.log 2024-08-17T02:31:46.093 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.45861.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47851.log.gz 2024-08-17T02:31:46.093 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- 88.9% /var/log/ceph/ceph-client.admin.43088.log 2024-08-17T02:31:46.093 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45861.log.gz 2024-08-17T02:31:46.095 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50756.log 2024-08-17T02:31:46.095 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46249.log.gz 2024-08-17T02:31:46.096 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43088.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43088.log.gz 2024-08-17T02:31:46.096 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42190.log 2024-08-17T02:31:46.097 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43752.log 2024-08-17T02:31:46.097 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50756.log.gz 2024-08-17T02:31:46.098 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.42190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51344.log 2024-08-17T02:31:46.098 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42190.log.gz 2024-08-17T02:31:46.099 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43752.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50034.log 2024-08-17T02:31:46.100 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43752.log.gz 2024-08-17T02:31:46.101 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.51344.log: /var/log/ceph/ceph-client.admin.50034.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51344.log.gz 2024-08-17T02:31:46.101 INFO:teuthology.orchestra.run.smithi106.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50034.log.gz 2024-08-17T02:31:46.138 INFO:teuthology.orchestra.run.smithi106.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-17T02:31:46.139 INFO:teuthology.orchestra.run.smithi106.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-17T02:31:46.174 INFO:teuthology.orchestra.run.smithi106.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-17T02:31:46.247 INFO:teuthology.orchestra.run.smithi106.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-17T02:31:46.251 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-08-17T02:31:46.251 INFO:teuthology.orchestra.run.smithi106.stderr:real 0m0.417s 2024-08-17T02:31:46.251 INFO:teuthology.orchestra.run.smithi106.stderr:user 0m1.190s 2024-08-17T02:31:46.251 INFO:teuthology.orchestra.run.smithi106.stderr:sys 0m0.593s 2024-08-17T02:31:46.251 INFO:tasks.ceph:Archiving logs... 2024-08-17T02:31:46.252 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858282/remote/smithi106/log 2024-08-17T02:31:46.253 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:31:46.597 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858282/remote/smithi171/log 2024-08-17T02:31:46.598 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:31:46.790 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-17T02:31:46.803 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-17T02:31:46.803 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:31:46.807 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:31:46.924 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-17T02:31:46.933 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-17T02:31:46.933 DEBUG:teuthology.orchestra.run.smithi106:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:31:46.937 DEBUG:teuthology.orchestra.run.smithi171:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:31:46.966 INFO:teuthology.orchestra.run.smithi106.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:31:46.971 INFO:teuthology.orchestra.run.smithi171.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:31:46.973 INFO:teuthology.orchestra.run.smithi106.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:31:46.973 INFO:teuthology.orchestra.run.smithi106.stdout:=============================================================================== 2024-08-17T02:31:46.973 INFO:teuthology.orchestra.run.smithi106.stdout:^* hv01.front.sepia.ceph.com 3 6 377 19 -67us[ -46us] +/- 60ms 2024-08-17T02:31:46.974 INFO:teuthology.orchestra.run.smithi106.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 20 -78us[ -57us] +/- 63ms 2024-08-17T02:31:46.974 INFO:teuthology.orchestra.run.smithi106.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 20 +186us[ +207us] +/- 62ms 2024-08-17T02:31:46.974 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:31:46.977 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:31:46.977 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2024-08-17T02:31:46.977 INFO:teuthology.orchestra.run.smithi171.stdout:^* hv01.front.sepia.ceph.com 3 6 377 19 -62us[ -47us] +/- 60ms 2024-08-17T02:31:46.978 INFO:teuthology.orchestra.run.smithi171.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 18 -46us[ -46us] +/- 63ms 2024-08-17T02:31:46.978 INFO:teuthology.orchestra.run.smithi171.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 +197us[ +212us] +/- 62ms 2024-08-17T02:31:46.978 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:31:46.979 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-17T02:31:46.987 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-17T02:31:46.988 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-17T02:31:47.002 DEBUG:teuthology.orchestra.run.smithi106:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:31:47.131 DEBUG:teuthology.orchestra.run.smithi171:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:31:47.243 DEBUG:teuthology.orchestra.run.smithi106:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:31:47.303 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:31:47.303 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:31:47.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:31:47.364 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-17T02:31:47.374 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-17T02:31:47.421 INFO:teuthology.task.internal:Duration was 750.184390 seconds 2024-08-17T02:31:47.422 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-17T02:31:47.433 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-17T02:31:47.433 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:31:47.437 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:31:47.520 INFO:teuthology.orchestra.run.smithi106.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:31:47.524 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:31:47.979 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-17T02:31:47.979 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi106.front.sepia.ceph.com 2024-08-17T02:31:47.979 DEBUG:teuthology.orchestra.run.smithi106:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:31:48.029 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi171.front.sepia.ceph.com 2024-08-17T02:31:48.029 DEBUG:teuthology.orchestra.run.smithi171:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:31:48.083 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-17T02:31:48.084 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:31:48.088 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:31:48.147 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-17T02:31:48.147 DEBUG:teuthology.orchestra.run.smithi106:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:31:48.151 DEBUG:teuthology.orchestra.run.smithi171:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:31:48.291 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-17T02:31:48.302 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-17T02:31:48.302 DEBUG:teuthology.orchestra.run.smithi106:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:31:48.358 DEBUG:teuthology.orchestra.run.smithi171:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:31:48.414 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-17T02:31:48.423 DEBUG:teuthology.orchestra.run.smithi106:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:31:48.428 DEBUG:teuthology.orchestra.run.smithi171:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:31:48.494 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = core 2024-08-17T02:31:48.498 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = core 2024-08-17T02:31:48.528 DEBUG:teuthology.orchestra.run.smithi106:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:31:48.561 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:31:48.562 DEBUG:teuthology.orchestra.run.smithi171:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:31:48.595 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:31:48.595 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-17T02:31:48.604 INFO:teuthology.task.internal:Transferring archived files... 2024-08-17T02:31:48.605 DEBUG:teuthology.misc:Transferring archived files from smithi106:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858282/remote/smithi106 2024-08-17T02:31:48.605 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:31:48.670 DEBUG:teuthology.misc:Transferring archived files from smithi171:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858282/remote/smithi171 2024-08-17T02:31:48.670 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:31:48.732 INFO:teuthology.task.internal:Removing archive directory... 2024-08-17T02:31:48.733 DEBUG:teuthology.orchestra.run.smithi106:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:31:48.737 DEBUG:teuthology.orchestra.run.smithi171:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:31:48.772 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-17T02:31:48.783 INFO:teuthology.task.internal:Not uploading archives. 2024-08-17T02:31:48.783 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-17T02:31:48.795 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-17T02:31:48.795 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:31:48.812 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:31:48.843 INFO:teuthology.orchestra.run.smithi106.stdout: 395180 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:31 /home/ubuntu/cephtest 2024-08-17T02:31:48.847 INFO:teuthology.orchestra.run.smithi171.stdout: 395180 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:31 /home/ubuntu/cephtest 2024-08-17T02:31:48.849 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-17T02:31:48.863 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-17T02:31:48.891 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 client.1-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} duration: 750.1843900680542 failure_reason: 'Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=b9c47e2f1126403fbd5addc54c52c945 status: fail success: false 2024-08-17T02:31:48.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:31:48.963 INFO:teuthology.run:FAIL